2024-09-11T14:25:03.036 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T14:25:03.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T14:25:03.144 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901362 branch: main description: crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore thrashers/simple thrashosds-health workloads/radosbench} email: null first_in_suite: false job_id: '7901362' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client.0: debug ms: 1 debug objecter: 20 debug rados: 20 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 osd pool default crimson: true paxos service trim min: 10 osd: crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug ms: 1 debug osd: 20 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore ompap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd max backfills: 3 osd max markdown count: 1000 osd objectstore: seastore osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a thrashosds: min_in: 4 workunit: branch: wip-matanb-crimson-seastore-logs env: CRIMSON_COMPAT: '1' sha1: dbebf1a3db6db7b5579464ee715edcf1b3e9cce2 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 5813 sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a sleep_before_teardown: 0 suite: crimson-rados suite_branch: wip-matanb-crimson-seastore-logs suite_path: /home/teuthworker/src/github.com_matan-b_ceph_dbebf1a3db6db7b5579464ee715edcf1b3e9cce2/qa suite_relpath: qa suite_repo: https://github.com/matan-b/ceph.git suite_sha1: dbebf1a3db6db7b5579464ee715edcf1b3e9cce2 targets: smithi103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJCS5ZNaZ3SvQMlN2GkBgywAGk4vw7tuaZpQlEbAaHWhxqmKYna8UvrTQL/q1KhPuE+0Y58166ksd+wKwVPY0fQ= smithi176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBItYjkqnoCqrfFwIqVfJ/De9259aHoBTYL7BeK1SHAoGnw1jvuTQavO4ycUdY3GHtBVJoeXPP+9quMeayHnMsrE= tasks: - install: null - ceph: conf: osd: debug monc: 20 flavor: crimson - thrashosds: ceph_objectstore_tool: false chance_down: 0 chance_inject_pause_short: 0 chance_reset_purged_snaps_last: 0 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 dump_ops_enable: false min_in: 3 noscrub_toggle_delay: 0 reweight_osd: 0 sighup_delay: 0 thrash_primary_affinity: false timeout: 2400 - full_sequential: - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_13:56:22 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T14:25:03.145 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_matan-b_ceph_dbebf1a3db6db7b5579464ee715edcf1b3e9cce2/qa; will attempt to use it 2024-09-11T14:25:03.145 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_matan-b_ceph_dbebf1a3db6db7b5579464ee715edcf1b3e9cce2/qa/tasks 2024-09-11T14:25:03.146 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T14:25:03.147 INFO:teuthology.task.internal:Checking packages... 2024-09-11T14:25:03.168 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '0d61375b8ab53be4c233f5b93e463edfdff9316a' 2024-09-11T14:25:03.169 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T14:25:03.169 INFO:teuthology.packaging:ref: None 2024-09-11T14:25:03.169 INFO:teuthology.packaging:tag: None 2024-09-11T14:25:03.169 INFO:teuthology.packaging:branch: main 2024-09-11T14:25:03.169 INFO:teuthology.packaging:sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a 2024-09-11T14:25:03.169 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=main 2024-09-11T14:25:03.381 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4872.g0d61375b 2024-09-11T14:25:03.383 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T14:25:03.390 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T14:25:03.390 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T14:25:03.508 INFO:teuthology.task.internal:Saving configuration 2024-09-11T14:25:03.524 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T14:25:03.537 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T14:25:03.561 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901362', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 14:19:50.166245', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJCS5ZNaZ3SvQMlN2GkBgywAGk4vw7tuaZpQlEbAaHWhxqmKYna8UvrTQL/q1KhPuE+0Y58166ksd+wKwVPY0fQ='} 2024-09-11T14:25:03.584 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901362', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 14:19:50.168064', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBItYjkqnoCqrfFwIqVfJ/De9259aHoBTYL7BeK1SHAoGnw1jvuTQavO4ycUdY3GHtBVJoeXPP+9quMeayHnMsrE='} 2024-09-11T14:25:03.585 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T14:25:03.590 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-09-11T14:25:03.590 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-11T14:25:03.590 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T14:25:03.676 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fae8937bac0>, signals=[15]) 2024-09-11T14:25:03.676 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T14:25:03.691 INFO:teuthology.task.internal:Opening connections... 2024-09-11T14:25:03.691 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2024-09-11T14:25:03.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:25:03.774 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi176.front.sepia.ceph.com 2024-09-11T14:25:03.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:25:03.850 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T14:25:03.856 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-09-11T14:25:03.874 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-09-11T14:25:03.874 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-09-11T14:25:03.931 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-09-11T14:25:03.931 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-09-11T14:25:03.931 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-09-11T14:25:03.931 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-09-11T14:25:03.932 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-09-11T14:25:03.932 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-09-11T14:25:03.932 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T14:25:03.932 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-09-11T14:25:03.932 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-09-11T14:25:03.932 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T14:25:03.932 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-09-11T14:25:03.932 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T14:25:03.932 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T14:25:03.932 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T14:25:03.933 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-09-11T14:25:03.956 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2024-09-11T14:25:03.975 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2024-09-11T14:25:03.975 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2024-09-11T14:25:04.033 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream" 2024-09-11T14:25:04.034 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="9" 2024-09-11T14:25:04.034 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2024-09-11T14:25:04.034 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2024-09-11T14:25:04.034 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="9" 2024-09-11T14:25:04.034 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el9" 2024-09-11T14:25:04.034 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T14:25:04.034 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2024-09-11T14:25:04.034 INFO:teuthology.orchestra.run.smithi176.stdout:LOGO="fedora-logo-icon" 2024-09-11T14:25:04.034 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T14:25:04.034 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/" 2024-09-11T14:25:04.034 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T14:25:04.034 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T14:25:04.035 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T14:25:04.035 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2024-09-11T14:25:04.056 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T14:25:04.065 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T14:25:04.175 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T14:25:04.176 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2024-09-11T14:25:04.179 DEBUG:teuthology.orchestra.run.smithi176:> test '!' -e /home/ubuntu/cephtest 2024-09-11T14:25:04.196 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T14:25:04.203 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T14:25:04.203 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2024-09-11T14:25:04.237 DEBUG:teuthology.orchestra.run.smithi176:> test -z $(ls -A /var/lib/ceph) 2024-09-11T14:25:04.530 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T14:25:04.582 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T14:25:04.596 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-11T14:25:04.597 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-11T14:25:04.597 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T14:25:04.598 DEBUG:teuthology.orchestra.run.smithi176:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T14:25:04.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:25:04.615 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-11T14:25:04.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:25:04.616 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-09-11T14:25:04.674 INFO:teuthology.orchestra.run.smithi176.stdout:5.14.0-503.el9.x86_64 2024-09-11T14:25:04.674 INFO:teuthology.task.kernel:Running kernel on smithi176: 5.14.0-503.el9.x86_64 2024-09-11T14:25:04.674 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum install -y kernel 2024-09-11T14:25:04.675 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-503.el9.x86_64 2024-09-11T14:25:04.676 INFO:teuthology.task.kernel:Running kernel on smithi103: 5.14.0-503.el9.x86_64 2024-09-11T14:25:04.676 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum install -y kernel 2024-09-11T14:25:07.170 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-11T14:25:07.977 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.2 MB 00:01 2024-09-11T14:25:09.171 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-11T14:25:10.029 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-11T14:25:15.330 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.5 MB 00:01 2024-09-11T14:25:16.338 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 6.5 MB 00:03 2024-09-11T14:25:17.105 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 19 kB 00:00 2024-09-11T14:25:17.780 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - Extras packages 92 kB/s | 19 kB 00:00 2024-09-11T14:25:17.976 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-11T14:25:18.968 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-11T14:25:23.391 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-11T14:25:24.490 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-11T14:25:25.397 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T14:25:25.398 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T14:25:25.482 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:25:25.491 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:25:25.491 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-09-11T14:25:25.491 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:25:25.491 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-11T14:25:25.491 INFO:teuthology.orchestra.run.smithi103.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T14:25:25.491 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-11T14:25:25.491 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T14:25:25.491 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T14:25:25.492 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T14:25:25.492 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:25:25.492 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-11T14:25:25.492 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:25:25.492 INFO:teuthology.orchestra.run.smithi103.stdout:Install 4 Packages 2024-09-11T14:25:25.492 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:25:25.493 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 79 M 2024-09-11T14:25:25.493 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 126 M 2024-09-11T14:25:25.493 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-11T14:25:25.667 INFO:teuthology.orchestra.run.smithi103.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 177 kB/s | 23 kB 00:00 2024-09-11T14:25:26.342 INFO:teuthology.orchestra.run.smithi103.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-11T14:25:26.571 INFO:teuthology.orchestra.run.smithi176.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T14:25:26.571 INFO:teuthology.orchestra.run.smithi176.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T14:25:26.659 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:25:26.666 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:25:26.666 INFO:teuthology.orchestra.run.smithi176.stdout: Package Architecture Version Repository Size 2024-09-11T14:25:26.666 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:25:26.666 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-11T14:25:26.666 INFO:teuthology.orchestra.run.smithi176.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T14:25:26.667 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-11T14:25:26.667 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T14:25:26.667 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T14:25:26.667 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T14:25:26.667 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:25:26.667 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-11T14:25:26.667 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:25:26.667 INFO:teuthology.orchestra.run.smithi176.stdout:Install 4 Packages 2024-09-11T14:25:26.667 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:25:26.668 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 79 M 2024-09-11T14:25:26.668 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 126 M 2024-09-11T14:25:26.668 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-11T14:25:26.849 INFO:teuthology.orchestra.run.smithi176.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 374 kB/s | 23 kB 00:00 2024-09-11T14:25:26.968 INFO:teuthology.orchestra.run.smithi103.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 24 MB/s | 35 MB 00:01 2024-09-11T14:25:27.318 INFO:teuthology.orchestra.run.smithi103.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 17 MB/s | 29 MB 00:01 2024-09-11T14:25:27.318 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:25:27.318 INFO:teuthology.orchestra.run.smithi103.stdout:Total 43 MB/s | 79 MB 00:01 2024-09-11T14:25:28.001 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-11T14:25:28.025 INFO:teuthology.orchestra.run.smithi176.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-11T14:25:28.358 INFO:teuthology.orchestra.run.smithi176.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 19 MB/s | 29 MB 00:01 2024-09-11T14:25:28.393 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-11T14:25:28.393 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-11T14:25:28.700 INFO:teuthology.orchestra.run.smithi176.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 18 MB/s | 35 MB 00:01 2024-09-11T14:25:28.700 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:25:28.700 INFO:teuthology.orchestra.run.smithi176.stdout:Total 39 MB/s | 79 MB 00:02 2024-09-11T14:25:29.359 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-11T14:25:29.360 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-11T14:25:29.379 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-11T14:25:29.723 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-11T14:25:29.723 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-11T14:25:30.666 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-11T14:25:30.666 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-11T14:25:31.825 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-11T14:25:32.479 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T14:25:32.562 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:25:33.150 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-11T14:25:33.869 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T14:25:33.958 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:25:35.354 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:25:35.498 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:25:36.758 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:25:36.886 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:25:40.326 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:25:40.466 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:25:41.729 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:25:41.844 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:25:45.315 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:25:46.684 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:26:23.423 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:26:23.463 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:26:23.817 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:26:23.817 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T14:26:23.817 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:26:23.817 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:26:24.679 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:26:24.680 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:26:24.680 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-11T14:26:24.680 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T14:26:24.680 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T14:26:24.680 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T14:26:24.680 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T14:26:24.680 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:26:24.680 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:26:24.972 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:26:25.012 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:26:25.039 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T14:26:25.126 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T14:26:25.126 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T14:26:25.126 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T14:26:25.126 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T14:26:25.126 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T14:26:25.127 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T14:26:25.127 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi103.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T14:26:25.127 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T14:26:25.185 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T14:26:25.185 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T14:26:25.185 DEBUG:teuthology.orchestra.run.smithi103:> sudo rpm -qi grub2-tools 2024-09-11T14:26:25.224 INFO:teuthology.orchestra.run.smithi103.stdout:Name : grub2-tools 2024-09-11T14:26:25.225 INFO:teuthology.orchestra.run.smithi103.stdout:Epoch : 1 2024-09-11T14:26:25.225 INFO:teuthology.orchestra.run.smithi103.stdout:Version : 2.06 2024-09-11T14:26:25.225 INFO:teuthology.orchestra.run.smithi103.stdout:Release : 82.el9 2024-09-11T14:26:25.225 INFO:teuthology.orchestra.run.smithi103.stdout:Architecture: x86_64 2024-09-11T14:26:25.225 INFO:teuthology.orchestra.run.smithi103.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T14:26:25.225 INFO:teuthology.orchestra.run.smithi103.stdout:Group : Unspecified 2024-09-11T14:26:25.225 INFO:teuthology.orchestra.run.smithi103.stdout:Size : 8274670 2024-09-11T14:26:25.225 INFO:teuthology.orchestra.run.smithi103.stdout:License : GPLv3+ 2024-09-11T14:26:25.225 INFO:teuthology.orchestra.run.smithi103.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T14:26:25.225 INFO:teuthology.orchestra.run.smithi103.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T14:26:25.226 INFO:teuthology.orchestra.run.smithi103.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T14:26:25.226 INFO:teuthology.orchestra.run.smithi103.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T14:26:25.226 INFO:teuthology.orchestra.run.smithi103.stdout:Packager : builder@centos.org 2024-09-11T14:26:25.226 INFO:teuthology.orchestra.run.smithi103.stdout:Vendor : CentOS 2024-09-11T14:26:25.226 INFO:teuthology.orchestra.run.smithi103.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T14:26:25.226 INFO:teuthology.orchestra.run.smithi103.stdout:Summary : Support tools for GRUB. 2024-09-11T14:26:25.226 INFO:teuthology.orchestra.run.smithi103.stdout:Description : 2024-09-11T14:26:25.226 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:26:25.226 INFO:teuthology.orchestra.run.smithi103.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T14:26:25.226 INFO:teuthology.orchestra.run.smithi103.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T14:26:25.226 INFO:teuthology.orchestra.run.smithi103.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T14:26:25.226 INFO:teuthology.orchestra.run.smithi103.stdout:hardware devices. 2024-09-11T14:26:25.226 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:26:25.226 INFO:teuthology.orchestra.run.smithi103.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T14:26:25.227 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T14:26:25.227 INFO:teuthology.task.kernel:Updating grub on smithi103 to boot 5.14.0-505.el9.x86_64 2024-09-11T14:26:25.228 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T14:26:25.371 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:26:25.371 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T14:26:25.371 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:26:25.371 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:26:25.866 INFO:teuthology.orchestra.run.smithi103.stderr:Generating grub configuration file ... 2024-09-11T14:26:26.259 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:26:26.259 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:26:26.259 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-11T14:26:26.259 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T14:26:26.259 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T14:26:26.259 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T14:26:26.259 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T14:26:26.259 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:26:26.259 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:26:26.631 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T14:26:26.720 INFO:teuthology.orchestra.run.smithi176.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T14:26:26.721 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T14:26:26.721 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T14:26:26.721 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T14:26:26.721 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T14:26:26.721 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-11T14:26:26.721 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi176.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T14:26:26.721 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T14:26:26.780 INFO:teuthology.orchestra.run.smithi176.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T14:26:26.780 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T14:26:26.780 DEBUG:teuthology.orchestra.run.smithi176:> sudo rpm -qi grub2-tools 2024-09-11T14:26:26.819 INFO:teuthology.orchestra.run.smithi176.stdout:Name : grub2-tools 2024-09-11T14:26:26.819 INFO:teuthology.orchestra.run.smithi176.stdout:Epoch : 1 2024-09-11T14:26:26.819 INFO:teuthology.orchestra.run.smithi176.stdout:Version : 2.06 2024-09-11T14:26:26.819 INFO:teuthology.orchestra.run.smithi176.stdout:Release : 82.el9 2024-09-11T14:26:26.819 INFO:teuthology.orchestra.run.smithi176.stdout:Architecture: x86_64 2024-09-11T14:26:26.819 INFO:teuthology.orchestra.run.smithi176.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T14:26:26.819 INFO:teuthology.orchestra.run.smithi176.stdout:Group : Unspecified 2024-09-11T14:26:26.819 INFO:teuthology.orchestra.run.smithi176.stdout:Size : 8274670 2024-09-11T14:26:26.820 INFO:teuthology.orchestra.run.smithi176.stdout:License : GPLv3+ 2024-09-11T14:26:26.820 INFO:teuthology.orchestra.run.smithi176.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T14:26:26.820 INFO:teuthology.orchestra.run.smithi176.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T14:26:26.820 INFO:teuthology.orchestra.run.smithi176.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T14:26:26.820 INFO:teuthology.orchestra.run.smithi176.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T14:26:26.820 INFO:teuthology.orchestra.run.smithi176.stdout:Packager : builder@centos.org 2024-09-11T14:26:26.820 INFO:teuthology.orchestra.run.smithi176.stdout:Vendor : CentOS 2024-09-11T14:26:26.820 INFO:teuthology.orchestra.run.smithi176.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T14:26:26.820 INFO:teuthology.orchestra.run.smithi176.stdout:Summary : Support tools for GRUB. 2024-09-11T14:26:26.820 INFO:teuthology.orchestra.run.smithi176.stdout:Description : 2024-09-11T14:26:26.820 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:26:26.820 INFO:teuthology.orchestra.run.smithi176.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T14:26:26.821 INFO:teuthology.orchestra.run.smithi176.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T14:26:26.821 INFO:teuthology.orchestra.run.smithi176.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T14:26:26.821 INFO:teuthology.orchestra.run.smithi176.stdout:hardware devices. 2024-09-11T14:26:26.821 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:26:26.821 INFO:teuthology.orchestra.run.smithi176.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T14:26:26.822 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T14:26:26.822 INFO:teuthology.task.kernel:Updating grub on smithi176 to boot 5.14.0-505.el9.x86_64 2024-09-11T14:26:26.822 DEBUG:teuthology.orchestra.run.smithi176:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T14:26:27.222 INFO:teuthology.orchestra.run.smithi103.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T14:26:27.261 INFO:teuthology.orchestra.run.smithi103.stderr:done 2024-09-11T14:26:27.262 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-09-11T14:26:27.279 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.QlXacUB7cD 2024-09-11T14:26:27.280 DEBUG:teuthology.orchestra.run.smithi103:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QlXacUB7cD 2024-09-11T14:26:27.348 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.QlXacUB7cD 2024-09-11T14:26:27.475 INFO:teuthology.orchestra.run.smithi176.stderr:Generating grub configuration file ... 2024-09-11T14:26:27.487 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.QlXacUB7cD is 6KB 2024-09-11T14:26:27.535 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.QlXacUB7cD 2024-09-11T14:26:27.550 DEBUG:teuthology.orchestra.run.smithi103:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T14:26:27.614 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T14:26:27.614 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T14:26:27.614 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T14:26:27.614 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T14:26:27.615 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T14:26:27.767 DEBUG:teuthology.orchestra.run.smithi103:> sudo shutdown -r now 2024-09-11T14:26:28.772 INFO:teuthology.orchestra.run.smithi176.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T14:26:28.798 INFO:teuthology.orchestra.run.smithi176.stderr:done 2024-09-11T14:26:28.801 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-09-11T14:26:28.817 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.Jw3EqgJ5kV 2024-09-11T14:26:28.817 DEBUG:teuthology.orchestra.run.smithi176:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Jw3EqgJ5kV 2024-09-11T14:26:28.891 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.Jw3EqgJ5kV 2024-09-11T14:26:29.031 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.Jw3EqgJ5kV is 6KB 2024-09-11T14:26:29.052 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.Jw3EqgJ5kV 2024-09-11T14:26:29.067 DEBUG:teuthology.orchestra.run.smithi176:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T14:26:29.131 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T14:26:29.131 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T14:26:29.131 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T14:26:29.131 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T14:26:29.132 DEBUG:teuthology.orchestra.run.smithi176:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T14:26:29.293 DEBUG:teuthology.orchestra.run.smithi176:> sudo shutdown -r now 2024-09-11T14:26:57.799 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T14:26:57.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-11T14:26:57.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:26:59.297 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-11T14:26:59.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-11T14:26:59.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:27:32.285 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-11T14:27:41.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-11T14:27:41.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:27:59.318 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T14:28:08.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-11T14:28:08.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:28:08.830 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-09-11T14:28:09.224 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-11T14:28:09.342 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-11T14:28:09.342 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-09-11T14:28:09.357 INFO:teuthology.orchestra.run.smithi176.stdout:5.14.0-505.el9.x86_64 2024-09-11T14:28:09.358 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T14:28:09.358 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T14:28:09.358 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T14:28:10.358 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-11T14:28:10.359 DEBUG:teuthology.orchestra.run.smithi176:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T14:28:10.435 INFO:teuthology.orchestra.run.smithi176.stdout:ttyS1 2024-09-11T14:28:10.464 DEBUG:teuthology.parallel:result is None 2024-09-11T14:28:41.299 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T14:28:53.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-11T14:28:53.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:28:53.931 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-11T14:28:54.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-11T14:28:54.256 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-11T14:28:54.256 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-11T14:28:54.271 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-505.el9.x86_64 2024-09-11T14:28:54.272 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T14:28:54.272 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T14:28:54.272 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T14:28:55.272 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T14:28:55.273 DEBUG:teuthology.orchestra.run.smithi103:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T14:28:55.624 INFO:teuthology.orchestra.run.smithi103.stdout:ttyS1 2024-09-11T14:28:55.646 DEBUG:teuthology.parallel:result is None 2024-09-11T14:28:55.646 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T14:28:55.652 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T14:28:55.653 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T14:28:55.655 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T14:28:55.676 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T14:28:55.705 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T14:28:55.755 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T14:28:55.756 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T14:28:55.758 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T14:28:55.788 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T14:28:55.805 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T14:28:55.805 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T14:28:55.824 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T14:28:55.859 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T14:28:55.860 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T14:28:55.871 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T14:28:55.871 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T14:28:55.873 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T14:28:55.880 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T14:28:55.880 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T14:28:55.916 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T14:28:55.944 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T14:28:55.953 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T14:28:55.953 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T14:28:55.987 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T14:28:56.004 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T14:28:56.086 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T14:28:56.144 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T14:28:56.223 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T14:28:56.270 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T14:28:56.271 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T14:28:56.336 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T14:28:56.378 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T14:28:56.430 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T14:28:56.513 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T14:28:56.560 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-11T14:28:56.560 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T14:28:56.629 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2024-09-11T14:28:56.632 DEBUG:teuthology.orchestra.run.smithi176:> sudo service rsyslog restart 2024-09-11T14:28:56.675 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T14:28:56.725 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T14:28:57.232 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T14:28:57.240 INFO:teuthology.task.internal:Starting timer... 2024-09-11T14:28:57.241 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T14:28:57.285 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T14:28:57.333 DEBUG:teuthology.orchestra.run.smithi103:> sudo service auditd rotate 2024-09-11T14:28:57.384 INFO:teuthology.orchestra.run.smithi103.stdout:Rotating logs: 2024-09-11T14:28:57.385 DEBUG:teuthology.orchestra.run.smithi176:> sudo service auditd rotate 2024-09-11T14:28:57.479 INFO:teuthology.orchestra.run.smithi176.stdout:Rotating logs: 2024-09-11T14:28:57.481 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T14:28:57.481 DEBUG:teuthology.orchestra.run.smithi103:> /usr/sbin/getenforce 2024-09-11T14:28:57.501 INFO:teuthology.orchestra.run.smithi103.stdout:Permissive 2024-09-11T14:28:57.501 DEBUG:teuthology.orchestra.run.smithi176:> /usr/sbin/getenforce 2024-09-11T14:28:57.526 INFO:teuthology.orchestra.run.smithi176.stdout:Permissive 2024-09-11T14:28:57.527 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi103.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi176.front.sepia.ceph.com': 'permissive'} 2024-09-11T14:28:57.527 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T14:28:57.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:28:57.569 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T14:28:57.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:28:57.599 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T14:28:57.599 DEBUG:teuthology.orchestra.run.smithi103:> sudo /usr/sbin/setenforce permissive 2024-09-11T14:28:57.643 DEBUG:teuthology.orchestra.run.smithi176:> sudo /usr/sbin/setenforce permissive 2024-09-11T14:28:57.682 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T14:28:57.691 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-11T14:28:57.694 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-11T14:28:57.800 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T14:28:57.811 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T14:28:57.812 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi103.front.sepia.ceph.com,smithi176.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T14:32:40.893 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi103.front.sepia.ceph.com'), Remote(name='ubuntu@smithi176.front.sepia.ceph.com')] 2024-09-11T14:32:40.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-11T14:32:40.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:32:40.976 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-11T14:32:41.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-11T14:32:41.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-11T14:32:41.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:32:41.149 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-09-11T14:32:41.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-11T14:32:41.229 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T14:32:41.242 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T14:32:41.243 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T14:32:41.243 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T14:32:41.246 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T14:32:41.246 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T14:32:41.272 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T14:32:41.287 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T14:32:41.300 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T14:32:41.310 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: ntpd: command not found 2024-09-11T14:32:41.314 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T14:32:41.322 INFO:teuthology.orchestra.run.smithi103.stdout:506 Cannot talk to daemon 2024-09-11T14:32:41.336 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T14:32:41.339 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: ntpd: command not found 2024-09-11T14:32:41.350 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T14:32:41.350 INFO:teuthology.orchestra.run.smithi176.stdout:506 Cannot talk to daemon 2024-09-11T14:32:41.365 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T14:32:41.378 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T14:32:41.410 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-11T14:32:41.414 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T14:32:41.414 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-11T14:32:41.414 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:32:41.414 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:32:41.414 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:32:41.414 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:32:41.435 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2024-09-11T14:32:41.438 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T14:32:41.438 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2024-09-11T14:32:41.438 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:32:41.438 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:32:41.438 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:32:41.439 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:32:41.439 INFO:teuthology.run_tasks:Running task install... 2024-09-11T14:32:41.451 DEBUG:teuthology.task.install:project ceph 2024-09-11T14:32:41.451 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}} 2024-09-11T14:32:41.451 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'} 2024-09-11T14:32:41.451 INFO:teuthology.task.install:Using flavor: crimson 2024-09-11T14:32:41.456 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T14:32:41.457 INFO:teuthology.task.install:extra packages: [] 2024-09-11T14:32:41.457 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a', 'tag': None, 'wait_for_package': False} 2024-09-11T14:32:41.457 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=0d61375b8ab53be4c233f5b93e463edfdff9316a 2024-09-11T14:32:41.459 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a', 'tag': None, 'wait_for_package': False} 2024-09-11T14:32:41.460 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=0d61375b8ab53be4c233f5b93e463edfdff9316a 2024-09-11T14:32:41.604 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/0d61375b8ab53be4c233f5b93e463edfdff9316a/centos/9/flavors/crimson/ 2024-09-11T14:32:41.604 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4872.g0d61375b 2024-09-11T14:32:41.614 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/0d61375b8ab53be4c233f5b93e463edfdff9316a/centos/9/flavors/crimson/ 2024-09-11T14:32:41.614 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4872.g0d61375b 2024-09-11T14:32:41.840 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/0d61375b8ab53be4c233f5b93e463edfdff9316a/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/0d61375b8ab53be4c233f5b93e463edfdff9316a/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/0d61375b8ab53be4c233f5b93e463edfdff9316a/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T14:32:41.840 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T14:32:41.840 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T14:32:41.847 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/0d61375b8ab53be4c233f5b93e463edfdff9316a/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/0d61375b8ab53be4c233f5b93e463edfdff9316a/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/0d61375b8ab53be4c233f5b93e463edfdff9316a/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T14:32:41.847 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-11T14:32:41.847 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T14:32:41.867 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-11T14:32:41.868 DEBUG:teuthology.orchestra.run.smithi103:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0d61375b8ab53be4c233f5b93e463edfdff9316a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T14:32:41.874 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-11T14:32:41.874 DEBUG:teuthology.orchestra.run.smithi176:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0d61375b8ab53be4c233f5b93e463edfdff9316a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T14:32:41.934 DEBUG:teuthology.orchestra.run.smithi103:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T14:32:41.940 DEBUG:teuthology.orchestra.run.smithi176:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T14:32:42.010 DEBUG:teuthology.orchestra.run.smithi103:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T14:32:42.015 DEBUG:teuthology.orchestra.run.smithi176:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T14:32:42.074 INFO:teuthology.orchestra.run.smithi103.stdout:check_obsoletes = 1 2024-09-11T14:32:42.075 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum clean all 2024-09-11T14:32:42.079 INFO:teuthology.orchestra.run.smithi176.stdout:check_obsoletes = 1 2024-09-11T14:32:42.081 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum clean all 2024-09-11T14:32:42.310 INFO:teuthology.orchestra.run.smithi103.stdout:45 files removed 2024-09-11T14:32:42.311 INFO:teuthology.orchestra.run.smithi176.stdout:45 files removed 2024-09-11T14:32:42.336 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-radosgw 2024-09-11T14:32:42.338 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-radosgw 2024-09-11T14:32:42.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph packages for x86_64 325 kB/s | 89 kB 00:00 2024-09-11T14:32:42.900 INFO:teuthology.orchestra.run.smithi176.stdout:ceph packages for x86_64 318 kB/s | 89 kB 00:00 2024-09-11T14:32:43.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph noarch packages 76 kB/s | 24 kB 00:00 2024-09-11T14:32:43.293 INFO:teuthology.orchestra.run.smithi176.stdout:ceph noarch packages 69 kB/s | 24 kB 00:00 2024-09-11T14:32:43.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph source packages 4.2 kB/s | 2.1 kB 00:00 2024-09-11T14:32:43.835 INFO:teuthology.orchestra.run.smithi176.stdout:ceph source packages 4.1 kB/s | 2.1 kB 00:00 2024-09-11T14:32:44.518 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-11T14:32:46.601 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.2 MB 00:02 2024-09-11T14:32:48.853 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 20 MB 00:03 2024-09-11T14:32:52.277 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 20 MB 00:04 2024-09-11T14:32:54.645 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.5 MB 00:01 2024-09-11T14:32:56.296 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 19 kB 00:00 2024-09-11T14:32:56.694 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-11T14:32:57.117 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-11T14:32:58.504 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-11T14:32:59.249 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 37 MB/s | 23 MB 00:00 2024-09-11T14:33:02.592 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-11T14:33:04.713 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-11T14:33:04.999 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:33:05.015 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:33:05.015 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-11T14:33:05.015 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:33:05.015 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-11T14:33:05.015 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 10 M 2024-09-11T14:33:05.015 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrading: 2024-09-11T14:33:05.016 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 3.5 M 2024-09-11T14:33:05.016 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 3.8 M 2024-09-11T14:33:05.016 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-11T14:33:05.016 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T14:33:05.016 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 6.1 M 2024-09-11T14:33:05.016 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 20 M 2024-09-11T14:33:05.016 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 25 k 2024-09-11T14:33:05.016 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T14:33:05.016 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T14:33:05.016 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T14:33:05.016 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 808 k 2024-09-11T14:33:05.017 INFO:teuthology.orchestra.run.smithi103.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T14:33:05.017 INFO:teuthology.orchestra.run.smithi103.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T14:33:05.017 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T14:33:05.017 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T14:33:05.017 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 558 k 2024-09-11T14:33:05.017 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T14:33:05.017 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 5.4 M 2024-09-11T14:33:05.017 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T14:33:05.017 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T14:33:05.017 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T14:33:05.017 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 45 k 2024-09-11T14:33:05.017 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 143 k 2024-09-11T14:33:05.018 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 159 k 2024-09-11T14:33:05.018 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T14:33:05.018 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 316 k 2024-09-11T14:33:05.018 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 303 k 2024-09-11T14:33:05.018 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 99 k 2024-09-11T14:33:05.018 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T14:33:05.018 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T14:33:05.018 INFO:teuthology.orchestra.run.smithi103.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T14:33:05.018 INFO:teuthology.orchestra.run.smithi103.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T14:33:05.018 INFO:teuthology.orchestra.run.smithi103.stdout:Installing weak dependencies: 2024-09-11T14:33:05.018 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T14:33:05.018 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:33:05.018 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-11T14:33:05.019 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:33:05.019 INFO:teuthology.orchestra.run.smithi103.stdout:Install 31 Packages 2024-09-11T14:33:05.019 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrade 2 Packages 2024-09-11T14:33:05.019 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:33:05.019 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 60 M 2024-09-11T14:33:05.019 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-11T14:33:05.975 INFO:teuthology.orchestra.run.smithi103.stdout:(1/33): ceph-base-19.3.0-4872.g0d61375b.el9.x86 11 MB/s | 6.1 MB 00:00 2024-09-11T14:33:06.042 INFO:teuthology.orchestra.run.smithi103.stdout:(2/33): ceph-selinux-19.3.0-4872.g0d61375b.el9. 377 kB/s | 25 kB 00:00 2024-09-11T14:33:06.142 INFO:teuthology.orchestra.run.smithi103.stdout:(3/33): libcephfs2-19.3.0-4872.g0d61375b.el9.x8 7.9 MB/s | 808 kB 00:00 2024-09-11T14:33:06.234 INFO:teuthology.orchestra.run.smithi103.stdout:(4/33): libradosstriper1-19.3.0-4872.g0d61375b. 6.0 MB/s | 558 kB 00:00 2024-09-11T14:33:06.668 INFO:teuthology.orchestra.run.smithi103.stdout:(5/33): librgw2-19.3.0-4872.g0d61375b.el9.x86_6 12 MB/s | 5.4 MB 00:00 2024-09-11T14:33:06.793 INFO:teuthology.orchestra.run.smithi103.stdout:(6/33): ceph-radosgw-19.3.0-4872.g0d61375b.el9. 7.7 MB/s | 10 MB 00:01 2024-09-11T14:33:06.818 INFO:teuthology.orchestra.run.smithi103.stdout:(7/33): python3-ceph-argparse-19.3.0-4872.g0d61 300 kB/s | 45 kB 00:00 2024-09-11T14:33:06.861 INFO:teuthology.orchestra.run.smithi103.stdout:(8/33): python3-ceph-common-19.3.0-4872.g0d6137 2.1 MB/s | 143 kB 00:00 2024-09-11T14:33:06.886 INFO:teuthology.orchestra.run.smithi103.stdout:(9/33): python3-cephfs-19.3.0-4872.g0d61375b.el 2.3 MB/s | 159 kB 00:00 2024-09-11T14:33:06.928 INFO:teuthology.orchestra.run.smithi103.stdout:(10/33): python3-rados-19.3.0-4872.g0d61375b.el 4.6 MB/s | 316 kB 00:00 2024-09-11T14:33:06.961 INFO:teuthology.orchestra.run.smithi103.stdout:(11/33): python3-rbd-19.3.0-4872.g0d61375b.el9. 3.9 MB/s | 303 kB 00:00 2024-09-11T14:33:06.995 INFO:teuthology.orchestra.run.smithi103.stdout:(12/33): python3-rgw-19.3.0-4872.g0d61375b.el9. 1.4 MB/s | 99 kB 00:00 2024-09-11T14:33:07.065 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:33:07.082 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:33:07.082 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-11T14:33:07.082 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:33:07.082 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-11T14:33:07.083 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 10 M 2024-09-11T14:33:07.083 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrading: 2024-09-11T14:33:07.083 INFO:teuthology.orchestra.run.smithi176.stdout: librados2 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 3.5 M 2024-09-11T14:33:07.083 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 3.8 M 2024-09-11T14:33:07.083 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-11T14:33:07.083 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T14:33:07.083 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 6.1 M 2024-09-11T14:33:07.083 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 20 M 2024-09-11T14:33:07.083 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 25 k 2024-09-11T14:33:07.083 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T14:33:07.083 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T14:33:07.083 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T14:33:07.083 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 808 k 2024-09-11T14:33:07.084 INFO:teuthology.orchestra.run.smithi176.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T14:33:07.084 INFO:teuthology.orchestra.run.smithi176.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T14:33:07.084 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T14:33:07.084 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T14:33:07.084 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 558 k 2024-09-11T14:33:07.084 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T14:33:07.084 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 5.4 M 2024-09-11T14:33:07.084 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T14:33:07.084 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T14:33:07.084 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T14:33:07.084 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 45 k 2024-09-11T14:33:07.084 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 143 k 2024-09-11T14:33:07.085 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 159 k 2024-09-11T14:33:07.085 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T14:33:07.085 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 316 k 2024-09-11T14:33:07.085 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 303 k 2024-09-11T14:33:07.085 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 99 k 2024-09-11T14:33:07.085 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T14:33:07.085 INFO:teuthology.orchestra.run.smithi176.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T14:33:07.085 INFO:teuthology.orchestra.run.smithi176.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T14:33:07.085 INFO:teuthology.orchestra.run.smithi176.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T14:33:07.085 INFO:teuthology.orchestra.run.smithi176.stdout:Installing weak dependencies: 2024-09-11T14:33:07.085 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T14:33:07.085 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:33:07.086 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-11T14:33:07.086 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:33:07.086 INFO:teuthology.orchestra.run.smithi176.stdout:Install 31 Packages 2024-09-11T14:33:07.086 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrade 2 Packages 2024-09-11T14:33:07.086 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:33:07.086 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 60 M 2024-09-11T14:33:07.086 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-11T14:33:07.429 INFO:teuthology.orchestra.run.smithi103.stdout:(13/33): boost-program-options-1.75.0-8.el9.x86 229 kB/s | 107 kB 00:00 2024-09-11T14:33:07.721 INFO:teuthology.orchestra.run.smithi103.stdout:(14/33): ceph-common-19.3.0-4872.g0d61375b.el9. 8.7 MB/s | 20 MB 00:02 2024-09-11T14:33:07.746 INFO:teuthology.orchestra.run.smithi103.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 227 kB/s | 171 kB 00:00 2024-09-11T14:33:07.771 INFO:teuthology.orchestra.run.smithi103.stdout:(16/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 468 kB/s | 160 kB 00:00 2024-09-11T14:33:07.964 INFO:teuthology.orchestra.run.smithi176.stdout:(1/33): ceph-base-19.3.0-4872.g0d61375b.el9.x86 7.7 MB/s | 6.1 MB 00:00 2024-09-11T14:33:07.972 INFO:teuthology.orchestra.run.smithi103.stdout:(17/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 292 kB 00:00 2024-09-11T14:33:08.031 INFO:teuthology.orchestra.run.smithi176.stdout:(2/33): ceph-selinux-19.3.0-4872.g0d61375b.el9. 378 kB/s | 25 kB 00:00 2024-09-11T14:33:08.089 INFO:teuthology.orchestra.run.smithi103.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 362 kB/s | 42 kB 00:00 2024-09-11T14:33:08.114 INFO:teuthology.orchestra.run.smithi103.stdout:(19/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 115 kB/s | 45 kB 00:00 2024-09-11T14:33:08.114 INFO:teuthology.orchestra.run.smithi176.stdout:(3/33): libcephfs2-19.3.0-4872.g0d61375b.el9.x8 9.5 MB/s | 808 kB 00:00 2024-09-11T14:33:08.206 INFO:teuthology.orchestra.run.smithi103.stdout:(20/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-11T14:33:08.207 INFO:teuthology.orchestra.run.smithi176.stdout:(4/33): libradosstriper1-19.3.0-4872.g0d61375b. 5.9 MB/s | 558 kB 00:00 2024-09-11T14:33:08.223 INFO:teuthology.orchestra.run.smithi103.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 330 kB/s | 36 kB 00:00 2024-09-11T14:33:08.274 INFO:teuthology.orchestra.run.smithi103.stdout:(22/33): gperftools-libs-2.9.1-2.el9.x86_64.rpm 6.1 MB/s | 309 kB 00:00 2024-09-11T14:33:08.315 INFO:teuthology.orchestra.run.smithi103.stdout:(23/33): librdkafka-1.6.1-102.el9.x86_64.rpm 1.1 MB/s | 662 kB 00:00 2024-09-11T14:33:08.332 INFO:teuthology.orchestra.run.smithi103.stdout:(24/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 376 kB/s | 47 kB 00:00 2024-09-11T14:33:08.374 INFO:teuthology.orchestra.run.smithi103.stdout:(25/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 444 kB/s | 26 kB 00:00 2024-09-11T14:33:08.391 INFO:teuthology.orchestra.run.smithi103.stdout:(26/33): liboath-2.6.7-2.el9.x86_64.rpm 955 kB/s | 49 kB 00:00 2024-09-11T14:33:08.417 INFO:teuthology.orchestra.run.smithi103.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-11T14:33:08.450 INFO:teuthology.orchestra.run.smithi103.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-11T14:33:08.501 INFO:teuthology.orchestra.run.smithi103.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-11T14:33:08.576 INFO:teuthology.orchestra.run.smithi103.stdout:(30/33): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-11T14:33:08.599 INFO:teuthology.orchestra.run.smithi176.stdout:(5/33): librgw2-19.3.0-4872.g0d61375b.el9.x86_6 14 MB/s | 5.4 MB 00:00 2024-09-11T14:33:08.626 INFO:teuthology.orchestra.run.smithi103.stdout:(31/33): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-09-11T14:33:08.691 INFO:teuthology.orchestra.run.smithi176.stdout:(6/33): python3-ceph-argparse-19.3.0-4872.g0d61 492 kB/s | 45 kB 00:00 2024-09-11T14:33:08.824 INFO:teuthology.orchestra.run.smithi176.stdout:(7/33): ceph-radosgw-19.3.0-4872.g0d61375b.el9. 6.3 MB/s | 10 MB 00:01 2024-09-11T14:33:08.850 INFO:teuthology.orchestra.run.smithi176.stdout:(8/33): python3-ceph-common-19.3.0-4872.g0d6137 901 kB/s | 143 kB 00:00 2024-09-11T14:33:08.925 INFO:teuthology.orchestra.run.smithi176.stdout:(9/33): python3-cephfs-19.3.0-4872.g0d61375b.el 1.5 MB/s | 159 kB 00:00 2024-09-11T14:33:08.950 INFO:teuthology.orchestra.run.smithi176.stdout:(10/33): python3-rados-19.3.0-4872.g0d61375b.el 3.1 MB/s | 316 kB 00:00 2024-09-11T14:33:09.017 INFO:teuthology.orchestra.run.smithi176.stdout:(11/33): python3-rbd-19.3.0-4872.g0d61375b.el9. 3.2 MB/s | 303 kB 00:00 2024-09-11T14:33:09.034 INFO:teuthology.orchestra.run.smithi103.stdout:(32/33): librados2-19.3.0-4872.g0d61375b.el9.x8 6.5 MB/s | 3.5 MB 00:00 2024-09-11T14:33:09.042 INFO:teuthology.orchestra.run.smithi176.stdout:(12/33): python3-rgw-19.3.0-4872.g0d61375b.el9. 1.1 MB/s | 99 kB 00:00 2024-09-11T14:33:09.185 INFO:teuthology.orchestra.run.smithi103.stdout:(33/33): librbd1-19.3.0-4872.g0d61375b.el9.x86_ 6.2 MB/s | 3.8 MB 00:00 2024-09-11T14:33:09.190 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:33:09.191 INFO:teuthology.orchestra.run.smithi103.stdout:Total 14 MB/s | 60 MB 00:04 2024-09-11T14:33:09.201 INFO:teuthology.orchestra.run.smithi176.stdout:(13/33): boost-program-options-1.75.0-8.el9.x86 582 kB/s | 107 kB 00:00 2024-09-11T14:33:09.226 INFO:teuthology.orchestra.run.smithi176.stdout:(14/33): libnbd-1.20.2-2.el9.x86_64.rpm 929 kB/s | 171 kB 00:00 2024-09-11T14:33:09.268 INFO:teuthology.orchestra.run.smithi176.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-11T14:33:09.309 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-11T14:33:09.345 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-11T14:33:09.346 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-11T14:33:09.452 INFO:teuthology.orchestra.run.smithi176.stdout:(16/33): ceph-common-19.3.0-4872.g0d61375b.el9. 8.7 MB/s | 20 MB 00:02 2024-09-11T14:33:09.469 INFO:teuthology.orchestra.run.smithi176.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 599 kB/s | 160 kB 00:00 2024-09-11T14:33:09.527 INFO:teuthology.orchestra.run.smithi176.stdout:(18/33): librdkafka-1.6.1-102.el9.x86_64.rpm 2.5 MB/s | 662 kB 00:00 2024-09-11T14:33:09.586 INFO:teuthology.orchestra.run.smithi176.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-11T14:33:09.611 INFO:teuthology.orchestra.run.smithi176.stdout:(20/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-11T14:33:09.637 INFO:teuthology.orchestra.run.smithi176.stdout:(21/33): python3-prettytable-0.7.2-27.el9.noarc 252 kB/s | 42 kB 00:00 2024-09-11T14:33:09.662 INFO:teuthology.orchestra.run.smithi176.stdout:(22/33): qatlib-service-24.02.0-1.el9.x86_64.rp 476 kB/s | 36 kB 00:00 2024-09-11T14:33:09.695 INFO:teuthology.orchestra.run.smithi176.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-09-11T14:33:09.769 INFO:teuthology.orchestra.run.smithi176.stdout:(24/33): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.8 MB/s | 309 kB 00:00 2024-09-11T14:33:09.796 INFO:teuthology.orchestra.run.smithi176.stdout:(25/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 260 kB/s | 26 kB 00:00 2024-09-11T14:33:09.821 INFO:teuthology.orchestra.run.smithi176.stdout:(26/33): liboath-2.6.7-2.el9.x86_64.rpm 930 kB/s | 49 kB 00:00 2024-09-11T14:33:09.846 INFO:teuthology.orchestra.run.smithi176.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-11T14:33:09.880 INFO:teuthology.orchestra.run.smithi176.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-11T14:33:09.913 INFO:teuthology.orchestra.run.smithi176.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-11T14:33:09.964 INFO:teuthology.orchestra.run.smithi176.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-11T14:33:10.019 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-11T14:33:10.020 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-11T14:33:10.047 INFO:teuthology.orchestra.run.smithi176.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-11T14:33:10.206 INFO:teuthology.orchestra.run.smithi176.stdout:(32/33): librados2-19.3.0-4872.g0d61375b.el9.x8 12 MB/s | 3.5 MB 00:00 2024-09-11T14:33:10.265 INFO:teuthology.orchestra.run.smithi176.stdout:(33/33): librbd1-19.3.0-4872.g0d61375b.el9.x86_ 13 MB/s | 3.8 MB 00:00 2024-09-11T14:33:10.269 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:33:10.270 INFO:teuthology.orchestra.run.smithi176.stdout:Total 19 MB/s | 60 MB 00:03 2024-09-11T14:33:10.386 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-11T14:33:10.422 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-11T14:33:10.422 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-11T14:33:11.101 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-11T14:33:11.102 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-11T14:33:11.557 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-11T14:33:12.094 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-11T14:33:12.154 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 2/35 2024-09-11T14:33:12.230 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 2/35 2024-09-11T14:33:12.326 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rados-2:19.3.0-4872.g0d61375b.el9.x86_64 3/35 2024-09-11T14:33:12.355 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 4/35 2024-09-11T14:33:12.419 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 4/35 2024-09-11T14:33:12.472 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-11T14:33:12.502 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-11T14:33:12.527 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-11T14:33:12.550 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-11T14:33:12.577 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-11T14:33:12.602 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-11T14:33:12.922 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-11T14:33:12.958 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-11T14:33:12.993 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-11T14:33:13.037 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-argparse-2:19.3.0-4872.g0d61375b.el9. 11/35 2024-09-11T14:33:13.066 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cephfs-2:19.3.0-4872.g0d61375b.el9.x86_64 12/35 2024-09-11T14:33:13.123 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-11T14:33:13.145 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-11T14:33:13.180 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libradosstriper1-2:19.3.0-4872.g0d61375b.el9.x86_6 14/35 2024-09-11T14:33:13.208 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 2/35 2024-09-11T14:33:13.261 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4872.g0d61375b.el9.x86_6 14/35 2024-09-11T14:33:13.292 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 2/35 2024-09-11T14:33:13.313 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-11T14:33:13.390 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rados-2:19.3.0-4872.g0d61375b.el9.x86_64 3/35 2024-09-11T14:33:13.419 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-11T14:33:13.426 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 4/35 2024-09-11T14:33:13.452 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-11T14:33:13.473 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 4/35 2024-09-11T14:33:13.497 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-11T14:33:13.524 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-11T14:33:13.537 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 19/35 2024-09-11T14:33:13.556 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-11T14:33:13.566 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-11T14:33:13.581 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-11T14:33:13.604 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-11T14:33:13.611 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-11T14:33:13.631 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-11T14:33:13.834 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-11T14:33:13.870 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-11T14:33:13.905 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-11T14:33:13.948 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-argparse-2:19.3.0-4872.g0d61375b.el9. 11/35 2024-09-11T14:33:13.966 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-11T14:33:13.977 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cephfs-2:19.3.0-4872.g0d61375b.el9.x86_64 12/35 2024-09-11T14:33:14.021 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 23/35 2024-09-11T14:33:14.058 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-11T14:33:14.085 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libradosstriper1-2:19.3.0-4872.g0d61375b.el9.x86_6 14/35 2024-09-11T14:33:14.095 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 23/35 2024-09-11T14:33:14.126 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rbd-2:19.3.0-4872.g0d61375b.el9.x86_64 24/35 2024-09-11T14:33:14.162 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-11T14:33:14.173 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4872.g0d61375b.el9.x86_6 14/35 2024-09-11T14:33:14.209 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-11T14:33:14.321 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-11T14:33:14.352 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-11T14:33:14.398 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-11T14:33:14.425 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 19/35 2024-09-11T14:33:14.454 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-11T14:33:14.491 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-11T14:33:14.749 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-11T14:33:14.800 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librgw2-2:19.3.0-4872.g0d61375b.el9.x86_64 27/35 2024-09-11T14:33:14.861 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-11T14:33:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librgw2-2:19.3.0-4872.g0d61375b.el9.x86_64 27/35 2024-09-11T14:33:14.908 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 23/35 2024-09-11T14:33:14.948 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rgw-2:19.3.0-4872.g0d61375b.el9.x86_64 28/35 2024-09-11T14:33:14.976 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-common-2:19.3.0-4872.g0d61375b.el9.x8 29/35 2024-09-11T14:33:14.982 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 23/35 2024-09-11T14:33:15.013 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rbd-2:19.3.0-4872.g0d61375b.el9.x86_64 24/35 2024-09-11T14:33:15.049 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-11T14:33:15.645 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-11T14:33:15.669 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librgw2-2:19.3.0-4872.g0d61375b.el9.x86_64 27/35 2024-09-11T14:33:15.740 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librgw2-2:19.3.0-4872.g0d61375b.el9.x86_64 27/35 2024-09-11T14:33:15.818 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rgw-2:19.3.0-4872.g0d61375b.el9.x86_64 28/35 2024-09-11T14:33:15.879 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-common-2:19.3.0-4872.g0d61375b.el9.x8 29/35 2024-09-11T14:33:17.409 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 30/35 2024-09-11T14:33:17.449 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 30/35 2024-09-11T14:33:18.142 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 30/35 2024-09-11T14:33:18.186 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 31/35 2024-09-11T14:33:18.277 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 31/35 2024-09-11T14:33:18.277 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T14:33:18.277 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T14:33:18.277 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:33:18.320 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-selinux-2:19.3.0-4872.g0d61375b.el9.x86_64 32/35 2024-09-11T14:33:18.350 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 30/35 2024-09-11T14:33:18.467 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 30/35 2024-09-11T14:33:19.185 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 30/35 2024-09-11T14:33:19.254 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 31/35 2024-09-11T14:33:19.347 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 31/35 2024-09-11T14:33:19.347 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T14:33:19.347 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T14:33:19.347 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:33:19.380 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-selinux-2:19.3.0-4872.g0d61375b.el9.x86_64 32/35 2024-09-11T14:33:28.513 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4872.g0d61375b.el9.x86_64 32/35 2024-09-11T14:33:28.514 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /sys 2024-09-11T14:33:28.514 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /proc 2024-09-11T14:33:28.514 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /mnt 2024-09-11T14:33:28.514 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /var/tmp 2024-09-11T14:33:28.514 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /home 2024-09-11T14:33:28.514 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /root 2024-09-11T14:33:28.514 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /tmp 2024-09-11T14:33:28.514 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:33:29.663 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-radosgw-2:19.3.0-4872.g0d61375b.el9.x86_64 33/35 2024-09-11T14:33:29.689 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4872.g0d61375b.el9.x86_64 33/35 2024-09-11T14:33:29.689 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:33:29.689 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T14:33:29.689 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T14:33:29.689 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T14:33:29.689 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:33:29.690 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T14:33:29.709 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4872.g0d61375b.el9.x86_64 32/35 2024-09-11T14:33:29.709 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /sys 2024-09-11T14:33:29.709 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /proc 2024-09-11T14:33:29.709 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /mnt 2024-09-11T14:33:29.709 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /var/tmp 2024-09-11T14:33:29.709 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /home 2024-09-11T14:33:29.709 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /root 2024-09-11T14:33:29.709 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /tmp 2024-09-11T14:33:29.709 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:33:29.773 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T14:33:29.773 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:33:30.839 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-radosgw-2:19.3.0-4872.g0d61375b.el9.x86_64 33/35 2024-09-11T14:33:30.865 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4872.g0d61375b.el9.x86_64 33/35 2024-09-11T14:33:30.865 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:33:30.865 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T14:33:30.865 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T14:33:30.865 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T14:33:30.865 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:33:30.867 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T14:33:30.966 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T14:33:30.966 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:33:31.138 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:33:31.138 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 1/35 2024-09-11T14:33:31.138 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 2/35 2024-09-11T14:33:31.138 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-radosgw-2:19.3.0-4872.g0d61375b.el9.x86_64 3/35 2024-09-11T14:33:31.138 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-selinux-2:19.3.0-4872.g0d61375b.el9.x86_64 4/35 2024-09-11T14:33:31.139 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 5/35 2024-09-11T14:33:31.139 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libradosstriper1-2:19.3.0-4872.g0d61375b.el9.x86_6 6/35 2024-09-11T14:33:31.139 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librgw2-2:19.3.0-4872.g0d61375b.el9.x86_64 7/35 2024-09-11T14:33:31.139 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4872.g0d61375b.el9. 8/35 2024-09-11T14:33:31.139 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-common-2:19.3.0-4872.g0d61375b.el9.x8 9/35 2024-09-11T14:33:31.139 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cephfs-2:19.3.0-4872.g0d61375b.el9.x86_64 10/35 2024-09-11T14:33:31.139 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rados-2:19.3.0-4872.g0d61375b.el9.x86_64 11/35 2024-09-11T14:33:31.139 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rbd-2:19.3.0-4872.g0d61375b.el9.x86_64 12/35 2024-09-11T14:33:31.139 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rgw-2:19.3.0-4872.g0d61375b.el9.x86_64 13/35 2024-09-11T14:33:31.139 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-11T14:33:31.139 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-11T14:33:31.139 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-11T14:33:31.139 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-11T14:33:31.140 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-11T14:33:31.140 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-11T14:33:31.140 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-11T14:33:31.140 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-11T14:33:31.140 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-11T14:33:31.140 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-11T14:33:31.140 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 24/35 2024-09-11T14:33:31.140 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-11T14:33:31.140 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-11T14:33:31.140 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-11T14:33:31.140 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-11T14:33:31.140 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-11T14:33:31.140 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-11T14:33:31.141 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-11T14:33:31.141 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 32/35 2024-09-11T14:33:31.141 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-11T14:33:31.141 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 34/35 2024-09-11T14:33:32.123 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:33:32.123 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:33:32.123 INFO:teuthology.orchestra.run.smithi103.stdout:Upgraded: 2024-09-11T14:33:32.123 INFO:teuthology.orchestra.run.smithi103.stdout: librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:32.124 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-11T14:33:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T14:33:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T14:33:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T14:33:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T14:33:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T14:33:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T14:33:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T14:33:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T14:33:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T14:33:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T14:33:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T14:33:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T14:33:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T14:33:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T14:33:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T14:33:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T14:33:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T14:33:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T14:33:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:33:32.126 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:33:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:33:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 1/35 2024-09-11T14:33:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 2/35 2024-09-11T14:33:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-radosgw-2:19.3.0-4872.g0d61375b.el9.x86_64 3/35 2024-09-11T14:33:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-selinux-2:19.3.0-4872.g0d61375b.el9.x86_64 4/35 2024-09-11T14:33:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 5/35 2024-09-11T14:33:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libradosstriper1-2:19.3.0-4872.g0d61375b.el9.x86_6 6/35 2024-09-11T14:33:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librgw2-2:19.3.0-4872.g0d61375b.el9.x86_64 7/35 2024-09-11T14:33:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4872.g0d61375b.el9. 8/35 2024-09-11T14:33:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-common-2:19.3.0-4872.g0d61375b.el9.x8 9/35 2024-09-11T14:33:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cephfs-2:19.3.0-4872.g0d61375b.el9.x86_64 10/35 2024-09-11T14:33:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rados-2:19.3.0-4872.g0d61375b.el9.x86_64 11/35 2024-09-11T14:33:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rbd-2:19.3.0-4872.g0d61375b.el9.x86_64 12/35 2024-09-11T14:33:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rgw-2:19.3.0-4872.g0d61375b.el9.x86_64 13/35 2024-09-11T14:33:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-11T14:33:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-11T14:33:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-11T14:33:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-11T14:33:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-11T14:33:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-11T14:33:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-11T14:33:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-11T14:33:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-11T14:33:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-11T14:33:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 24/35 2024-09-11T14:33:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-11T14:33:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-11T14:33:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-11T14:33:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-11T14:33:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-11T14:33:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-11T14:33:32.290 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-11T14:33:32.290 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 32/35 2024-09-11T14:33:32.290 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-11T14:33:32.290 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 34/35 2024-09-11T14:33:32.486 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-test 2024-09-11T14:33:33.054 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:31 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:33:33.188 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:33:33.189 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:33:33.189 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-11T14:33:33.189 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:33:33.189 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-11T14:33:33.189 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 85 M 2024-09-11T14:33:33.189 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-11T14:33:33.189 INFO:teuthology.orchestra.run.smithi103.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-11T14:33:33.189 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 175 k 2024-09-11T14:33:33.189 INFO:teuthology.orchestra.run.smithi103.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-11T14:33:33.190 INFO:teuthology.orchestra.run.smithi103.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-11T14:33:33.190 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T14:33:33.190 INFO:teuthology.orchestra.run.smithi103.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T14:33:33.190 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T14:33:33.190 INFO:teuthology.orchestra.run.smithi103.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-11T14:33:33.190 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:33:33.190 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-11T14:33:33.190 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:33:33.190 INFO:teuthology.orchestra.run.smithi103.stdout:Install 9 Packages 2024-09-11T14:33:33.190 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:33:33.191 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 87 M 2024-09-11T14:33:33.191 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 797 M 2024-09-11T14:33:33.191 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-11T14:33:33.283 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:33:33.283 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:33:33.283 INFO:teuthology.orchestra.run.smithi176.stdout:Upgraded: 2024-09-11T14:33:33.283 INFO:teuthology.orchestra.run.smithi176.stdout: librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:33.284 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:33.284 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-11T14:33:33.284 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T14:33:33.284 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:33.284 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:33.284 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:33.284 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:33.284 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T14:33:33.284 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T14:33:33.284 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T14:33:33.284 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:33.284 INFO:teuthology.orchestra.run.smithi176.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T14:33:33.285 INFO:teuthology.orchestra.run.smithi176.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T14:33:33.285 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T14:33:33.285 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T14:33:33.285 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:33.285 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T14:33:33.285 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:33.285 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T14:33:33.285 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T14:33:33.285 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T14:33:33.285 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:33.285 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:33.285 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:33.286 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T14:33:33.286 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:33.286 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:33.286 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:33:33.286 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T14:33:33.286 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T14:33:33.286 INFO:teuthology.orchestra.run.smithi176.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T14:33:33.286 INFO:teuthology.orchestra.run.smithi176.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T14:33:33.286 INFO:teuthology.orchestra.run.smithi176.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T14:33:33.286 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:33:33.286 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:33:33.647 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-test 2024-09-11T14:33:33.707 INFO:teuthology.orchestra.run.smithi103.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 514 kB/s | 94 kB 00:00 2024-09-11T14:33:33.865 INFO:teuthology.orchestra.run.smithi103.stdout:(2/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 3.2 MB/s | 513 kB 00:00 2024-09-11T14:33:33.907 INFO:teuthology.orchestra.run.smithi103.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 183 kB 00:00 2024-09-11T14:33:33.974 INFO:teuthology.orchestra.run.smithi103.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-11T14:33:34.016 INFO:teuthology.orchestra.run.smithi103.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 7.1 MB/s | 304 kB 00:00 2024-09-11T14:33:34.050 INFO:teuthology.orchestra.run.smithi103.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2024-09-11T14:33:34.092 INFO:teuthology.orchestra.run.smithi103.stdout:(7/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.9 MB/s | 122 kB 00:00 2024-09-11T14:33:34.117 INFO:teuthology.orchestra.run.smithi103.stdout:(8/9): libcephsqlite-19.3.0-4872.g0d61375b.el9. 295 kB/s | 175 kB 00:00 2024-09-11T14:33:34.213 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:00:30 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:33:34.353 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:33:34.354 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:33:34.354 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-11T14:33:34.355 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:33:34.355 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-11T14:33:34.355 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 85 M 2024-09-11T14:33:34.355 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-11T14:33:34.355 INFO:teuthology.orchestra.run.smithi176.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-11T14:33:34.355 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 175 k 2024-09-11T14:33:34.355 INFO:teuthology.orchestra.run.smithi176.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-11T14:33:34.355 INFO:teuthology.orchestra.run.smithi176.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-11T14:33:34.355 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T14:33:34.355 INFO:teuthology.orchestra.run.smithi176.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T14:33:34.355 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T14:33:34.355 INFO:teuthology.orchestra.run.smithi176.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-11T14:33:34.355 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:33:34.356 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-11T14:33:34.356 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:33:34.356 INFO:teuthology.orchestra.run.smithi176.stdout:Install 9 Packages 2024-09-11T14:33:34.356 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:33:34.356 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 87 M 2024-09-11T14:33:34.356 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 797 M 2024-09-11T14:33:34.357 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-11T14:33:34.796 INFO:teuthology.orchestra.run.smithi176.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 629 kB/s | 94 kB 00:00 2024-09-11T14:33:34.947 INFO:teuthology.orchestra.run.smithi176.stdout:(2/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 3.4 MB/s | 513 kB 00:00 2024-09-11T14:33:34.997 INFO:teuthology.orchestra.run.smithi176.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 183 kB 00:00 2024-09-11T14:33:35.197 INFO:teuthology.orchestra.run.smithi176.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-09-11T14:33:35.305 INFO:teuthology.orchestra.run.smithi176.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-11T14:33:35.356 INFO:teuthology.orchestra.run.smithi176.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-11T14:33:35.398 INFO:teuthology.orchestra.run.smithi176.stdout:(7/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.9 MB/s | 122 kB 00:00 2024-09-11T14:33:35.423 INFO:teuthology.orchestra.run.smithi176.stdout:(8/9): libcephsqlite-19.3.0-4872.g0d61375b.el9. 225 kB/s | 175 kB 00:00 2024-09-11T14:33:40.021 INFO:teuthology.orchestra.run.smithi103.stdout:(9/9): ceph-test-19.3.0-4872.g0d61375b.el9.x86_ 13 MB/s | 85 MB 00:06 2024-09-11T14:33:40.024 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:33:40.024 INFO:teuthology.orchestra.run.smithi103.stdout:Total 13 MB/s | 87 MB 00:06 2024-09-11T14:33:40.108 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-11T14:33:40.132 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-11T14:33:40.132 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-11T14:33:40.736 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-11T14:33:40.737 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-11T14:33:41.625 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-11T14:33:41.716 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-11T14:33:41.762 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-11T14:33:41.805 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-11T14:33:41.834 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-11T14:33:41.871 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-11T14:33:41.896 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-11T14:33:41.976 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-11T14:33:42.022 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-11T14:33:42.048 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephsqlite-2:19.3.0-4872.g0d61375b.el9.x86_64 8/9 2024-09-11T14:33:47.764 INFO:teuthology.orchestra.run.smithi176.stdout:(9/9): ceph-test-19.3.0-4872.g0d61375b.el9.x86_ 6.5 MB/s | 85 MB 00:13 2024-09-11T14:33:47.767 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:33:47.767 INFO:teuthology.orchestra.run.smithi176.stdout:Total 6.5 MB/s | 87 MB 00:13 2024-09-11T14:33:47.850 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-11T14:33:47.873 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-11T14:33:47.873 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-11T14:33:48.474 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-11T14:33:48.474 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-11T14:33:49.354 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-11T14:33:49.442 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-11T14:33:49.499 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-11T14:33:49.543 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-11T14:33:49.576 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-11T14:33:49.609 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-11T14:33:49.634 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-11T14:33:49.709 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-11T14:33:49.752 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-11T14:33:49.786 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephsqlite-2:19.3.0-4872.g0d61375b.el9.x86_64 8/9 2024-09-11T14:33:53.265 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4872.g0d61375b.el9.x86_64 8/9 2024-09-11T14:33:53.339 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-test-2:19.3.0-4872.g0d61375b.el9.x86_64 9/9 2024-09-11T14:33:59.758 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-test-2:19.3.0-4872.g0d61375b.el9.x86_64 9/9 2024-09-11T14:33:59.759 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-test-2:19.3.0-4872.g0d61375b.el9.x86_64 1/9 2024-09-11T14:33:59.759 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephsqlite-2:19.3.0-4872.g0d61375b.el9.x86_64 2/9 2024-09-11T14:33:59.759 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-11T14:33:59.759 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-11T14:33:59.759 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-11T14:33:59.759 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-11T14:33:59.759 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-11T14:33:59.759 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-11T14:34:00.191 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-11T14:34:00.191 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:00.191 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-11T14:34:00.191 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:34:00.191 INFO:teuthology.orchestra.run.smithi103.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-11T14:34:00.192 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:34:00.192 INFO:teuthology.orchestra.run.smithi103.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-11T14:34:00.192 INFO:teuthology.orchestra.run.smithi103.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-11T14:34:00.192 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T14:34:00.192 INFO:teuthology.orchestra.run.smithi103.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T14:34:00.192 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T14:34:00.192 INFO:teuthology.orchestra.run.smithi103.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-11T14:34:00.192 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:00.192 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:34:00.551 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph 2024-09-11T14:34:01.000 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4872.g0d61375b.el9.x86_64 8/9 2024-09-11T14:34:01.075 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-test-2:19.3.0-4872.g0d61375b.el9.x86_64 9/9 2024-09-11T14:34:01.121 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:59 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:34:01.267 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:34:01.269 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:34:01.269 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-11T14:34:01.269 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:34:01.269 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-11T14:34:01.269 INFO:teuthology.orchestra.run.smithi103.stdout: ceph x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 6.5 k 2024-09-11T14:34:01.269 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-11T14:34:01.269 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 2.2 M 2024-09-11T14:34:01.269 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 1.6 M 2024-09-11T14:34:01.270 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 291 k 2024-09-11T14:34:01.270 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 5.1 M 2024-09-11T14:34:01.270 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 71 M 2024-09-11T14:34:01.270 INFO:teuthology.orchestra.run.smithi103.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T14:34:01.270 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T14:34:01.270 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T14:34:01.270 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T14:34:01.270 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T14:34:01.270 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T14:34:01.270 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T14:34:01.270 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T14:34:01.270 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T14:34:01.271 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T14:34:01.271 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections 2024-09-11T14:34:01.271 INFO:teuthology.orchestra.run.smithi103.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-11T14:34:01.271 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T14:34:01.271 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T14:34:01.271 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T14:34:01.271 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T14:34:01.271 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T14:34:01.271 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T14:34:01.271 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T14:34:01.271 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T14:34:01.271 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T14:34:01.271 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T14:34:01.272 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T14:34:01.272 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T14:34:01.272 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T14:34:01.272 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T14:34:01.272 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T14:34:01.272 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T14:34:01.272 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T14:34:01.272 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T14:34:01.272 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T14:34:01.272 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T14:34:01.272 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:01.273 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-11T14:34:01.273 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:34:01.273 INFO:teuthology.orchestra.run.smithi103.stdout:Install 37 Packages 2024-09-11T14:34:01.273 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:01.273 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 84 M 2024-09-11T14:34:01.274 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 896 M 2024-09-11T14:34:01.274 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-11T14:34:01.693 INFO:teuthology.orchestra.run.smithi103.stdout:(1/37): ceph-19.3.0-4872.g0d61375b.el9.x86_64.r 47 kB/s | 6.5 kB 00:00 2024-09-11T14:34:01.868 INFO:teuthology.orchestra.run.smithi103.stdout:(2/37): ceph-mgr-19.3.0-4872.g0d61375b.el9.x86_ 5.1 MB/s | 1.6 MB 00:00 2024-09-11T14:34:01.927 INFO:teuthology.orchestra.run.smithi103.stdout:(3/37): ceph-mds-19.3.0-4872.g0d61375b.el9.x86_ 5.9 MB/s | 2.2 MB 00:00 2024-09-11T14:34:01.985 INFO:teuthology.orchestra.run.smithi103.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4872.g0d61 4.9 MB/s | 291 kB 00:00 2024-09-11T14:34:02.419 INFO:teuthology.orchestra.run.smithi103.stdout:(5/37): ceph-mon-19.3.0-4872.g0d61375b.el9.x86_ 7.0 MB/s | 5.1 MB 00:00 2024-09-11T14:34:02.486 INFO:teuthology.orchestra.run.smithi103.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 506 kB/s | 253 kB 00:00 2024-09-11T14:34:02.911 INFO:teuthology.orchestra.run.smithi103.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 251 kB/s | 106 kB 00:00 2024-09-11T14:34:03.115 INFO:teuthology.orchestra.run.smithi103.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 1.8 MB/s | 1.2 MB 00:00 2024-09-11T14:34:03.899 INFO:teuthology.orchestra.run.smithi103.stdout:(9/37): ceph-osd-19.3.0-4872.g0d61375b.el9.x86_ 35 MB/s | 71 MB 00:02 2024-09-11T14:34:03.924 INFO:teuthology.orchestra.run.smithi103.stdout:(10/37): python3-pycparser-2.20-6.el9.noarch.rp 133 kB/s | 135 kB 00:01 2024-09-11T14:34:04.066 INFO:teuthology.orchestra.run.smithi103.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-09-11T14:34:04.091 INFO:teuthology.orchestra.run.smithi103.stdout:(12/37): python3-requests-2.25.1-8.el9.noarch.r 128 kB/s | 125 kB 00:00 2024-09-11T14:34:04.142 INFO:teuthology.orchestra.run.smithi103.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-11T14:34:04.184 INFO:teuthology.orchestra.run.smithi103.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 378 kB/s | 35 kB 00:00 2024-09-11T14:34:04.217 INFO:teuthology.orchestra.run.smithi103.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-09-11T14:34:04.268 INFO:teuthology.orchestra.run.smithi103.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-09-11T14:34:04.293 INFO:teuthology.orchestra.run.smithi103.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 552 kB/s | 42 kB 00:00 2024-09-11T14:34:04.344 INFO:teuthology.orchestra.run.smithi103.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-11T14:34:04.369 INFO:teuthology.orchestra.run.smithi103.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-11T14:34:04.394 INFO:teuthology.orchestra.run.smithi103.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 177 kB/s | 22 kB 00:00 2024-09-11T14:34:04.419 INFO:teuthology.orchestra.run.smithi103.stdout:(21/37): python3-urllib3-1.26.5-6.el9.noarch.rp 413 kB/s | 215 kB 00:00 2024-09-11T14:34:04.470 INFO:teuthology.orchestra.run.smithi103.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-11T14:34:04.495 INFO:teuthology.orchestra.run.smithi103.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 157 kB/s | 11 kB 00:00 2024-09-11T14:34:04.521 INFO:teuthology.orchestra.run.smithi103.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 378 kB/s | 18 kB 00:00 2024-09-11T14:34:04.546 INFO:teuthology.orchestra.run.smithi103.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-11T14:34:04.571 INFO:teuthology.orchestra.run.smithi103.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-09-11T14:34:04.597 INFO:teuthology.orchestra.run.smithi103.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-11T14:34:04.622 INFO:teuthology.orchestra.run.smithi103.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-09-11T14:34:04.647 INFO:teuthology.orchestra.run.smithi103.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-11T14:34:04.673 INFO:teuthology.orchestra.run.smithi103.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 658 kB/s | 16 kB 00:00 2024-09-11T14:34:04.697 INFO:teuthology.orchestra.run.smithi103.stdout:(31/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-09-11T14:34:04.723 INFO:teuthology.orchestra.run.smithi103.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-11T14:34:04.748 INFO:teuthology.orchestra.run.smithi103.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-11T14:34:04.782 INFO:teuthology.orchestra.run.smithi103.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-11T14:34:04.808 INFO:teuthology.orchestra.run.smithi103.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 800 kB/s | 20 kB 00:00 2024-09-11T14:34:04.833 INFO:teuthology.orchestra.run.smithi103.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-11T14:34:04.858 INFO:teuthology.orchestra.run.smithi103.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-11T14:34:04.863 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:34:04.863 INFO:teuthology.orchestra.run.smithi103.stdout:Total 23 MB/s | 84 MB 00:03 2024-09-11T14:34:05.019 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-11T14:34:05.060 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-11T14:34:05.061 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-11T14:34:05.865 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-11T14:34:05.865 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-11T14:34:07.049 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-test-2:19.3.0-4872.g0d61375b.el9.x86_64 9/9 2024-09-11T14:34:07.049 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-test-2:19.3.0-4872.g0d61375b.el9.x86_64 1/9 2024-09-11T14:34:07.050 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephsqlite-2:19.3.0-4872.g0d61375b.el9.x86_64 2/9 2024-09-11T14:34:07.050 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-11T14:34:07.050 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-11T14:34:07.050 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-11T14:34:07.050 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-11T14:34:07.050 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-11T14:34:07.050 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-11T14:34:07.423 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-11T14:34:07.424 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:07.424 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-11T14:34:07.424 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:34:07.424 INFO:teuthology.orchestra.run.smithi176.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-11T14:34:07.424 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:34:07.424 INFO:teuthology.orchestra.run.smithi176.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-11T14:34:07.424 INFO:teuthology.orchestra.run.smithi176.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-11T14:34:07.424 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T14:34:07.424 INFO:teuthology.orchestra.run.smithi176.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T14:34:07.424 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T14:34:07.424 INFO:teuthology.orchestra.run.smithi176.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-11T14:34:07.424 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:07.425 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:34:07.533 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-11T14:34:07.603 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-11T14:34:07.636 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-11T14:34:07.672 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-11T14:34:07.743 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-11T14:34:07.780 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph 2024-09-11T14:34:07.780 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-11T14:34:07.820 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-11T14:34:07.922 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-11T14:34:07.999 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-11T14:34:08.040 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-11T14:34:08.075 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-11T14:34:08.105 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-11T14:34:08.139 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-11T14:34:08.198 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-11T14:34:08.238 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-11T14:34:08.282 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-11T14:34:08.324 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-11T14:34:08.345 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:04 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:34:08.372 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-11T14:34:08.404 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-11T14:34:08.477 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-11T14:34:08.485 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:34:08.487 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:34:08.487 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-11T14:34:08.487 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:34:08.488 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-11T14:34:08.488 INFO:teuthology.orchestra.run.smithi176.stdout: ceph x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 6.5 k 2024-09-11T14:34:08.488 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-11T14:34:08.488 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 2.2 M 2024-09-11T14:34:08.488 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 1.6 M 2024-09-11T14:34:08.488 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 291 k 2024-09-11T14:34:08.488 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 5.1 M 2024-09-11T14:34:08.488 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 71 M 2024-09-11T14:34:08.488 INFO:teuthology.orchestra.run.smithi176.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T14:34:08.488 INFO:teuthology.orchestra.run.smithi176.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T14:34:08.488 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T14:34:08.488 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T14:34:08.488 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T14:34:08.489 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T14:34:08.489 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T14:34:08.489 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T14:34:08.489 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T14:34:08.489 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T14:34:08.489 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections 2024-09-11T14:34:08.489 INFO:teuthology.orchestra.run.smithi176.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-11T14:34:08.489 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T14:34:08.489 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T14:34:08.489 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T14:34:08.489 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T14:34:08.489 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T14:34:08.489 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T14:34:08.490 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T14:34:08.490 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T14:34:08.490 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T14:34:08.490 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T14:34:08.490 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T14:34:08.490 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T14:34:08.490 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T14:34:08.490 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T14:34:08.490 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T14:34:08.490 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T14:34:08.490 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T14:34:08.490 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T14:34:08.490 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T14:34:08.490 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T14:34:08.490 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:08.491 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-11T14:34:08.491 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:34:08.491 INFO:teuthology.orchestra.run.smithi176.stdout:Install 37 Packages 2024-09-11T14:34:08.491 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:08.491 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 84 M 2024-09-11T14:34:08.491 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 896 M 2024-09-11T14:34:08.491 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-11T14:34:08.625 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-11T14:34:08.722 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-11T14:34:08.783 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-11T14:34:08.821 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-11T14:34:08.879 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-11T14:34:08.935 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-11T14:34:09.002 INFO:teuthology.orchestra.run.smithi176.stdout:(1/37): ceph-19.3.0-4872.g0d61375b.el9.x86_64.r 55 kB/s | 6.5 kB 00:00 2024-09-11T14:34:09.122 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-11T14:34:09.176 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-11T14:34:09.185 INFO:teuthology.orchestra.run.smithi176.stdout:(2/37): ceph-mds-19.3.0-4872.g0d61375b.el9.x86_ 7.3 MB/s | 2.2 MB 00:00 2024-09-11T14:34:09.227 INFO:teuthology.orchestra.run.smithi176.stdout:(3/37): ceph-mgr-19.3.0-4872.g0d61375b.el9.x86_ 4.6 MB/s | 1.6 MB 00:00 2024-09-11T14:34:09.263 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-11T14:34:09.327 INFO:teuthology.orchestra.run.smithi176.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4872.g0d61 2.8 MB/s | 291 kB 00:00 2024-09-11T14:34:09.359 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-11T14:34:09.409 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-11T14:34:09.540 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-11T14:34:09.694 INFO:teuthology.orchestra.run.smithi176.stdout:(5/37): ceph-mon-19.3.0-4872.g0d61375b.el9.x86_ 7.4 MB/s | 5.1 MB 00:00 2024-09-11T14:34:09.730 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4872.g0d61375b.el9. 32/37 2024-09-11T14:34:09.752 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 33/37 2024-09-11T14:34:09.778 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 33/37 2024-09-11T14:34:09.779 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:34:09.779 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T14:34:09.779 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T14:34:09.779 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T14:34:09.779 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:09.970 INFO:teuthology.orchestra.run.smithi176.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 394 kB/s | 253 kB 00:00 2024-09-11T14:34:10.086 INFO:teuthology.orchestra.run.smithi176.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 914 kB/s | 106 kB 00:00 2024-09-11T14:34:10.203 INFO:teuthology.orchestra.run.smithi176.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.1 MB/s | 135 kB 00:00 2024-09-11T14:34:10.320 INFO:teuthology.orchestra.run.smithi176.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.0 MB/s | 125 kB 00:00 2024-09-11T14:34:10.437 INFO:teuthology.orchestra.run.smithi176.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.8 MB/s | 215 kB 00:00 2024-09-11T14:34:10.605 INFO:teuthology.orchestra.run.smithi176.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-09-11T14:34:11.197 INFO:teuthology.orchestra.run.smithi176.stdout:(12/37): ceph-osd-19.3.0-4872.g0d61375b.el9.x86 35 MB/s | 71 MB 00:02 2024-09-11T14:34:11.222 INFO:teuthology.orchestra.run.smithi176.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 279 kB/s | 172 kB 00:00 2024-09-11T14:34:11.264 INFO:teuthology.orchestra.run.smithi176.stdout:(14/37): python3-cryptography-36.0.1-4.el9.x86_ 800 kB/s | 1.2 MB 00:01 2024-09-11T14:34:11.289 INFO:teuthology.orchestra.run.smithi176.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.1 MB/s | 77 kB 00:00 2024-09-11T14:34:11.314 INFO:teuthology.orchestra.run.smithi176.stdout:(16/37): python3-markupsafe-1.1.1-12.el9.x86_64 297 kB/s | 35 kB 00:00 2024-09-11T14:34:11.339 INFO:teuthology.orchestra.run.smithi176.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 831 kB/s | 42 kB 00:00 2024-09-11T14:34:11.381 INFO:teuthology.orchestra.run.smithi176.stdout:(18/37): python3-pytz-2021.1-5.el9.noarch.rpm 435 kB/s | 51 kB 00:00 2024-09-11T14:34:11.415 INFO:teuthology.orchestra.run.smithi176.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-09-11T14:34:11.440 INFO:teuthology.orchestra.run.smithi176.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 767 kB/s | 43 kB 00:00 2024-09-11T14:34:11.465 INFO:teuthology.orchestra.run.smithi176.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.5 MB/s | 172 kB 00:00 2024-09-11T14:34:11.491 INFO:teuthology.orchestra.run.smithi176.stdout:(22/37): lua-devel-5.4.4-4.el9.x86_64.rpm 126 kB/s | 22 kB 00:00 2024-09-11T14:34:11.516 INFO:teuthology.orchestra.run.smithi176.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 214 kB/s | 11 kB 00:00 2024-09-11T14:34:11.549 INFO:teuthology.orchestra.run.smithi176.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 903 kB/s | 23 kB 00:00 2024-09-11T14:34:11.575 INFO:teuthology.orchestra.run.smithi176.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 839 kB/s | 19 kB 00:00 2024-09-11T14:34:11.600 INFO:teuthology.orchestra.run.smithi176.stdout:(26/37): python3-jaraco-classes-3.2.1-5.el9.noa 162 kB/s | 18 kB 00:00 2024-09-11T14:34:11.625 INFO:teuthology.orchestra.run.smithi176.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-11T14:34:11.650 INFO:teuthology.orchestra.run.smithi176.stdout:(28/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.9 MB/s | 358 kB 00:00 2024-09-11T14:34:11.676 INFO:teuthology.orchestra.run.smithi176.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 614 kB/s | 46 kB 00:00 2024-09-11T14:34:11.701 INFO:teuthology.orchestra.run.smithi176.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-11T14:34:11.718 INFO:teuthology.orchestra.run.smithi176.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 394 kB/s | 16 kB 00:00 2024-09-11T14:34:11.735 INFO:teuthology.orchestra.run.smithi176.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 2.1 MB/s | 36 kB 00:00 2024-09-11T14:34:11.760 INFO:teuthology.orchestra.run.smithi176.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-11T14:34:11.794 INFO:teuthology.orchestra.run.smithi176.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-11T14:34:11.811 INFO:teuthology.orchestra.run.smithi176.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-11T14:34:11.836 INFO:teuthology.orchestra.run.smithi176.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-11T14:34:11.865 INFO:teuthology.orchestra.run.smithi176.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.0 MB/s | 427 kB 00:00 2024-09-11T14:34:11.870 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:34:11.870 INFO:teuthology.orchestra.run.smithi176.stdout:Total 25 MB/s | 84 MB 00:03 2024-09-11T14:34:12.025 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-11T14:34:12.067 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-11T14:34:12.067 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-11T14:34:12.885 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-11T14:34:12.885 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-11T14:34:14.583 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-11T14:34:14.651 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-11T14:34:14.701 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-11T14:34:14.736 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-11T14:34:14.809 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-11T14:34:14.869 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-11T14:34:14.901 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-11T14:34:14.993 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-11T14:34:15.063 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-11T14:34:15.104 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-11T14:34:15.148 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-11T14:34:15.177 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-11T14:34:15.212 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-11T14:34:15.245 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-11T14:34:15.286 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-11T14:34:15.321 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-11T14:34:15.355 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-11T14:34:15.411 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-11T14:34:15.444 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-11T14:34:15.517 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-11T14:34:15.665 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-11T14:34:15.752 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-11T14:34:15.805 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-11T14:34:15.851 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-11T14:34:15.901 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-11T14:34:15.957 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-11T14:34:16.153 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-11T14:34:16.215 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-11T14:34:16.294 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-11T14:34:16.382 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-11T14:34:16.422 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-11T14:34:16.553 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-11T14:34:16.750 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4872.g0d61375b.el9. 32/37 2024-09-11T14:34:16.783 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 33/37 2024-09-11T14:34:16.809 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 33/37 2024-09-11T14:34:16.809 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:34:16.809 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T14:34:16.809 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T14:34:16.809 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T14:34:16.809 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:20.378 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-osd-2:19.3.0-4872.g0d61375b.el9.x86_64 34/37 2024-09-11T14:34:20.405 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-osd-2:19.3.0-4872.g0d61375b.el9.x86_64 34/37 2024-09-11T14:34:20.405 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:34:20.406 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T14:34:20.406 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T14:34:20.406 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T14:34:20.406 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:20.962 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mon-2:19.3.0-4872.g0d61375b.el9.x86_64 35/37 2024-09-11T14:34:20.986 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mon-2:19.3.0-4872.g0d61375b.el9.x86_64 35/37 2024-09-11T14:34:20.986 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:34:20.987 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T14:34:20.987 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T14:34:20.987 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T14:34:20.987 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:21.221 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mds-2:19.3.0-4872.g0d61375b.el9.x86_64 36/37 2024-09-11T14:34:21.244 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mds-2:19.3.0-4872.g0d61375b.el9.x86_64 36/37 2024-09-11T14:34:21.244 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:34:21.245 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T14:34:21.245 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T14:34:21.245 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T14:34:21.245 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:21.310 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-2:19.3.0-4872.g0d61375b.el9.x86_64 37/37 2024-09-11T14:34:27.324 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-osd-2:19.3.0-4872.g0d61375b.el9.x86_64 34/37 2024-09-11T14:34:27.351 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-osd-2:19.3.0-4872.g0d61375b.el9.x86_64 34/37 2024-09-11T14:34:27.351 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:34:27.351 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T14:34:27.351 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T14:34:27.351 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T14:34:27.351 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:27.900 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mon-2:19.3.0-4872.g0d61375b.el9.x86_64 35/37 2024-09-11T14:34:27.923 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mon-2:19.3.0-4872.g0d61375b.el9.x86_64 35/37 2024-09-11T14:34:27.924 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:34:27.924 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T14:34:27.924 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T14:34:27.924 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T14:34:27.924 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:28.159 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mds-2:19.3.0-4872.g0d61375b.el9.x86_64 36/37 2024-09-11T14:34:28.182 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mds-2:19.3.0-4872.g0d61375b.el9.x86_64 36/37 2024-09-11T14:34:28.182 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:34:28.183 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T14:34:28.183 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T14:34:28.183 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T14:34:28.183 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:28.190 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-2:19.3.0-4872.g0d61375b.el9.x86_64 37/37 2024-09-11T14:34:28.190 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-2:19.3.0-4872.g0d61375b.el9.x86_64 1/37 2024-09-11T14:34:28.190 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mds-2:19.3.0-4872.g0d61375b.el9.x86_64 2/37 2024-09-11T14:34:28.190 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 3/37 2024-09-11T14:34:28.190 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mon-2:19.3.0-4872.g0d61375b.el9.x86_64 4/37 2024-09-11T14:34:28.190 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-osd-2:19.3.0-4872.g0d61375b.el9.x86_64 5/37 2024-09-11T14:34:28.190 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4872.g0d61375b.el9. 6/37 2024-09-11T14:34:28.191 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-11T14:34:28.191 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-11T14:34:28.191 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-11T14:34:28.191 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-11T14:34:28.191 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-11T14:34:28.191 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-11T14:34:28.191 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-11T14:34:28.191 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-11T14:34:28.191 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-11T14:34:28.191 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-11T14:34:28.191 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-11T14:34:28.191 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-11T14:34:28.191 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-11T14:34:28.191 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-11T14:34:28.192 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-11T14:34:28.192 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-11T14:34:28.192 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-11T14:34:28.192 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-11T14:34:28.192 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-11T14:34:28.192 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-11T14:34:28.192 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-11T14:34:28.193 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-11T14:34:28.193 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-11T14:34:28.193 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-11T14:34:28.194 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-11T14:34:28.194 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-11T14:34:28.194 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-11T14:34:28.194 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-11T14:34:28.194 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-11T14:34:28.194 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-11T14:34:28.246 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-2:19.3.0-4872.g0d61375b.el9.x86_64 37/37 2024-09-11T14:34:29.143 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-11T14:34:29.143 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:29.143 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-11T14:34:29.143 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:34:29.143 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:34:29.143 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:34:29.143 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:34:29.144 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:34:29.144 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:34:29.144 INFO:teuthology.orchestra.run.smithi103.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T14:34:29.144 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T14:34:29.144 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T14:34:29.144 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T14:34:29.144 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T14:34:29.144 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T14:34:29.144 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T14:34:29.144 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T14:34:29.144 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T14:34:29.144 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T14:34:29.145 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T14:34:29.145 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T14:34:29.145 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T14:34:29.145 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T14:34:29.145 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T14:34:29.145 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T14:34:29.145 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T14:34:29.145 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T14:34:29.145 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T14:34:29.145 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T14:34:29.145 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T14:34:29.145 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T14:34:29.145 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T14:34:29.145 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T14:34:29.146 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T14:34:29.146 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T14:34:29.146 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T14:34:29.146 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T14:34:29.146 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T14:34:29.146 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T14:34:29.146 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T14:34:29.146 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:29.146 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:34:29.411 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-base 2024-09-11T14:34:30.006 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:28 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:34:30.098 INFO:teuthology.orchestra.run.smithi103.stdout:Package ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:34:30.141 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:34:30.142 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-11T14:34:30.143 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:34:30.211 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install cephadm 2024-09-11T14:34:30.782 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:28 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:34:30.912 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:34:30.913 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:34:30.913 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-11T14:34:30.913 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:34:30.913 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-11T14:34:30.914 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 784 k 2024-09-11T14:34:30.914 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:30.914 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-11T14:34:30.914 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:34:30.914 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-11T14:34:30.914 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:30.914 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 784 k 2024-09-11T14:34:30.914 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 791 k 2024-09-11T14:34:30.914 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-11T14:34:31.190 INFO:teuthology.orchestra.run.smithi103.stdout:cephadm-19.3.0-4872.g0d61375b.el9.noarch.rpm 2.8 MB/s | 784 kB 00:00 2024-09-11T14:34:31.190 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:34:31.190 INFO:teuthology.orchestra.run.smithi103.stdout:Total 2.8 MB/s | 784 kB 00:00 2024-09-11T14:34:31.191 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-11T14:34:31.196 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-11T14:34:31.196 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-11T14:34:31.202 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-11T14:34:31.202 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-11T14:34:31.275 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-11T14:34:31.736 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:34:31.819 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:34:32.211 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:34:32.462 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:34:32.462 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:32.463 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-11T14:34:32.463 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:34:32.463 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:32.463 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:34:32.703 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-immutable-object-cache 2024-09-11T14:34:33.281 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:31 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:34:33.416 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:34:33.417 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:34:33.417 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-09-11T14:34:33.417 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:34:33.417 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-11T14:34:33.418 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 158 k 2024-09-11T14:34:33.418 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:33.418 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-11T14:34:33.418 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:34:33.418 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-11T14:34:33.418 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:33.418 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 158 k 2024-09-11T14:34:33.418 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 644 k 2024-09-11T14:34:33.418 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-11T14:34:33.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-immutable-object-cache-19.3.0-4872.g0d6137 769 kB/s | 158 kB 00:00 2024-09-11T14:34:33.624 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:34:33.624 INFO:teuthology.orchestra.run.smithi103.stdout:Total 764 kB/s | 158 kB 00:00 2024-09-11T14:34:33.624 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-11T14:34:33.633 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-11T14:34:33.634 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-11T14:34:33.690 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-11T14:34:33.691 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-11T14:34:33.839 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-11T14:34:33.908 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4872.g0d61375b. 1/1 2024-09-11T14:34:33.933 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4872.g0d61375b. 1/1 2024-09-11T14:34:33.933 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:34:33.933 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T14:34:33.933 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:34.765 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-2:19.3.0-4872.g0d61375b.el9.x86_64 37/37 2024-09-11T14:34:34.765 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-2:19.3.0-4872.g0d61375b.el9.x86_64 1/37 2024-09-11T14:34:34.765 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mds-2:19.3.0-4872.g0d61375b.el9.x86_64 2/37 2024-09-11T14:34:34.766 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 3/37 2024-09-11T14:34:34.766 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mon-2:19.3.0-4872.g0d61375b.el9.x86_64 4/37 2024-09-11T14:34:34.766 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-osd-2:19.3.0-4872.g0d61375b.el9.x86_64 5/37 2024-09-11T14:34:34.766 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4872.g0d61375b.el9. 6/37 2024-09-11T14:34:34.766 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-11T14:34:34.766 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-11T14:34:34.766 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-11T14:34:34.766 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-11T14:34:34.766 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-11T14:34:34.766 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-11T14:34:34.766 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-11T14:34:34.766 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-11T14:34:34.766 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-11T14:34:34.767 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-11T14:34:34.767 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-11T14:34:34.767 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-11T14:34:34.767 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-11T14:34:34.767 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-11T14:34:34.767 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-11T14:34:34.767 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-11T14:34:34.767 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-11T14:34:34.767 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-11T14:34:34.767 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-11T14:34:34.767 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-11T14:34:34.767 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-11T14:34:34.768 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-11T14:34:34.768 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-11T14:34:34.768 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-11T14:34:34.768 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-11T14:34:34.768 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-11T14:34:34.768 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-11T14:34:34.768 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-11T14:34:34.768 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-11T14:34:34.768 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-11T14:34:34.854 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4872.g0d61375b. 1/1 2024-09-11T14:34:34.855 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:34.855 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-11T14:34:34.855 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:34:34.855 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:34.855 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:34:35.071 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr 2024-09-11T14:34:35.648 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:33 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:34:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-11T14:34:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:35.727 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-11T14:34:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:34:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:34:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:34:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:34:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:34:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:34:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T14:34:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T14:34:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T14:34:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T14:34:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T14:34:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T14:34:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T14:34:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T14:34:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T14:34:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T14:34:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T14:34:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T14:34:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T14:34:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T14:34:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T14:34:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T14:34:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T14:34:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T14:34:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T14:34:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T14:34:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T14:34:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T14:34:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T14:34:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T14:34:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T14:34:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T14:34:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T14:34:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T14:34:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T14:34:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T14:34:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T14:34:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:35.730 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:34:35.741 INFO:teuthology.orchestra.run.smithi103.stdout:Package ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:34:35.784 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:34:35.785 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-11T14:34:35.785 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:34:35.853 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-dashboard 2024-09-11T14:34:35.987 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-base 2024-09-11T14:34:36.417 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:34 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:34:36.553 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:34:36.554 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:34:36.554 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-11T14:34:36.554 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:34:36.555 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-11T14:34:36.555 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 14 M 2024-09-11T14:34:36.555 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-11T14:34:36.555 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T14:34:36.555 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 34 k 2024-09-11T14:34:36.555 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 16 k 2024-09-11T14:34:36.555 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T14:34:36.555 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T14:34:36.555 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T14:34:36.555 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T14:34:36.555 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T14:34:36.555 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T14:34:36.555 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T14:34:36.556 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:36.556 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-11T14:34:36.556 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:34:36.556 INFO:teuthology.orchestra.run.smithi103.stdout:Install 11 Packages 2024-09-11T14:34:36.556 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:36.556 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 18 M 2024-09-11T14:34:36.557 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 155 M 2024-09-11T14:34:36.557 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-11T14:34:36.585 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:32 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:34:36.683 INFO:teuthology.orchestra.run.smithi176.stdout:Package ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:34:36.727 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:34:36.728 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-11T14:34:36.728 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:34:36.793 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install cephadm 2024-09-11T14:34:37.337 INFO:teuthology.orchestra.run.smithi103.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4872.g0d 161 kB/s | 34 kB 00:00 2024-09-11T14:34:37.363 INFO:teuthology.orchestra.run.smithi103.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4872.g0d6 69 kB/s | 16 kB 00:00 2024-09-11T14:34:37.375 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:33 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:34:37.505 INFO:teuthology.orchestra.run.smithi103.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.6 MB/s | 269 kB 00:00 2024-09-11T14:34:37.506 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:34:37.507 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:34:37.507 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-11T14:34:37.507 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:34:37.507 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-11T14:34:37.507 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 784 k 2024-09-11T14:34:37.507 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:37.507 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-11T14:34:37.508 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:34:37.508 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-11T14:34:37.508 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:37.508 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 784 k 2024-09-11T14:34:37.508 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 791 k 2024-09-11T14:34:37.508 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-11T14:34:37.580 INFO:teuthology.orchestra.run.smithi103.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 7.1 MB/s | 548 kB 00:00 2024-09-11T14:34:37.605 INFO:teuthology.orchestra.run.smithi103.stdout:(5/11): protobuf-compiler-3.14.0-13.el9.x86_64. 3.5 MB/s | 863 kB 00:00 2024-09-11T14:34:37.631 INFO:teuthology.orchestra.run.smithi103.stdout:(6/11): grpc-data-1.46.7-10.el9.noarch.rpm 387 kB/s | 19 kB 00:00 2024-09-11T14:34:37.665 INFO:teuthology.orchestra.run.smithi103.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.5 MB/s | 144 kB 00:00 2024-09-11T14:34:37.690 INFO:teuthology.orchestra.run.smithi103.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.3 MB/s | 31 kB 00:00 2024-09-11T14:34:37.715 INFO:teuthology.orchestra.run.smithi103.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-11T14:34:37.782 INFO:teuthology.orchestra.run.smithi103.stdout:(10/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 12 MB/s | 2.0 MB 00:00 2024-09-11T14:34:37.925 INFO:teuthology.orchestra.run.smithi176.stdout:cephadm-19.3.0-4872.g0d61375b.el9.noarch.rpm 1.8 MB/s | 784 kB 00:00 2024-09-11T14:34:37.925 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:34:37.926 INFO:teuthology.orchestra.run.smithi176.stdout:Total 1.8 MB/s | 784 kB 00:00 2024-09-11T14:34:37.926 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-11T14:34:37.931 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-11T14:34:37.931 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-11T14:34:37.937 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-11T14:34:37.937 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-11T14:34:38.012 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-11T14:34:38.032 INFO:teuthology.orchestra.run.smithi103.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4872.g0d6137 16 MB/s | 14 MB 00:00 2024-09-11T14:34:38.037 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:34:38.037 INFO:teuthology.orchestra.run.smithi103.stdout:Total 12 MB/s | 18 MB 00:01 2024-09-11T14:34:38.068 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-11T14:34:38.087 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-11T14:34:38.087 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-11T14:34:38.368 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-11T14:34:38.406 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-11T14:34:38.420 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:34:38.522 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:34:38.888 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:34:38.921 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-11T14:34:39.022 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-11T14:34:39.052 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-11T14:34:39.128 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:34:39.128 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:39.129 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-11T14:34:39.129 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:34:39.129 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:39.129 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:34:39.159 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-11T14:34:39.296 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-11T14:34:39.337 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-immutable-object-cache 2024-09-11T14:34:39.347 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-11T14:34:39.434 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-11T14:34:39.484 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-11T14:34:39.520 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-11T14:34:39.552 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4872.g0d61375b.el9 9/11 2024-09-11T14:34:39.907 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:35 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:34:40.043 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:34:40.044 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:34:40.044 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repo Size 2024-09-11T14:34:40.044 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:34:40.044 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-11T14:34:40.044 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 158 k 2024-09-11T14:34:40.044 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:40.044 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-11T14:34:40.044 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:34:40.044 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-11T14:34:40.044 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:40.044 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 158 k 2024-09-11T14:34:40.044 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 644 k 2024-09-11T14:34:40.045 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-11T14:34:40.281 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-immutable-object-cache-19.3.0-4872.g0d6137 668 kB/s | 158 kB 00:00 2024-09-11T14:34:40.282 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:34:40.282 INFO:teuthology.orchestra.run.smithi176.stdout:Total 663 kB/s | 158 kB 00:00 2024-09-11T14:34:40.282 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-11T14:34:40.292 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-11T14:34:40.292 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-11T14:34:40.350 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-11T14:34:40.350 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-11T14:34:40.500 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-11T14:34:40.590 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4872.g0d61375b. 1/1 2024-09-11T14:34:40.616 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4872.g0d61375b. 1/1 2024-09-11T14:34:40.616 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:34:40.616 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T14:34:40.616 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:41.507 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4872.g0d61375b. 1/1 2024-09-11T14:34:41.508 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:41.508 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-11T14:34:41.508 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:34:41.508 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:41.508 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:34:41.737 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr 2024-09-11T14:34:42.314 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:38 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:34:42.406 INFO:teuthology.orchestra.run.smithi176.stdout:Package ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:34:42.448 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:34:42.449 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-11T14:34:42.449 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:34:42.517 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr-dashboard 2024-09-11T14:34:42.767 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4872.g0d61375b.el 10/11 2024-09-11T14:34:42.833 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4872.g0d61375b.el9.noa 11/11 2024-09-11T14:34:43.080 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:39 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:34:43.212 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:34:43.213 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:34:43.213 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-11T14:34:43.214 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:34:43.214 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-11T14:34:43.214 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 14 M 2024-09-11T14:34:43.214 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-11T14:34:43.214 INFO:teuthology.orchestra.run.smithi176.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T14:34:43.214 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 34 k 2024-09-11T14:34:43.214 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 16 k 2024-09-11T14:34:43.214 INFO:teuthology.orchestra.run.smithi176.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T14:34:43.214 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T14:34:43.214 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T14:34:43.214 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T14:34:43.214 INFO:teuthology.orchestra.run.smithi176.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T14:34:43.215 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T14:34:43.215 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T14:34:43.215 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:43.215 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-11T14:34:43.215 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:34:43.215 INFO:teuthology.orchestra.run.smithi176.stdout:Install 11 Packages 2024-09-11T14:34:43.215 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:43.216 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 18 M 2024-09-11T14:34:43.216 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 155 M 2024-09-11T14:34:43.216 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-11T14:34:43.953 INFO:teuthology.orchestra.run.smithi176.stdout:(1/11): ceph-prometheus-alerts-19.3.0-4872.g0d6 94 kB/s | 16 kB 00:00 2024-09-11T14:34:43.978 INFO:teuthology.orchestra.run.smithi176.stdout:(2/11): ceph-grafana-dashboards-19.3.0-4872.g0d 171 kB/s | 34 kB 00:00 2024-09-11T14:34:44.120 INFO:teuthology.orchestra.run.smithi176.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.6 MB/s | 269 kB 00:00 2024-09-11T14:34:44.171 INFO:teuthology.orchestra.run.smithi176.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-11T14:34:44.204 INFO:teuthology.orchestra.run.smithi176.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 581 kB/s | 19 kB 00:00 2024-09-11T14:34:44.271 INFO:teuthology.orchestra.run.smithi176.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-11T14:34:44.305 INFO:teuthology.orchestra.run.smithi176.stdout:(7/11): protobuf-compiler-3.14.0-13.el9.x86_64. 2.6 MB/s | 863 kB 00:00 2024-09-11T14:34:44.338 INFO:teuthology.orchestra.run.smithi176.stdout:(8/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.1 MB/s | 144 kB 00:00 2024-09-11T14:34:44.364 INFO:teuthology.orchestra.run.smithi176.stdout:(9/11): python3-repoze-lru-0.7-16.el9.noarch.rp 526 kB/s | 31 kB 00:00 2024-09-11T14:34:44.392 INFO:teuthology.orchestra.run.smithi176.stdout:(10/11): python3-routes-2.5.1-5.el9.noarch.rpm 3.8 MB/s | 188 kB 00:00 2024-09-11T14:34:44.623 INFO:teuthology.orchestra.run.smithi176.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4872.g0d6137 17 MB/s | 14 MB 00:00 2024-09-11T14:34:44.627 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:34:44.627 INFO:teuthology.orchestra.run.smithi176.stdout:Total 13 MB/s | 18 MB 00:01 2024-09-11T14:34:44.658 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-11T14:34:44.678 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-11T14:34:44.678 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-11T14:34:44.784 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4872.g0d61375b.el9.noa 11/11 2024-09-11T14:34:44.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4872.g0d61375b.el 1/11 2024-09-11T14:34:44.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4872.g0d61375b.el9.noa 2/11 2024-09-11T14:34:44.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4872.g0d61375b.el9 3/11 2024-09-11T14:34:44.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-11T14:34:44.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-11T14:34:44.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-11T14:34:44.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-11T14:34:44.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-11T14:34:44.785 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-11T14:34:44.785 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-11T14:34:44.945 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-11T14:34:44.945 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-11T14:34:45.103 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-11T14:34:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:45.104 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-11T14:34:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T14:34:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:34:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:34:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:34:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T14:34:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T14:34:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T14:34:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T14:34:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T14:34:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T14:34:45.105 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T14:34:45.105 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:45.105 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:34:45.370 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-11T14:34:45.506 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-11T14:34:45.587 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-11T14:34:45.618 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-11T14:34:45.722 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-11T14:34:45.853 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-11T14:34:45.904 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-11T14:34:45.940 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:43 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:34:45.989 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-11T14:34:46.040 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-11T14:34:46.068 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-11T14:34:46.073 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:34:46.074 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-09-11T14:34:46.074 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-11T14:34:46.075 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-09-11T14:34:46.075 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-11T14:34:46.075 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 7.4 M 2024-09-11T14:34:46.075 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-11T14:34:46.075 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T14:34:46.075 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T14:34:46.075 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T14:34:46.075 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T14:34:46.075 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T14:34:46.075 INFO:teuthology.orchestra.run.smithi103.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T14:34:46.075 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T14:34:46.075 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T14:34:46.075 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T14:34:46.076 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T14:34:46.076 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T14:34:46.076 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:46.076 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-11T14:34:46.076 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-09-11T14:34:46.076 INFO:teuthology.orchestra.run.smithi103.stdout:Install 12 Packages 2024-09-11T14:34:46.076 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:46.077 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 38 M 2024-09-11T14:34:46.077 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 212 M 2024-09-11T14:34:46.077 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-11T14:34:46.100 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4872.g0d61375b.el9 9/11 2024-09-11T14:34:46.374 INFO:teuthology.orchestra.run.smithi103.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-11T14:34:46.407 INFO:teuthology.orchestra.run.smithi103.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.8 MB/s | 801 kB 00:00 2024-09-11T14:34:46.508 INFO:teuthology.orchestra.run.smithi103.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 245 kB/s | 33 kB 00:00 2024-09-11T14:34:46.558 INFO:teuthology.orchestra.run.smithi103.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 363 kB/s | 18 kB 00:00 2024-09-11T14:34:46.608 INFO:teuthology.orchestra.run.smithi103.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 772 kB/s | 38 kB 00:00 2024-09-11T14:34:46.801 INFO:teuthology.orchestra.run.smithi103.stdout:(6/12): ceph-mgr-diskprediction-local-19.3.0-48 13 MB/s | 7.4 MB 00:00 2024-09-11T14:34:47.001 INFO:teuthology.orchestra.run.smithi103.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-11T14:34:47.601 INFO:teuthology.orchestra.run.smithi103.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.5 MB/s | 3.0 MB 00:01 2024-09-11T14:34:47.751 INFO:teuthology.orchestra.run.smithi103.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.6 MB/s | 250 kB 00:00 2024-09-11T14:34:48.527 INFO:teuthology.orchestra.run.smithi103.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.3 MB/s | 5.1 MB 00:01 2024-09-11T14:34:48.710 INFO:teuthology.orchestra.run.smithi103.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.4 MB/s | 4.9 MB 00:02 2024-09-11T14:34:49.305 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4872.g0d61375b.el 10/11 2024-09-11T14:34:49.355 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4872.g0d61375b.el9.noa 11/11 2024-09-11T14:34:51.264 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4872.g0d61375b.el9.noa 11/11 2024-09-11T14:34:51.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4872.g0d61375b.el 1/11 2024-09-11T14:34:51.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4872.g0d61375b.el9.noa 2/11 2024-09-11T14:34:51.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4872.g0d61375b.el9 3/11 2024-09-11T14:34:51.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-11T14:34:51.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-11T14:34:51.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-11T14:34:51.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-11T14:34:51.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-11T14:34:51.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-11T14:34:51.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-11T14:34:51.574 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-11T14:34:51.574 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:51.574 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-11T14:34:51.574 INFO:teuthology.orchestra.run.smithi176.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T14:34:51.574 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:34:51.574 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:34:51.574 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:34:51.574 INFO:teuthology.orchestra.run.smithi176.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T14:34:51.574 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T14:34:51.575 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T14:34:51.575 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T14:34:51.575 INFO:teuthology.orchestra.run.smithi176.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T14:34:51.575 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T14:34:51.575 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T14:34:51.575 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:51.575 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:34:51.652 INFO:teuthology.orchestra.run.smithi103.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.2 MB/s | 16 MB 00:03 2024-09-11T14:34:51.653 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:34:51.653 INFO:teuthology.orchestra.run.smithi103.stdout:Total 6.9 MB/s | 38 MB 00:05 2024-09-11T14:34:51.832 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-11T14:34:52.007 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-11T14:34:52.033 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-11T14:34:52.033 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-11T14:34:52.398 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:48 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:34:52.460 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-11T14:34:52.461 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-11T14:34:52.533 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:34:52.534 INFO:teuthology.orchestra.run.smithi176.stdout:======================================================================================= 2024-09-11T14:34:52.534 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-11T14:34:52.534 INFO:teuthology.orchestra.run.smithi176.stdout:======================================================================================= 2024-09-11T14:34:52.535 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-11T14:34:52.535 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 7.4 M 2024-09-11T14:34:52.535 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-11T14:34:52.535 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T14:34:52.535 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T14:34:52.535 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T14:34:52.535 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T14:34:52.535 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T14:34:52.535 INFO:teuthology.orchestra.run.smithi176.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T14:34:52.535 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T14:34:52.535 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T14:34:52.535 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T14:34:52.536 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T14:34:52.536 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T14:34:52.536 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:52.536 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-11T14:34:52.536 INFO:teuthology.orchestra.run.smithi176.stdout:======================================================================================= 2024-09-11T14:34:52.536 INFO:teuthology.orchestra.run.smithi176.stdout:Install 12 Packages 2024-09-11T14:34:52.536 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:34:52.536 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 38 M 2024-09-11T14:34:52.537 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 212 M 2024-09-11T14:34:52.537 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-11T14:34:53.178 INFO:teuthology.orchestra.run.smithi176.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 847 kB/s | 191 kB 00:00 2024-09-11T14:34:53.232 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-11T14:34:53.236 INFO:teuthology.orchestra.run.smithi176.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 561 kB/s | 33 kB 00:00 2024-09-11T14:34:53.270 INFO:teuthology.orchestra.run.smithi176.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-11T14:34:53.293 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-11T14:34:53.321 INFO:teuthology.orchestra.run.smithi176.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 363 kB/s | 18 kB 00:00 2024-09-11T14:34:53.333 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-11T14:34:53.371 INFO:teuthology.orchestra.run.smithi176.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 772 kB/s | 38 kB 00:00 2024-09-11T14:34:53.431 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-11T14:34:53.438 INFO:teuthology.orchestra.run.smithi176.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 15 MB/s | 3.0 MB 00:00 2024-09-11T14:34:53.468 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-11T14:34:53.530 INFO:teuthology.orchestra.run.smithi176.stdout:(7/12): ceph-mgr-diskprediction-local-19.3.0-48 13 MB/s | 7.4 MB 00:00 2024-09-11T14:34:53.555 INFO:teuthology.orchestra.run.smithi176.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-11T14:34:53.652 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-11T14:34:53.672 INFO:teuthology.orchestra.run.smithi176.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 250 kB 00:00 2024-09-11T14:34:53.676 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-11T14:34:53.747 INFO:teuthology.orchestra.run.smithi176.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 13 MB/s | 4.9 MB 00:00 2024-09-11T14:34:53.760 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-11T14:34:54.064 INFO:teuthology.orchestra.run.smithi176.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-09-11T14:34:54.214 INFO:teuthology.orchestra.run.smithi176.stdout:(12/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.5 MB/s | 5.1 MB 00:00 2024-09-11T14:34:54.215 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:34:54.215 INFO:teuthology.orchestra.run.smithi176.stdout:Total 23 MB/s | 38 MB 00:01 2024-09-11T14:34:54.416 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-11T14:34:54.539 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-11T14:34:54.569 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-11T14:34:54.596 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-11T14:34:54.596 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-11T14:34:55.028 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-11T14:34:55.029 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-11T14:34:55.803 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T14:34:55.807 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-11T14:34:55.903 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-11T14:34:55.946 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-11T14:34:56.045 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-11T14:34:56.080 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-11T14:34:56.265 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-11T14:34:56.295 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-11T14:34:56.373 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-11T14:34:56.844 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-11T14:34:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4872.g0d613 12/12 2024-09-11T14:34:57.031 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-11T14:34:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-11T14:34:58.435 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T14:34:59.464 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-11T14:34:59.486 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4872.g0d613 12/12 2024-09-11T14:34:59.553 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4872.g0d613 12/12 2024-09-11T14:34:59.554 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4872.g0d613 1/12 2024-09-11T14:34:59.554 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-11T14:34:59.554 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-11T14:34:59.554 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-11T14:34:59.554 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-11T14:34:59.554 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-11T14:34:59.554 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-11T14:34:59.554 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-11T14:34:59.554 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-11T14:34:59.554 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T14:34:59.554 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-11T14:34:59.956 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-11T14:34:59.956 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:59.956 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-11T14:34:59.956 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:34:59.956 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T14:34:59.956 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T14:34:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T14:34:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T14:34:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T14:34:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T14:34:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T14:34:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T14:34:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T14:34:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T14:34:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T14:34:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:34:59.957 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:35:00.365 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-rook 2024-09-11T14:35:00.953 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:58 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:35:01.094 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:35:01.095 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:01.095 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-11T14:35:01.096 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:01.096 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-11T14:35:01.096 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 49 k 2024-09-11T14:35:01.096 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-11T14:35:01.096 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T14:35:01.096 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T14:35:01.096 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T14:35:01.096 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T14:35:01.096 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T14:35:01.096 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T14:35:01.096 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T14:35:01.096 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T14:35:01.097 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T14:35:01.097 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T14:35:01.097 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T14:35:01.097 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T14:35:01.097 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:01.097 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-11T14:35:01.097 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:01.097 INFO:teuthology.orchestra.run.smithi103.stdout:Install 13 Packages 2024-09-11T14:35:01.097 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:01.098 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 2.2 M 2024-09-11T14:35:01.098 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 26 M 2024-09-11T14:35:01.098 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-11T14:35:01.430 INFO:teuthology.orchestra.run.smithi103.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 178 kB/s | 19 kB 00:00 2024-09-11T14:35:01.446 INFO:teuthology.orchestra.run.smithi103.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 206 kB/s | 26 kB 00:00 2024-09-11T14:35:01.472 INFO:teuthology.orchestra.run.smithi103.stdout:(3/13): ceph-mgr-rook-19.3.0-4872.g0d61375b.el9 329 kB/s | 49 kB 00:00 2024-09-11T14:35:01.589 INFO:teuthology.orchestra.run.smithi103.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-11T14:35:01.622 INFO:teuthology.orchestra.run.smithi103.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.1 MB/s | 222 kB 00:00 2024-09-11T14:35:01.639 INFO:teuthology.orchestra.run.smithi103.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-11T14:35:01.673 INFO:teuthology.orchestra.run.smithi103.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 640 kB/s | 32 kB 00:00 2024-09-11T14:35:01.706 INFO:teuthology.orchestra.run.smithi103.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-09-11T14:35:01.723 INFO:teuthology.orchestra.run.smithi103.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 168 kB/s | 14 kB 00:00 2024-09-11T14:35:01.757 INFO:teuthology.orchestra.run.smithi103.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-11T14:35:01.774 INFO:teuthology.orchestra.run.smithi103.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.3 MB/s | 59 kB 00:00 2024-09-11T14:35:01.799 INFO:teuthology.orchestra.run.smithi103.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 2.2 MB/s | 90 kB 00:00 2024-09-11T14:35:01.841 INFO:teuthology.orchestra.run.smithi103.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.6 MB/s | 1.0 MB 00:00 2024-09-11T14:35:01.844 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:01.844 INFO:teuthology.orchestra.run.smithi103.stdout:Total 3.0 MB/s | 2.2 MB 00:00 2024-09-11T14:35:01.910 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-11T14:35:01.925 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-11T14:35:01.926 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-11T14:35:02.015 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-11T14:35:02.016 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-11T14:35:02.118 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4872.g0d613 12/12 2024-09-11T14:35:02.118 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4872.g0d613 1/12 2024-09-11T14:35:02.118 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-11T14:35:02.118 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-11T14:35:02.118 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-11T14:35:02.118 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-11T14:35:02.118 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-11T14:35:02.118 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-11T14:35:02.118 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-11T14:35:02.118 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-11T14:35:02.118 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T14:35:02.119 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-11T14:35:02.520 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-11T14:35:02.520 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:02.520 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-11T14:35:02.520 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:35:02.521 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T14:35:02.521 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T14:35:02.521 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T14:35:02.521 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T14:35:02.521 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T14:35:02.521 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T14:35:02.521 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T14:35:02.521 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T14:35:02.521 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T14:35:02.521 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T14:35:02.521 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T14:35:02.522 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:02.522 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:35:02.528 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-11T14:35:02.692 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-11T14:35:02.751 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-11T14:35:02.815 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-11T14:35:02.852 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-11T14:35:02.893 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-11T14:35:02.976 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr-rook 2024-09-11T14:35:03.006 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-11T14:35:03.106 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-11T14:35:03.154 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-11T14:35:03.547 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:59 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:35:03.682 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:35:03.683 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:03.684 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-11T14:35:03.684 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:03.684 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-11T14:35:03.684 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 49 k 2024-09-11T14:35:03.684 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-11T14:35:03.684 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T14:35:03.684 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T14:35:03.684 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T14:35:03.684 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T14:35:03.684 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T14:35:03.684 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T14:35:03.684 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T14:35:03.685 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T14:35:03.685 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T14:35:03.685 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T14:35:03.685 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T14:35:03.685 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T14:35:03.685 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:03.685 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-11T14:35:03.685 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:03.685 INFO:teuthology.orchestra.run.smithi176.stdout:Install 13 Packages 2024-09-11T14:35:03.685 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:03.686 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 2.2 M 2024-09-11T14:35:03.686 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 26 M 2024-09-11T14:35:03.686 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-11T14:35:03.884 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-11T14:35:03.943 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-11T14:35:03.977 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-11T14:35:04.026 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-11T14:35:04.072 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-rook-2:19.3.0-4872.g0d61375b.el9.noarch 13/13 2024-09-11T14:35:04.119 INFO:teuthology.orchestra.run.smithi176.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 155 kB/s | 19 kB 00:00 2024-09-11T14:35:04.145 INFO:teuthology.orchestra.run.smithi176.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 171 kB/s | 26 kB 00:00 2024-09-11T14:35:04.170 INFO:teuthology.orchestra.run.smithi176.stdout:(3/13): ceph-mgr-rook-19.3.0-4872.g0d61375b.el9 282 kB/s | 49 kB 00:00 2024-09-11T14:35:04.271 INFO:teuthology.orchestra.run.smithi176.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-11T14:35:04.296 INFO:teuthology.orchestra.run.smithi176.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.2 MB/s | 222 kB 00:00 2024-09-11T14:35:04.329 INFO:teuthology.orchestra.run.smithi176.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 915 kB/s | 54 kB 00:00 2024-09-11T14:35:04.363 INFO:teuthology.orchestra.run.smithi176.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 479 kB/s | 32 kB 00:00 2024-09-11T14:35:04.388 INFO:teuthology.orchestra.run.smithi176.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-09-11T14:35:04.414 INFO:teuthology.orchestra.run.smithi176.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 171 kB/s | 14 kB 00:00 2024-09-11T14:35:04.447 INFO:teuthology.orchestra.run.smithi176.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.2 MB/s | 59 kB 00:00 2024-09-11T14:35:04.472 INFO:teuthology.orchestra.run.smithi176.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.0 MB/s | 220 kB 00:00 2024-09-11T14:35:04.489 INFO:teuthology.orchestra.run.smithi176.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 2.2 MB/s | 90 kB 00:00 2024-09-11T14:35:04.531 INFO:teuthology.orchestra.run.smithi176.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-11T14:35:04.533 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:04.534 INFO:teuthology.orchestra.run.smithi176.stdout:Total 2.6 MB/s | 2.2 MB 00:00 2024-09-11T14:35:04.597 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-11T14:35:04.612 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-11T14:35:04.612 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-11T14:35:04.701 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-11T14:35:04.701 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-11T14:35:04.856 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4872.g0d61375b.el9.noarch 13/13 2024-09-11T14:35:04.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4872.g0d61375b.el9.noarch 1/13 2024-09-11T14:35:04.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-11T14:35:04.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-11T14:35:04.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-11T14:35:04.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-11T14:35:04.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-11T14:35:04.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-11T14:35:04.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-11T14:35:04.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-11T14:35:04.857 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-11T14:35:04.857 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-11T14:35:04.857 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-11T14:35:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-11T14:35:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:05.191 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-11T14:35:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:35:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T14:35:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T14:35:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T14:35:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T14:35:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T14:35:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T14:35:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T14:35:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T14:35:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T14:35:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T14:35:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T14:35:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T14:35:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:05.192 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:35:05.204 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-11T14:35:05.389 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-11T14:35:05.441 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-11T14:35:05.458 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-cephadm 2024-09-11T14:35:05.496 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-11T14:35:05.533 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-11T14:35:05.575 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-11T14:35:05.677 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-11T14:35:05.779 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-11T14:35:05.835 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-11T14:35:06.038 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:04 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:35:06.173 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:35:06.174 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-11T14:35:06.174 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:06.174 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-11T14:35:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 154 k 2024-09-11T14:35:06.174 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-11T14:35:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T14:35:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T14:35:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T14:35:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T14:35:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T14:35:06.175 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:06.175 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-11T14:35:06.175 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:06.175 INFO:teuthology.orchestra.run.smithi103.stdout:Install 6 Packages 2024-09-11T14:35:06.175 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:06.175 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 7.0 M 2024-09-11T14:35:06.175 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 33 M 2024-09-11T14:35:06.175 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-11T14:35:06.561 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-11T14:35:06.615 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-11T14:35:06.649 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-11T14:35:06.697 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-11T14:35:06.727 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-rook-2:19.3.0-4872.g0d61375b.el9.noarch 13/13 2024-09-11T14:35:06.945 INFO:teuthology.orchestra.run.smithi103.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-09-11T14:35:06.979 INFO:teuthology.orchestra.run.smithi103.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4872.g0d61375b.e 726 kB/s | 154 kB 00:00 2024-09-11T14:35:07.029 INFO:teuthology.orchestra.run.smithi103.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-11T14:35:07.055 INFO:teuthology.orchestra.run.smithi103.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 769 kB/s | 58 kB 00:00 2024-09-11T14:35:07.089 INFO:teuthology.orchestra.run.smithi103.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.2 MB/s | 74 kB 00:00 2024-09-11T14:35:07.214 INFO:teuthology.orchestra.run.smithi103.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-11T14:35:07.217 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:07.217 INFO:teuthology.orchestra.run.smithi103.stdout:Total 6.7 MB/s | 7.0 MB 00:01 2024-09-11T14:35:07.288 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-11T14:35:07.299 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-11T14:35:07.299 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-11T14:35:07.399 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-11T14:35:07.399 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-11T14:35:07.541 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4872.g0d61375b.el9.noarch 13/13 2024-09-11T14:35:07.541 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4872.g0d61375b.el9.noarch 1/13 2024-09-11T14:35:07.541 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-11T14:35:07.541 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-11T14:35:07.541 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-11T14:35:07.541 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-11T14:35:07.541 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-11T14:35:07.541 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-11T14:35:07.541 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-11T14:35:07.542 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-11T14:35:07.542 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-11T14:35:07.542 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-11T14:35:07.542 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-11T14:35:07.700 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-11T14:35:07.864 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-11T14:35:07.864 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:07.864 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-11T14:35:07.864 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:35:07.864 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T14:35:07.864 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T14:35:07.864 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T14:35:07.864 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T14:35:07.864 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T14:35:07.865 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T14:35:07.865 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T14:35:07.865 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T14:35:07.865 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T14:35:07.865 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T14:35:07.865 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T14:35:07.865 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T14:35:07.865 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:07.865 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:35:07.880 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-11T14:35:07.932 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-11T14:35:08.155 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr-cephadm 2024-09-11T14:35:08.455 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-11T14:35:08.543 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-11T14:35:08.611 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-11T14:35:08.636 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 6/6 2024-09-11T14:35:08.753 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:04 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:35:08.896 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:35:08.896 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:08.896 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-11T14:35:08.896 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:08.896 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-11T14:35:08.897 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 154 k 2024-09-11T14:35:08.897 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-11T14:35:08.897 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T14:35:08.897 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T14:35:08.897 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T14:35:08.897 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T14:35:08.897 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T14:35:08.897 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:08.897 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-11T14:35:08.897 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:08.897 INFO:teuthology.orchestra.run.smithi176.stdout:Install 6 Packages 2024-09-11T14:35:08.897 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:08.898 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 7.0 M 2024-09-11T14:35:08.898 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 33 M 2024-09-11T14:35:08.898 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-11T14:35:09.478 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 6/6 2024-09-11T14:35:09.478 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/6 2024-09-11T14:35:09.478 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-11T14:35:09.478 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-11T14:35:09.478 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-11T14:35:09.478 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-11T14:35:09.567 INFO:teuthology.orchestra.run.smithi176.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4872.g0d61375b.e 381 kB/s | 154 kB 00:00 2024-09-11T14:35:09.617 INFO:teuthology.orchestra.run.smithi176.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-11T14:35:09.634 INFO:teuthology.orchestra.run.smithi176.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 3.4 MB/s | 58 kB 00:00 2024-09-11T14:35:09.659 INFO:teuthology.orchestra.run.smithi176.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-11T14:35:09.758 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-11T14:35:09.758 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:09.758 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-11T14:35:09.758 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:35:09.758 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T14:35:09.758 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T14:35:09.758 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T14:35:09.758 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T14:35:09.758 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T14:35:09.759 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:09.759 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:35:10.016 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-fuse 2024-09-11T14:35:10.018 INFO:teuthology.orchestra.run.smithi176.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 290 kB/s | 248 kB 00:00 2024-09-11T14:35:10.470 INFO:teuthology.orchestra.run.smithi176.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.6 MB/s | 6.0 MB 00:01 2024-09-11T14:35:10.472 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:10.473 INFO:teuthology.orchestra.run.smithi176.stdout:Total 4.5 MB/s | 7.0 MB 00:01 2024-09-11T14:35:10.546 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-11T14:35:10.557 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-11T14:35:10.557 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-11T14:35:10.580 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:08 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:35:10.657 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-11T14:35:10.657 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-11T14:35:10.714 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:35:10.714 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:10.715 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-11T14:35:10.715 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:10.715 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-11T14:35:10.715 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 884 k 2024-09-11T14:35:10.715 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-11T14:35:10.715 INFO:teuthology.orchestra.run.smithi103.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T14:35:10.715 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:10.715 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-11T14:35:10.715 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:10.715 INFO:teuthology.orchestra.run.smithi103.stdout:Install 2 Packages 2024-09-11T14:35:10.715 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:10.716 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 964 k 2024-09-11T14:35:10.716 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 4.1 M 2024-09-11T14:35:10.716 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-11T14:35:10.958 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-11T14:35:11.083 INFO:teuthology.orchestra.run.smithi103.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 715 kB/s | 80 kB 00:00 2024-09-11T14:35:11.133 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-11T14:35:11.194 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-11T14:35:11.267 INFO:teuthology.orchestra.run.smithi103.stdout:(2/2): ceph-fuse-19.3.0-4872.g0d61375b.el9.x86_ 2.9 MB/s | 884 kB 00:00 2024-09-11T14:35:11.267 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:11.268 INFO:teuthology.orchestra.run.smithi103.stdout:Total 1.7 MB/s | 964 kB 00:00 2024-09-11T14:35:11.280 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-11T14:35:11.304 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-11T14:35:11.304 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-11T14:35:11.385 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-11T14:35:11.385 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-11T14:35:11.585 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-11T14:35:11.729 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-11T14:35:11.745 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-11T14:35:11.805 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-11T14:35:11.816 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 2/2 2024-09-11T14:35:11.882 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-11T14:35:11.907 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 6/6 2024-09-11T14:35:12.573 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 2/2 2024-09-11T14:35:12.574 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 1/2 2024-09-11T14:35:12.729 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 6/6 2024-09-11T14:35:12.729 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/6 2024-09-11T14:35:12.729 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-11T14:35:12.729 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-11T14:35:12.729 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-11T14:35:12.729 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-11T14:35:12.860 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-11T14:35:12.861 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:12.861 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-11T14:35:12.861 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-11T14:35:12.861 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:12.861 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:35:13.018 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-11T14:35:13.018 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:13.018 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-11T14:35:13.018 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:35:13.018 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T14:35:13.018 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T14:35:13.018 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T14:35:13.018 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T14:35:13.018 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T14:35:13.018 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:13.018 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:35:13.145 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-volume 2024-09-11T14:35:13.271 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-fuse 2024-09-11T14:35:13.715 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:11 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:35:13.834 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:09 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:35:13.853 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:35:13.854 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:13.854 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-11T14:35:13.854 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:13.855 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-11T14:35:13.855 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 285 k 2024-09-11T14:35:13.855 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:13.855 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-11T14:35:13.855 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:13.855 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-11T14:35:13.855 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:13.855 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 285 k 2024-09-11T14:35:13.855 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 1.3 M 2024-09-11T14:35:13.855 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-11T14:35:13.969 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:35:13.970 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:13.970 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-11T14:35:13.970 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:13.970 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-11T14:35:13.970 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 884 k 2024-09-11T14:35:13.970 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-11T14:35:13.970 INFO:teuthology.orchestra.run.smithi176.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T14:35:13.970 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:13.970 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-11T14:35:13.971 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:13.971 INFO:teuthology.orchestra.run.smithi176.stdout:Install 2 Packages 2024-09-11T14:35:13.971 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:13.971 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 964 k 2024-09-11T14:35:13.971 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 4.1 M 2024-09-11T14:35:13.971 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-11T14:35:14.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-volume-19.3.0-4872.g0d61375b.el9.noarch.rp 1.3 MB/s | 285 kB 00:00 2024-09-11T14:35:14.065 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:14.066 INFO:teuthology.orchestra.run.smithi103.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-11T14:35:14.066 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-11T14:35:14.074 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-11T14:35:14.074 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-11T14:35:14.104 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-11T14:35:14.104 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-11T14:35:14.237 INFO:teuthology.orchestra.run.smithi176.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 541 kB/s | 80 kB 00:00 2024-09-11T14:35:14.316 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-11T14:35:14.370 INFO:teuthology.orchestra.run.smithi176.stdout:(2/2): ceph-fuse-19.3.0-4872.g0d61375b.el9.x86_ 3.1 MB/s | 884 kB 00:00 2024-09-11T14:35:14.370 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:14.371 INFO:teuthology.orchestra.run.smithi176.stdout:Total 2.4 MB/s | 964 kB 00:00 2024-09-11T14:35:14.382 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-11T14:35:14.401 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-volume-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:35:14.405 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-11T14:35:14.406 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-11T14:35:14.417 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-volume-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:35:14.417 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:35:14.417 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T14:35:14.417 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:14.487 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-11T14:35:14.487 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-11T14:35:14.668 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-11T14:35:14.815 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-11T14:35:14.877 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 2/2 2024-09-11T14:35:15.450 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-volume-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:35:15.450 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:15.450 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-11T14:35:15.450 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:35:15.451 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:15.451 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:35:15.562 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 2/2 2024-09-11T14:35:15.562 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 1/2 2024-09-11T14:35:15.728 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install librados-devel 2024-09-11T14:35:15.839 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-11T14:35:15.839 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:15.839 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-11T14:35:15.840 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-11T14:35:15.840 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:15.840 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:35:16.155 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-volume 2024-09-11T14:35:16.307 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:14 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:35:16.446 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:35:16.446 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:16.447 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-09-11T14:35:16.447 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:16.447 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-11T14:35:16.447 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 125 k 2024-09-11T14:35:16.447 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:16.447 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-11T14:35:16.447 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:16.447 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-11T14:35:16.447 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:16.447 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 125 k 2024-09-11T14:35:16.447 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 445 k 2024-09-11T14:35:16.447 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-11T14:35:16.639 INFO:teuthology.orchestra.run.smithi103.stdout:librados-devel-19.3.0-4872.g0d61375b.el9.x86_64 653 kB/s | 125 kB 00:00 2024-09-11T14:35:16.639 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:16.639 INFO:teuthology.orchestra.run.smithi103.stdout:Total 649 kB/s | 125 kB 00:00 2024-09-11T14:35:16.639 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-11T14:35:16.645 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-11T14:35:16.645 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-11T14:35:16.710 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-11T14:35:16.710 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-11T14:35:16.731 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:12 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:35:16.858 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-11T14:35:16.865 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:35:16.865 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:16.866 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-11T14:35:16.866 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:16.866 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-11T14:35:16.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 285 k 2024-09-11T14:35:16.866 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:16.866 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-11T14:35:16.866 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:16.866 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-11T14:35:16.866 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:16.866 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 285 k 2024-09-11T14:35:16.866 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 1.3 M 2024-09-11T14:35:16.866 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-11T14:35:16.970 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librados-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:17.125 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-volume-19.3.0-4872.g0d61375b.el9.noarch.rp 1.1 MB/s | 285 kB 00:00 2024-09-11T14:35:17.125 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:17.126 INFO:teuthology.orchestra.run.smithi176.stdout:Total 1.1 MB/s | 285 kB 00:00 2024-09-11T14:35:17.126 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-11T14:35:17.134 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-11T14:35:17.134 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-11T14:35:17.167 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-11T14:35:17.168 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-11T14:35:17.386 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-11T14:35:17.431 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:17.443 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-volume-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:35:17.459 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-volume-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:35:17.459 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:35:17.459 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T14:35:17.459 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:17.724 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:17.725 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:17.725 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-11T14:35:17.725 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:35:17.725 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:17.725 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:35:17.985 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install libcephfs2 2024-09-11T14:35:18.484 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-volume-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:35:18.485 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:18.485 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-11T14:35:18.485 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:35:18.485 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:18.485 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:35:18.572 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:16 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:35:18.665 INFO:teuthology.orchestra.run.smithi103.stdout:Package libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:35:18.709 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:35:18.710 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-11T14:35:18.711 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:35:18.763 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install librados-devel 2024-09-11T14:35:18.798 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install libcephfs-devel 2024-09-11T14:35:19.352 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:15 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:35:19.366 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:17 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:35:19.499 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:35:19.500 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:19.500 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-09-11T14:35:19.500 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:19.500 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-11T14:35:19.501 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 32 k 2024-09-11T14:35:19.501 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:19.501 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-11T14:35:19.501 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:19.501 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-11T14:35:19.501 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:19.501 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 32 k 2024-09-11T14:35:19.501 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 142 k 2024-09-11T14:35:19.501 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-11T14:35:19.502 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:35:19.502 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:19.502 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repo Size 2024-09-11T14:35:19.502 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:19.502 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-11T14:35:19.502 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 125 k 2024-09-11T14:35:19.502 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:19.502 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-11T14:35:19.502 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:19.503 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-11T14:35:19.503 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:19.503 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 125 k 2024-09-11T14:35:19.503 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 445 k 2024-09-11T14:35:19.503 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-11T14:35:19.644 INFO:teuthology.orchestra.run.smithi103.stdout:libcephfs-devel-19.3.0-4872.g0d61375b.el9.x86_6 222 kB/s | 32 kB 00:00 2024-09-11T14:35:19.644 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:19.644 INFO:teuthology.orchestra.run.smithi103.stdout:Total 220 kB/s | 32 kB 00:00 2024-09-11T14:35:19.645 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-11T14:35:19.648 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-11T14:35:19.648 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-11T14:35:19.665 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-11T14:35:19.665 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-11T14:35:19.688 INFO:teuthology.orchestra.run.smithi176.stdout:librados-devel-19.3.0-4872.g0d61375b.el9.x86_64 673 kB/s | 125 kB 00:00 2024-09-11T14:35:19.688 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:19.689 INFO:teuthology.orchestra.run.smithi176.stdout:Total 668 kB/s | 125 kB 00:00 2024-09-11T14:35:19.689 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-11T14:35:19.694 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-11T14:35:19.694 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-11T14:35:19.757 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-11T14:35:19.758 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-11T14:35:19.758 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-11T14:35:19.867 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:19.911 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-11T14:35:20.018 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librados-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:20.249 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:20.463 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:20.513 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:20.513 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:20.513 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-11T14:35:20.513 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:35:20.514 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:20.514 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:35:20.699 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install librados2 2024-09-11T14:35:20.721 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:20.721 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:20.721 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-11T14:35:20.721 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:35:20.721 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:20.721 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:35:20.998 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install libcephfs2 2024-09-11T14:35:21.264 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:19 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:35:21.354 INFO:teuthology.orchestra.run.smithi103.stdout:Package librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:35:21.399 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:35:21.400 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-11T14:35:21.400 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:35:21.471 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install librbd1 2024-09-11T14:35:21.565 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:17 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:35:21.656 INFO:teuthology.orchestra.run.smithi176.stdout:Package libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:35:21.699 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:35:21.701 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-11T14:35:21.701 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:35:21.768 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install libcephfs-devel 2024-09-11T14:35:22.034 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:20 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:35:22.124 INFO:teuthology.orchestra.run.smithi103.stdout:Package librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:35:22.168 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:35:22.169 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-11T14:35:22.169 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:35:22.239 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-rados 2024-09-11T14:35:22.328 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:18 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:35:22.463 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:35:22.463 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:22.463 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repo Size 2024-09-11T14:35:22.463 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:22.464 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-11T14:35:22.464 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 32 k 2024-09-11T14:35:22.464 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:22.464 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-11T14:35:22.464 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:22.464 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-11T14:35:22.464 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:22.465 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 32 k 2024-09-11T14:35:22.465 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 142 k 2024-09-11T14:35:22.465 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-11T14:35:22.624 INFO:teuthology.orchestra.run.smithi176.stdout:libcephfs-devel-19.3.0-4872.g0d61375b.el9.x86_6 199 kB/s | 32 kB 00:00 2024-09-11T14:35:22.625 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:22.625 INFO:teuthology.orchestra.run.smithi176.stdout:Total 197 kB/s | 32 kB 00:00 2024-09-11T14:35:22.625 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-11T14:35:22.629 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-11T14:35:22.629 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-11T14:35:22.649 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-11T14:35:22.649 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-11T14:35:22.741 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-11T14:35:22.803 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:20 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:35:22.838 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:22.894 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-rados-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:35:22.938 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:35:22.940 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-11T14:35:22.940 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:35:23.014 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-rgw 2024-09-11T14:35:23.219 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:23.449 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:23.449 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:23.449 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-11T14:35:23.449 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:35:23.449 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:23.449 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:35:23.580 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:21 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:35:23.630 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install librados2 2024-09-11T14:35:23.671 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-rgw-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:35:23.714 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:35:23.716 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-11T14:35:23.716 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:35:23.788 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-cephfs 2024-09-11T14:35:24.195 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:20 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:35:24.286 INFO:teuthology.orchestra.run.smithi176.stdout:Package librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:35:24.329 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:35:24.330 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-11T14:35:24.330 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:35:24.356 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:22 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:35:24.401 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install librbd1 2024-09-11T14:35:24.445 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-cephfs-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:35:24.489 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:35:24.490 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-11T14:35:24.490 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:35:24.563 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-rbd 2024-09-11T14:35:24.964 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:20 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:35:25.054 INFO:teuthology.orchestra.run.smithi176.stdout:Package librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:35:25.097 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:35:25.098 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-11T14:35:25.098 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:35:25.123 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:23 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:35:25.170 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install python3-rados 2024-09-11T14:35:25.214 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-rbd-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:35:25.258 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:35:25.259 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-11T14:35:25.259 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:35:25.337 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install rbd-fuse 2024-09-11T14:35:25.728 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:21 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:35:25.818 INFO:teuthology.orchestra.run.smithi176.stdout:Package python3-rados-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:35:25.861 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:35:25.862 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-11T14:35:25.862 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:35:25.895 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:23 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:35:25.937 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install python3-rgw 2024-09-11T14:35:26.027 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:35:26.028 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:26.028 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-09-11T14:35:26.028 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:26.028 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-11T14:35:26.028 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 91 k 2024-09-11T14:35:26.028 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:26.029 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-11T14:35:26.029 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:26.029 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-11T14:35:26.029 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:26.029 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 91 k 2024-09-11T14:35:26.029 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 321 k 2024-09-11T14:35:26.029 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-11T14:35:26.231 INFO:teuthology.orchestra.run.smithi103.stdout:rbd-fuse-19.3.0-4872.g0d61375b.el9.x86_64.rpm 450 kB/s | 91 kB 00:00 2024-09-11T14:35:26.231 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:26.232 INFO:teuthology.orchestra.run.smithi103.stdout:Total 447 kB/s | 91 kB 00:00 2024-09-11T14:35:26.232 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-11T14:35:26.240 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-11T14:35:26.241 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-11T14:35:26.303 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-11T14:35:26.304 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-11T14:35:26.455 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-11T14:35:26.500 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:22 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:35:26.571 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:26.589 INFO:teuthology.orchestra.run.smithi176.stdout:Package python3-rgw-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:35:26.633 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:35:26.634 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-11T14:35:26.634 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:35:26.701 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install python3-cephfs 2024-09-11T14:35:26.938 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:27.199 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-11T14:35:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:35:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:27.199 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:35:27.268 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:23 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:35:27.359 INFO:teuthology.orchestra.run.smithi176.stdout:Package python3-cephfs-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:35:27.401 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:35:27.402 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-11T14:35:27.402 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:35:27.476 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install python3-rbd 2024-09-11T14:35:27.516 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install rbd-mirror 2024-09-11T14:35:28.044 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:24 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:35:28.089 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:26 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:35:28.134 INFO:teuthology.orchestra.run.smithi176.stdout:Package python3-rbd-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:35:28.178 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:35:28.179 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-11T14:35:28.179 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:35:28.227 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:35:28.227 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:28.227 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-09-11T14:35:28.228 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:28.228 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-11T14:35:28.228 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 3.5 M 2024-09-11T14:35:28.228 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:28.228 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-11T14:35:28.228 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:28.228 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-11T14:35:28.228 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:28.229 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 3.5 M 2024-09-11T14:35:28.229 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 30 M 2024-09-11T14:35:28.229 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-11T14:35:28.260 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install rbd-fuse 2024-09-11T14:35:28.577 INFO:teuthology.orchestra.run.smithi103.stdout:rbd-mirror-19.3.0-4872.g0d61375b.el9.x86_64.rpm 10 MB/s | 3.5 MB 00:00 2024-09-11T14:35:28.578 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:28.578 INFO:teuthology.orchestra.run.smithi103.stdout:Total 10 MB/s | 3.5 MB 00:00 2024-09-11T14:35:28.579 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-11T14:35:28.590 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-11T14:35:28.590 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-11T14:35:28.674 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-11T14:35:28.674 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-11T14:35:28.825 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:24 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:35:28.958 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:35:28.959 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:28.959 INFO:teuthology.orchestra.run.smithi176.stdout: Package Architecture Version Repository Size 2024-09-11T14:35:28.959 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:28.959 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-11T14:35:28.959 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 91 k 2024-09-11T14:35:28.959 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:28.960 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-11T14:35:28.960 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:28.960 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-11T14:35:28.960 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:28.960 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 91 k 2024-09-11T14:35:28.960 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 321 k 2024-09-11T14:35:28.960 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-11T14:35:29.153 INFO:teuthology.orchestra.run.smithi176.stdout:rbd-fuse-19.3.0-4872.g0d61375b.el9.x86_64.rpm 472 kB/s | 91 kB 00:00 2024-09-11T14:35:29.153 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:29.153 INFO:teuthology.orchestra.run.smithi176.stdout:Total 469 kB/s | 91 kB 00:00 2024-09-11T14:35:29.154 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-11T14:35:29.162 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-11T14:35:29.162 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-11T14:35:29.226 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-11T14:35:29.227 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-11T14:35:29.268 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-11T14:35:29.372 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-11T14:35:29.477 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:29.554 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-mirror-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:29.583 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:29.583 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:35:29.583 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T14:35:29.583 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T14:35:29.583 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T14:35:29.583 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:29.893 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:30.158 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:30.158 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:30.158 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-11T14:35:30.158 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:35:30.158 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:30.158 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:35:30.465 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install rbd-mirror 2024-09-11T14:35:30.563 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-mirror-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:30.563 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:30.563 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-11T14:35:30.563 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:35:30.564 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:30.564 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:35:30.848 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install rbd-nbd 2024-09-11T14:35:31.031 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:27 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:35:31.165 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:35:31.166 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:31.166 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repo Size 2024-09-11T14:35:31.166 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:31.166 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-11T14:35:31.166 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 3.5 M 2024-09-11T14:35:31.166 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:31.166 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-11T14:35:31.167 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:31.167 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-11T14:35:31.167 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:31.167 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 3.5 M 2024-09-11T14:35:31.167 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 30 M 2024-09-11T14:35:31.167 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-11T14:35:31.432 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:29 ago on Wed 11 Sep 2024 02:33:02 PM UTC. 2024-09-11T14:35:31.523 INFO:teuthology.orchestra.run.smithi176.stdout:rbd-mirror-19.3.0-4872.g0d61375b.el9.x86_64.rpm 9.9 MB/s | 3.5 MB 00:00 2024-09-11T14:35:31.524 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:31.524 INFO:teuthology.orchestra.run.smithi176.stdout:Total 9.8 MB/s | 3.5 MB 00:00 2024-09-11T14:35:31.524 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-11T14:35:31.535 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-11T14:35:31.535 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-11T14:35:31.576 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T14:35:31.576 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:31.577 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-09-11T14:35:31.577 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:31.577 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-11T14:35:31.577 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 177 k 2024-09-11T14:35:31.577 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:31.577 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-11T14:35:31.577 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-11T14:35:31.577 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-11T14:35:31.577 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:31.578 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 177 k 2024-09-11T14:35:31.578 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 685 k 2024-09-11T14:35:31.578 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-11T14:35:31.617 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-11T14:35:31.618 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-11T14:35:31.793 INFO:teuthology.orchestra.run.smithi103.stdout:rbd-nbd-19.3.0-4872.g0d61375b.el9.x86_64.rpm 824 kB/s | 177 kB 00:00 2024-09-11T14:35:31.793 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:31.794 INFO:teuthology.orchestra.run.smithi103.stdout:Total 817 kB/s | 177 kB 00:00 2024-09-11T14:35:31.794 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-11T14:35:31.805 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-11T14:35:31.805 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-11T14:35:31.872 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-11T14:35:31.873 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-11T14:35:32.036 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-11T14:35:32.134 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-nbd-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:32.194 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-11T14:35:32.257 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-mirror-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:32.283 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:32.283 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:35:32.283 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T14:35:32.283 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T14:35:32.283 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T14:35:32.284 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:32.593 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-nbd-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:32.838 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-11T14:35:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:35:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:32.838 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T14:35:33.164 DEBUG:teuthology.parallel:result is None 2024-09-11T14:35:33.527 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-mirror-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:33.527 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:33.527 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-11T14:35:33.528 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:35:33.528 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:33.528 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:35:33.784 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install rbd-nbd 2024-09-11T14:35:34.361 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:30 ago on Wed 11 Sep 2024 02:33:04 PM UTC. 2024-09-11T14:35:34.501 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-11T14:35:34.502 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:34.502 INFO:teuthology.orchestra.run.smithi176.stdout: Package Architecture Version Repository Size 2024-09-11T14:35:34.502 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:34.502 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-11T14:35:34.502 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 177 k 2024-09-11T14:35:34.502 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:34.502 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-11T14:35:34.502 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-11T14:35:34.502 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-11T14:35:34.502 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:34.503 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 177 k 2024-09-11T14:35:34.503 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 685 k 2024-09-11T14:35:34.503 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-11T14:35:34.744 INFO:teuthology.orchestra.run.smithi176.stdout:rbd-nbd-19.3.0-4872.g0d61375b.el9.x86_64.rpm 735 kB/s | 177 kB 00:00 2024-09-11T14:35:34.745 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:34.745 INFO:teuthology.orchestra.run.smithi176.stdout:Total 731 kB/s | 177 kB 00:00 2024-09-11T14:35:34.745 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-11T14:35:34.754 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-11T14:35:34.754 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-11T14:35:34.820 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-11T14:35:34.820 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-11T14:35:34.980 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-11T14:35:35.083 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-nbd-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:35.591 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:35.851 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-nbd-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:35:35.851 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:35.851 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-11T14:35:35.851 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:35:35.851 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:35.851 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-11T14:35:36.109 DEBUG:teuthology.parallel:result is None 2024-09-11T14:35:36.110 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=0d61375b8ab53be4c233f5b93e463edfdff9316a 2024-09-11T14:35:36.254 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T14:35:36.280 INFO:teuthology.orchestra.run.smithi103.stdout:19.3.0-4872.g0d61375b.el9 2024-09-11T14:35:36.281 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4872.g0d61375b.el9 2024-09-11T14:35:36.281 INFO:teuthology.task.install:The correct ceph version 19.3.0-4872.g0d61375b is installed. 2024-09-11T14:35:36.283 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=0d61375b8ab53be4c233f5b93e463edfdff9316a 2024-09-11T14:35:36.423 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T14:35:36.445 INFO:teuthology.orchestra.run.smithi176.stdout:19.3.0-4872.g0d61375b.el9 2024-09-11T14:35:36.445 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4872.g0d61375b.el9 2024-09-11T14:35:36.445 INFO:teuthology.task.install:The correct ceph version 19.3.0-4872.g0d61375b is installed. 2024-09-11T14:35:36.447 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T14:35:36.447 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T14:35:36.447 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T14:35:36.479 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-11T14:35:36.479 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T14:35:36.512 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T14:35:36.512 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T14:35:36.512 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T14:35:36.547 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T14:35:36.616 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-11T14:35:36.617 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T14:35:36.642 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T14:35:36.707 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T14:35:36.708 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T14:35:36.708 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T14:35:36.736 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T14:35:36.803 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-11T14:35:36.803 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T14:35:36.855 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T14:35:36.921 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T14:35:36.921 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T14:35:36.922 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T14:35:36.951 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T14:35:37.021 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-11T14:35:37.021 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T14:35:37.045 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T14:35:37.111 INFO:teuthology.run_tasks:Running task ceph... 2024-09-11T14:35:37.192 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-11T14:35:37.192 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /var/log/ceph 2024-09-11T14:35:37.195 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 777 /var/log/ceph 2024-09-11T14:35:37.221 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-11T14:35:37.222 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T14:35:37.264 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T14:35:37.291 INFO:tasks.ceph:Creating extra log directories... 2024-09-11T14:35:37.291 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T14:35:37.333 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T14:35:37.369 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-11T14:35:37.369 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore ompap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-11T14:35:37.369 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901362', 'branch': 'main', 'description': 'crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore thrashers/simple thrashosds-health workloads/radosbench}', 'email': None, 'first_in_suite': False, 'job_id': '7901362', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore ompap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'wip-matanb-crimson-seastore-logs', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': 'dbebf1a3db6db7b5579464ee715edcf1b3e9cce2'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 5813, 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'wip-matanb-crimson-seastore-logs', 'suite_path': '/home/teuthworker/src/github.com_matan-b_ceph_dbebf1a3db6db7b5579464ee715edcf1b3e9cce2/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/matan-b/ceph.git', 'suite_sha1': 'dbebf1a3db6db7b5579464ee715edcf1b3e9cce2', 'targets': {'smithi103.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJCS5ZNaZ3SvQMlN2GkBgywAGk4vw7tuaZpQlEbAaHWhxqmKYna8UvrTQL/q1KhPuE+0Y58166ksd+wKwVPY0fQ=', 'smithi176.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBItYjkqnoCqrfFwIqVfJ/De9259aHoBTYL7BeK1SHAoGnw1jvuTQavO4ycUdY3GHtBVJoeXPP+9quMeayHnMsrE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore ompap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a', 'cluster': 'ceph'}}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400}}, {'full_sequential': [{'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}]}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_13:56:22', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-11T14:35:37.370 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T14:35:37.401 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T14:35:37.417 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T14:35:37.459 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T14:35:37.484 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T14:35:37.485 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T14:35:37.541 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T14:35:37.542 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2024-09-11T14:35:37.598 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T14:35:37.598 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:35:37.598 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-11T14:35:37.598 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:35:37.598 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:35:37.599 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-11 14:35:29.843184944 +0000 2024-09-11T14:35:37.599 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-11 14:32:20.712455881 +0000 2024-09-11T14:35:37.599 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-11 14:32:20.712455881 +0000 2024-09-11T14:35:37.599 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-11 14:32:20.712455881 +0000 2024-09-11T14:35:37.599 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T14:35:37.664 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-11T14:35:37.664 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-11T14:35:37.664 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000263102 s, 1.9 MB/s 2024-09-11T14:35:37.665 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T14:35:37.723 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2024-09-11T14:35:37.778 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T14:35:37.779 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:35:37.779 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-11T14:35:37.779 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:35:37.779 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:35:37.779 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-11 14:35:29.843184944 +0000 2024-09-11T14:35:37.779 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-11 14:32:21.057449346 +0000 2024-09-11T14:35:37.779 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-11 14:32:21.057449346 +0000 2024-09-11T14:35:37.779 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-11 14:32:21.057449346 +0000 2024-09-11T14:35:37.779 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T14:35:37.843 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-11T14:35:37.843 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-11T14:35:37.843 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000187291 s, 2.7 MB/s 2024-09-11T14:35:37.844 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T14:35:37.901 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2024-09-11T14:35:37.957 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T14:35:37.958 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:35:37.958 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-11T14:35:37.958 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:35:37.958 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:35:37.958 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-11 14:35:29.843184944 +0000 2024-09-11T14:35:37.958 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-11 14:32:21.381443208 +0000 2024-09-11T14:35:37.958 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-11 14:32:21.381443208 +0000 2024-09-11T14:35:37.958 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-11 14:32:21.381443208 +0000 2024-09-11T14:35:37.958 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T14:35:38.021 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-11T14:35:38.021 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-11T14:35:38.021 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000225447 s, 2.3 MB/s 2024-09-11T14:35:38.022 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T14:35:38.079 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2024-09-11T14:35:38.134 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T14:35:38.134 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:35:38.134 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-11T14:35:38.134 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:35:38.134 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:35:38.134 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-11 14:35:29.844184925 +0000 2024-09-11T14:35:38.135 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-11 14:32:21.716436863 +0000 2024-09-11T14:35:38.135 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-11 14:32:21.716436863 +0000 2024-09-11T14:35:38.135 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-11 14:32:21.716436863 +0000 2024-09-11T14:35:38.135 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T14:35:38.198 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-11T14:35:38.198 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-11T14:35:38.198 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000195354 s, 2.6 MB/s 2024-09-11T14:35:38.199 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T14:35:38.256 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-11T14:35:38.256 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-11T14:35:38.256 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T14:35:38.272 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T14:35:38.272 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_1 2024-09-11T14:35:38.327 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T14:35:38.328 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:35:38.328 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-11T14:35:38.328 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:35:38.328 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:35:38.328 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-11 14:35:32.566260052 +0000 2024-09-11T14:35:38.328 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-11 14:32:20.738073089 +0000 2024-09-11T14:35:38.328 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-11 14:32:20.738073089 +0000 2024-09-11T14:35:38.328 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-11 14:32:20.738073089 +0000 2024-09-11T14:35:38.328 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T14:35:38.390 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-11T14:35:38.390 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-11T14:35:38.390 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.00020657 s, 2.5 MB/s 2024-09-11T14:35:38.392 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T14:35:38.448 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_2 2024-09-11T14:35:38.503 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T14:35:38.503 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:35:38.503 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-11T14:35:38.503 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:35:38.504 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:35:38.504 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-11 14:35:32.566260052 +0000 2024-09-11T14:35:38.504 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-11 14:32:21.053070440 +0000 2024-09-11T14:35:38.504 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-11 14:32:21.053070440 +0000 2024-09-11T14:35:38.504 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-11 14:32:21.053070440 +0000 2024-09-11T14:35:38.504 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T14:35:38.566 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-11T14:35:38.566 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-11T14:35:38.566 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000204152 s, 2.5 MB/s 2024-09-11T14:35:38.567 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T14:35:38.623 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_3 2024-09-11T14:35:38.678 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T14:35:38.678 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:35:38.678 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-11T14:35:38.678 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:35:38.678 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:35:38.679 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-11 14:35:32.566260052 +0000 2024-09-11T14:35:38.679 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-11 14:32:21.381067680 +0000 2024-09-11T14:35:38.679 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-11 14:32:21.381067680 +0000 2024-09-11T14:35:38.679 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-11 14:32:21.381067680 +0000 2024-09-11T14:35:38.679 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T14:35:38.741 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-11T14:35:38.741 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-11T14:35:38.741 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000221529 s, 2.3 MB/s 2024-09-11T14:35:38.742 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T14:35:38.798 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_4 2024-09-11T14:35:38.854 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T14:35:38.854 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:35:38.854 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-11T14:35:38.854 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:35:38.854 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:35:38.854 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-11 14:35:32.567260043 +0000 2024-09-11T14:35:38.854 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-11 14:32:21.716064862 +0000 2024-09-11T14:35:38.854 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-11 14:32:21.716064862 +0000 2024-09-11T14:35:38.854 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-11 14:32:21.716064862 +0000 2024-09-11T14:35:38.855 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T14:35:38.917 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-11T14:35:38.917 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-11T14:35:38.917 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000199143 s, 2.6 MB/s 2024-09-11T14:35:38.918 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T14:35:38.974 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-11T14:35:38.974 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-11T14:35:38.974 INFO:tasks.ceph:Generating config... 2024-09-11T14:35:38.975 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-11T14:35:38.975 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-11T14:35:38.975 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-11T14:35:38.975 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-11T14:35:38.976 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-11T14:35:38.976 INFO:tasks.ceph:[osd] debug seastore = 20 2024-09-11T14:35:38.976 INFO:tasks.ceph:[osd] debug seastore backref = 20 2024-09-11T14:35:38.976 INFO:tasks.ceph:[osd] debug seastore cache = 20 2024-09-11T14:35:38.976 INFO:tasks.ceph:[osd] debug seastore cleaner = 20 2024-09-11T14:35:38.976 INFO:tasks.ceph:[osd] debug seastore device = 20 2024-09-11T14:35:38.976 INFO:tasks.ceph:[osd] debug seastore epm = 20 2024-09-11T14:35:38.976 INFO:tasks.ceph:[osd] debug seastore fixedkv tree = 20 2024-09-11T14:35:38.976 INFO:tasks.ceph:[osd] debug seastore journal = 20 2024-09-11T14:35:38.976 INFO:tasks.ceph:[osd] debug seastore lba = 20 2024-09-11T14:35:38.976 INFO:tasks.ceph:[osd] debug seastore odata = 20 2024-09-11T14:35:38.976 INFO:tasks.ceph:[osd] debug seastore ompap = 20 2024-09-11T14:35:38.976 INFO:tasks.ceph:[osd] debug seastore onode = 20 2024-09-11T14:35:38.977 INFO:tasks.ceph:[osd] debug seastore t = 20 2024-09-11T14:35:38.977 INFO:tasks.ceph:[osd] debug seastore tm = 20 2024-09-11T14:35:38.977 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-11T14:35:38.977 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2024-09-11T14:35:38.977 INFO:tasks.ceph:[osd] osd delete sleep = 1 2024-09-11T14:35:38.977 INFO:tasks.ceph:[osd] osd max backfills = 3 2024-09-11T14:35:38.977 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-11T14:35:38.977 INFO:tasks.ceph:[osd] osd objectstore = seastore 2024-09-11T14:35:38.977 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2024-09-11T14:35:38.977 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2024-09-11T14:35:38.977 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-11T14:35:38.977 INFO:tasks.ceph:[osd] osd snap trim sleep = 2 2024-09-11T14:35:38.977 INFO:tasks.ceph:[client.0] debug ms = 1 2024-09-11T14:35:38.977 INFO:tasks.ceph:[client.0] debug objecter = 20 2024-09-11T14:35:38.978 INFO:tasks.ceph:[client.0] debug rados = 20 2024-09-11T14:35:38.978 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-11T14:35:38.978 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-11T14:35:38.978 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-11T14:35:38.978 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-11T14:35:38.978 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-11T14:35:38.978 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-11T14:35:38.978 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-11T14:35:38.978 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2024-09-11T14:35:38.978 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2024-09-11T14:35:38.978 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-11T14:35:38.978 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-11T14:35:38.978 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-11T14:35:38.979 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-11T14:35:38.979 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-11T14:35:38.979 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-11T14:35:38.979 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-11T14:35:38.979 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-11T14:35:38.979 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-11T14:35:38.979 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-11T14:35:38.979 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-11T14:35:38.979 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-09-11T14:35:38.980 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-09-11T14:35:38.980 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-09-11T14:35:38.980 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-09-11T14:35:38.980 INFO:tasks.ceph:Setting up mon.a... 2024-09-11T14:35:38.980 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-11T14:35:39.050 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.keyring 2024-09-11T14:35:39.053 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-11T14:35:39.109 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T14:35:39.134 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.103')] 2024-09-11T14:35:39.135 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.103', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore ompap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-09-11T14:35:39.136 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T14:35:39.136 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T14:35:39.190 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.103 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:35:39.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:35:39.281+0000 7fae92837f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:39.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:35:39.281+0000 7fae92837f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:39.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:35:39.281+0000 7fae92837f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:39.282 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:35:39.283 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: generated fsid dc3d4a5d-c4e2-4e8c-9b89-77a2b35b981a 2024-09-11T14:35:39.283 INFO:teuthology.orchestra.run.smithi103.stdout:setting min_mon_release = quincy 2024-09-11T14:35:39.283 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 0 2024-09-11T14:35:39.283 INFO:teuthology.orchestra.run.smithi103.stdout:fsid dc3d4a5d-c4e2-4e8c-9b89-77a2b35b981a 2024-09-11T14:35:39.283 INFO:teuthology.orchestra.run.smithi103.stdout:last_changed 2024-09-11T14:35:39.282202+0000 2024-09-11T14:35:39.283 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-11T14:35:39.282202+0000 2024-09-11T14:35:39.283 INFO:teuthology.orchestra.run.smithi103.stdout:min_mon_release 17 (quincy) 2024-09-11T14:35:39.283 INFO:teuthology.orchestra.run.smithi103.stdout:election_strategy: 1 2024-09-11T14:35:39.283 INFO:teuthology.orchestra.run.smithi103.stdout:0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-11T14:35:39.283 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-11T14:35:39.284 DEBUG:teuthology.orchestra.run.smithi103:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T14:35:39.299 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID dc3d4a5d-c4e2-4e8c-9b89-77a2b35b981a... 2024-09-11T14:35:39.300 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T14:35:39.342 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T14:35:39.382 INFO:teuthology.orchestra.run.smithi103.stdout:[global] 2024-09-11T14:35:39.382 INFO:teuthology.orchestra.run.smithi103.stdout: chdir = "" 2024-09-11T14:35:39.382 INFO:teuthology.orchestra.run.smithi103.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T14:35:39.382 INFO:teuthology.orchestra.run.smithi103.stdout: auth supported = cephx 2024-09-11T14:35:39.383 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.383 INFO:teuthology.orchestra.run.smithi103.stdout: filestore xattr use omap = true 2024-09-11T14:35:39.383 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.383 INFO:teuthology.orchestra.run.smithi103.stdout: mon clock drift allowed = 1.000 2024-09-11T14:35:39.383 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.383 INFO:teuthology.orchestra.run.smithi103.stdout: osd crush chooseleaf type = 0 2024-09-11T14:35:39.383 INFO:teuthology.orchestra.run.smithi103.stdout: auth debug = true 2024-09-11T14:35:39.383 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.383 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on old message = true 2024-09-11T14:35:39.383 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on bug = true 2024-09-11T14:35:39.383 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.383 INFO:teuthology.orchestra.run.smithi103.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T14:35:39.384 INFO:teuthology.orchestra.run.smithi103.stdout: mon pg warn max object skew = 0 2024-09-11T14:35:39.384 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.384 INFO:teuthology.orchestra.run.smithi103.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T14:35:39.384 INFO:teuthology.orchestra.run.smithi103.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T14:35:39.384 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.384 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default size = 2 2024-09-11T14:35:39.384 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.384 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow primary affinity = true 2024-09-11T14:35:39.384 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow pg remap = true 2024-09-11T14:35:39.384 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on legacy crush tunables = false 2024-09-11T14:35:39.384 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on crush straw calc version zero = false 2024-09-11T14:35:39.385 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on no sortbitwise = false 2024-09-11T14:35:39.385 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on osd down out interval zero = false 2024-09-11T14:35:39.385 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on too few osds = false 2024-09-11T14:35:39.385 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T14:35:39.385 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T14:35:39.385 INFO:teuthology.orchestra.run.smithi103.stdout: mon_allow_pool_size_one = true 2024-09-11T14:35:39.385 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.385 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T14:35:39.385 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.385 INFO:teuthology.orchestra.run.smithi103.stdout: osd default data pool replay window = 5 2024-09-11T14:35:39.385 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.385 INFO:teuthology.orchestra.run.smithi103.stdout: mon allow pool delete = true 2024-09-11T14:35:39.386 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.386 INFO:teuthology.orchestra.run.smithi103.stdout: mon cluster log file level = debug 2024-09-11T14:35:39.386 INFO:teuthology.orchestra.run.smithi103.stdout: debug asserts on shutdown = true 2024-09-11T14:35:39.386 INFO:teuthology.orchestra.run.smithi103.stdout: mon health detail to clog = false 2024-09-11T14:35:39.386 INFO:teuthology.orchestra.run.smithi103.stdout: mon host = 172.21.15.103 2024-09-11T14:35:39.386 INFO:teuthology.orchestra.run.smithi103.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-11T14:35:39.386 INFO:teuthology.orchestra.run.smithi103.stdout: ms client mode = crc 2024-09-11T14:35:39.386 INFO:teuthology.orchestra.run.smithi103.stdout: ms cluster mode = crc 2024-09-11T14:35:39.386 INFO:teuthology.orchestra.run.smithi103.stdout: ms mon client mode = crc 2024-09-11T14:35:39.386 INFO:teuthology.orchestra.run.smithi103.stdout: ms mon cluster mode = crc 2024-09-11T14:35:39.386 INFO:teuthology.orchestra.run.smithi103.stdout: ms mon service mode = crc 2024-09-11T14:35:39.386 INFO:teuthology.orchestra.run.smithi103.stdout: ms service mode = crc 2024-09-11T14:35:39.386 INFO:teuthology.orchestra.run.smithi103.stdout: osd_pool_default_min_size = 2 2024-09-11T14:35:39.386 INFO:teuthology.orchestra.run.smithi103.stdout: osd_pool_default_size = 3 2024-09-11T14:35:39.387 INFO:teuthology.orchestra.run.smithi103.stdout: fsid = dc3d4a5d-c4e2-4e8c-9b89-77a2b35b981a 2024-09-11T14:35:39.387 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.387 INFO:teuthology.orchestra.run.smithi103.stdout:[osd] 2024-09-11T14:35:39.387 INFO:teuthology.orchestra.run.smithi103.stdout: osd journal size = 100 2024-09-11T14:35:39.387 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.387 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub load threshold = 5.0 2024-09-11T14:35:39.387 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub max interval = 120 2024-09-11T14:35:39.387 INFO:teuthology.orchestra.run.smithi103.stdout: osd mclock profile = high_recovery_ops 2024-09-11T14:35:39.387 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.387 INFO:teuthology.orchestra.run.smithi103.stdout: osd recover clone overlap = true 2024-09-11T14:35:39.387 INFO:teuthology.orchestra.run.smithi103.stdout: osd recovery max chunk = 1048576 2024-09-11T14:35:39.387 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.387 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug shutdown = true 2024-09-11T14:35:39.388 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug op order = true 2024-09-11T14:35:39.388 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug verify stray on activate = true 2024-09-11T14:35:39.388 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug trim objects = true 2024-09-11T14:35:39.388 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.388 INFO:teuthology.orchestra.run.smithi103.stdout: osd open classes on start = true 2024-09-11T14:35:39.388 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug pg log writeout = true 2024-09-11T14:35:39.388 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.388 INFO:teuthology.orchestra.run.smithi103.stdout: osd deep scrub update digest min age = 30 2024-09-11T14:35:39.388 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.388 INFO:teuthology.orchestra.run.smithi103.stdout: osd map max advance = 10 2024-09-11T14:35:39.388 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.388 INFO:teuthology.orchestra.run.smithi103.stdout: journal zero on create = true 2024-09-11T14:35:39.388 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.389 INFO:teuthology.orchestra.run.smithi103.stdout: filestore ondisk finisher threads = 3 2024-09-11T14:35:39.389 INFO:teuthology.orchestra.run.smithi103.stdout: filestore apply finisher threads = 3 2024-09-11T14:35:39.389 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.389 INFO:teuthology.orchestra.run.smithi103.stdout: bdev debug aio = true 2024-09-11T14:35:39.389 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug misdirected ops = true 2024-09-11T14:35:39.389 INFO:teuthology.orchestra.run.smithi103.stdout: debug monc = 20 2024-09-11T14:35:39.389 INFO:teuthology.orchestra.run.smithi103.stdout: crimson alien thread cpu cores = 6-7 2024-09-11T14:35:39.389 INFO:teuthology.orchestra.run.smithi103.stdout: crimson osd obc lru size = 10 2024-09-11T14:35:39.389 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-11T14:35:39.389 INFO:teuthology.orchestra.run.smithi103.stdout: debug osd = 20 2024-09-11T14:35:39.389 INFO:teuthology.orchestra.run.smithi103.stdout: debug seastore = 20 2024-09-11T14:35:39.389 INFO:teuthology.orchestra.run.smithi103.stdout: debug seastore backref = 20 2024-09-11T14:35:39.389 INFO:teuthology.orchestra.run.smithi103.stdout: debug seastore cache = 20 2024-09-11T14:35:39.390 INFO:teuthology.orchestra.run.smithi103.stdout: debug seastore cleaner = 20 2024-09-11T14:35:39.390 INFO:teuthology.orchestra.run.smithi103.stdout: debug seastore device = 20 2024-09-11T14:35:39.390 INFO:teuthology.orchestra.run.smithi103.stdout: debug seastore epm = 20 2024-09-11T14:35:39.390 INFO:teuthology.orchestra.run.smithi103.stdout: debug seastore fixedkv tree = 20 2024-09-11T14:35:39.390 INFO:teuthology.orchestra.run.smithi103.stdout: debug seastore journal = 20 2024-09-11T14:35:39.390 INFO:teuthology.orchestra.run.smithi103.stdout: debug seastore lba = 20 2024-09-11T14:35:39.390 INFO:teuthology.orchestra.run.smithi103.stdout: debug seastore odata = 20 2024-09-11T14:35:39.390 INFO:teuthology.orchestra.run.smithi103.stdout: debug seastore ompap = 20 2024-09-11T14:35:39.390 INFO:teuthology.orchestra.run.smithi103.stdout: debug seastore onode = 20 2024-09-11T14:35:39.390 INFO:teuthology.orchestra.run.smithi103.stdout: debug seastore t = 20 2024-09-11T14:35:39.390 INFO:teuthology.orchestra.run.smithi103.stdout: debug seastore tm = 20 2024-09-11T14:35:39.390 INFO:teuthology.orchestra.run.smithi103.stdout: osd blocked scrub grace period = 3600 2024-09-11T14:35:39.390 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug reject backfill probability = 0.3 2024-09-11T14:35:39.390 INFO:teuthology.orchestra.run.smithi103.stdout: osd delete sleep = 1 2024-09-11T14:35:39.391 INFO:teuthology.orchestra.run.smithi103.stdout: osd max backfills = 3 2024-09-11T14:35:39.391 INFO:teuthology.orchestra.run.smithi103.stdout: osd max markdown count = 1000 2024-09-11T14:35:39.391 INFO:teuthology.orchestra.run.smithi103.stdout: osd objectstore = seastore 2024-09-11T14:35:39.391 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub min interval = 60 2024-09-11T14:35:39.391 INFO:teuthology.orchestra.run.smithi103.stdout: osd shutdown pgref assert = True 2024-09-11T14:35:39.391 INFO:teuthology.orchestra.run.smithi103.stdout: osd snap trim sleep = 2 2024-09-11T14:35:39.391 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.391 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr] 2024-09-11T14:35:39.391 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-11T14:35:39.391 INFO:teuthology.orchestra.run.smithi103.stdout: debug mgr = 20 2024-09-11T14:35:39.391 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-09-11T14:35:39.391 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-09-11T14:35:39.391 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-09-11T14:35:39.391 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-09-11T14:35:39.392 INFO:teuthology.orchestra.run.smithi103.stdout: mgr/telemetry/nag = false 2024-09-11T14:35:39.392 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.392 INFO:teuthology.orchestra.run.smithi103.stdout:[mon] 2024-09-11T14:35:39.392 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-11T14:35:39.392 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-09-11T14:35:39.392 INFO:teuthology.orchestra.run.smithi103.stdout: debug paxos = 20 2024-09-11T14:35:39.392 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-09-11T14:35:39.392 INFO:teuthology.orchestra.run.smithi103.stdout: mon data avail warn = 5 2024-09-11T14:35:39.392 INFO:teuthology.orchestra.run.smithi103.stdout: mon mgr mkfs grace = 240 2024-09-11T14:35:39.392 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-09-11T14:35:39.392 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd reporter subtree level = osd 2024-09-11T14:35:39.392 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd prime pg temp = true 2024-09-11T14:35:39.393 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-09-11T14:35:39.393 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.393 INFO:teuthology.orchestra.run.smithi103.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T14:35:39.393 INFO:teuthology.orchestra.run.smithi103.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T14:35:39.393 INFO:teuthology.orchestra.run.smithi103.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T14:35:39.393 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.393 INFO:teuthology.orchestra.run.smithi103.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T14:35:39.393 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T14:35:39.393 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T14:35:39.393 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.393 INFO:teuthology.orchestra.run.smithi103.stdout: # 1m isn't quite enough 2024-09-11T14:35:39.393 INFO:teuthology.orchestra.run.smithi103.stdout: mon_down_mkfs_grace = 2m 2024-09-11T14:35:39.393 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.394 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_filestore_osds = false 2024-09-11T14:35:39.394 INFO:teuthology.orchestra.run.smithi103.stdout: mon min osdmap epochs = 50 2024-09-11T14:35:39.394 INFO:teuthology.orchestra.run.smithi103.stdout: mon osdmap full prune interval = 2 2024-09-11T14:35:39.394 INFO:teuthology.orchestra.run.smithi103.stdout: mon osdmap full prune min = 15 2024-09-11T14:35:39.394 INFO:teuthology.orchestra.run.smithi103.stdout: mon osdmap full prune txsize = 2 2024-09-11T14:35:39.394 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default crimson = True 2024-09-11T14:35:39.394 INFO:teuthology.orchestra.run.smithi103.stdout: paxos service trim min = 10 2024-09-11T14:35:39.394 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:39.394 INFO:teuthology.orchestra.run.smithi103.stdout:[client] 2024-09-11T14:35:39.394 INFO:teuthology.orchestra.run.smithi103.stdout: rgw cache enabled = true 2024-09-11T14:35:39.394 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable ops log = true 2024-09-11T14:35:39.394 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable usage log = true 2024-09-11T14:35:39.394 INFO:teuthology.orchestra.run.smithi103.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T14:35:39.394 INFO:teuthology.orchestra.run.smithi103.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T14:35:39.395 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.a] 2024-09-11T14:35:39.395 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-09-11T14:35:39.395 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-11T14:35:39.395 INFO:teuthology.orchestra.run.smithi103.stdout: debug objecter = 20 2024-09-11T14:35:39.395 INFO:teuthology.orchestra.run.smithi103.stdout: debug rados = 20 2024-09-11T14:35:39.395 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.0] 2024-09-11T14:35:39.395 INFO:teuthology.orchestra.run.smithi103.stdout: crimson seastar cpu cores = 0-2 2024-09-11T14:35:39.395 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.1] 2024-09-11T14:35:39.395 INFO:teuthology.orchestra.run.smithi103.stdout: crimson seastar cpu cores = 3-5 2024-09-11T14:35:39.395 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.2] 2024-09-11T14:35:39.395 INFO:teuthology.orchestra.run.smithi103.stdout: crimson seastar cpu cores = 0-2 2024-09-11T14:35:39.395 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.3] 2024-09-11T14:35:39.395 INFO:teuthology.orchestra.run.smithi103.stdout: crimson seastar cpu cores = 3-5 2024-09-11T14:35:39.397 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2024-09-11T14:35:39.397 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2024-09-11T14:35:39.397 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T14:35:39.397 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2024-09-11T14:35:39.397 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.397 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2024-09-11T14:35:39.397 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.397 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2024-09-11T14:35:39.397 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.398 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2024-09-11T14:35:39.398 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2024-09-11T14:35:39.398 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.398 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2024-09-11T14:35:39.398 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2024-09-11T14:35:39.398 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.398 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T14:35:39.398 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2024-09-11T14:35:39.398 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.398 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T14:35:39.398 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T14:35:39.398 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.399 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2024-09-11T14:35:39.399 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.399 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2024-09-11T14:35:39.399 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2024-09-11T14:35:39.399 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2024-09-11T14:35:39.399 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2024-09-11T14:35:39.399 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2024-09-11T14:35:39.399 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2024-09-11T14:35:39.399 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2024-09-11T14:35:39.399 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T14:35:39.399 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T14:35:39.399 INFO:teuthology.orchestra.run.smithi176.stdout: mon_allow_pool_size_one = true 2024-09-11T14:35:39.400 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.400 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T14:35:39.400 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.400 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2024-09-11T14:35:39.400 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.400 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2024-09-11T14:35:39.400 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.400 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2024-09-11T14:35:39.400 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2024-09-11T14:35:39.400 INFO:teuthology.orchestra.run.smithi176.stdout: mon health detail to clog = false 2024-09-11T14:35:39.400 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = 172.21.15.103 2024-09-11T14:35:39.400 INFO:teuthology.orchestra.run.smithi176.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-11T14:35:39.400 INFO:teuthology.orchestra.run.smithi176.stdout: ms client mode = crc 2024-09-11T14:35:39.401 INFO:teuthology.orchestra.run.smithi176.stdout: ms cluster mode = crc 2024-09-11T14:35:39.401 INFO:teuthology.orchestra.run.smithi176.stdout: ms mon client mode = crc 2024-09-11T14:35:39.401 INFO:teuthology.orchestra.run.smithi176.stdout: ms mon cluster mode = crc 2024-09-11T14:35:39.401 INFO:teuthology.orchestra.run.smithi176.stdout: ms mon service mode = crc 2024-09-11T14:35:39.401 INFO:teuthology.orchestra.run.smithi176.stdout: ms service mode = crc 2024-09-11T14:35:39.401 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_min_size = 2 2024-09-11T14:35:39.401 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_size = 3 2024-09-11T14:35:39.401 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = dc3d4a5d-c4e2-4e8c-9b89-77a2b35b981a 2024-09-11T14:35:39.401 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.401 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2024-09-11T14:35:39.401 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2024-09-11T14:35:39.401 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.401 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2024-09-11T14:35:39.402 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 120 2024-09-11T14:35:39.402 INFO:teuthology.orchestra.run.smithi176.stdout: osd mclock profile = high_recovery_ops 2024-09-11T14:35:39.402 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.402 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2024-09-11T14:35:39.402 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2024-09-11T14:35:39.402 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.402 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2024-09-11T14:35:39.402 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2024-09-11T14:35:39.402 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2024-09-11T14:35:39.402 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug trim objects = true 2024-09-11T14:35:39.402 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.402 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2024-09-11T14:35:39.402 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2024-09-11T14:35:39.403 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.403 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2024-09-11T14:35:39.403 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.403 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2024-09-11T14:35:39.403 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.403 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2024-09-11T14:35:39.403 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.403 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2024-09-11T14:35:39.403 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2024-09-11T14:35:39.403 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.403 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2024-09-11T14:35:39.403 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2024-09-11T14:35:39.403 INFO:teuthology.orchestra.run.smithi176.stdout: debug monc = 20 2024-09-11T14:35:39.404 INFO:teuthology.orchestra.run.smithi176.stdout: crimson alien thread cpu cores = 6-7 2024-09-11T14:35:39.404 INFO:teuthology.orchestra.run.smithi176.stdout: crimson osd obc lru size = 10 2024-09-11T14:35:39.404 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-11T14:35:39.404 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 20 2024-09-11T14:35:39.404 INFO:teuthology.orchestra.run.smithi176.stdout: debug seastore = 20 2024-09-11T14:35:39.404 INFO:teuthology.orchestra.run.smithi176.stdout: debug seastore backref = 20 2024-09-11T14:35:39.404 INFO:teuthology.orchestra.run.smithi176.stdout: debug seastore cache = 20 2024-09-11T14:35:39.404 INFO:teuthology.orchestra.run.smithi176.stdout: debug seastore cleaner = 20 2024-09-11T14:35:39.404 INFO:teuthology.orchestra.run.smithi176.stdout: debug seastore device = 20 2024-09-11T14:35:39.404 INFO:teuthology.orchestra.run.smithi176.stdout: debug seastore epm = 20 2024-09-11T14:35:39.404 INFO:teuthology.orchestra.run.smithi176.stdout: debug seastore fixedkv tree = 20 2024-09-11T14:35:39.404 INFO:teuthology.orchestra.run.smithi176.stdout: debug seastore journal = 20 2024-09-11T14:35:39.404 INFO:teuthology.orchestra.run.smithi176.stdout: debug seastore lba = 20 2024-09-11T14:35:39.404 INFO:teuthology.orchestra.run.smithi176.stdout: debug seastore odata = 20 2024-09-11T14:35:39.405 INFO:teuthology.orchestra.run.smithi176.stdout: debug seastore ompap = 20 2024-09-11T14:35:39.405 INFO:teuthology.orchestra.run.smithi176.stdout: debug seastore onode = 20 2024-09-11T14:35:39.405 INFO:teuthology.orchestra.run.smithi176.stdout: debug seastore t = 20 2024-09-11T14:35:39.405 INFO:teuthology.orchestra.run.smithi176.stdout: debug seastore tm = 20 2024-09-11T14:35:39.405 INFO:teuthology.orchestra.run.smithi176.stdout: osd blocked scrub grace period = 3600 2024-09-11T14:35:39.405 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug reject backfill probability = 0.3 2024-09-11T14:35:39.405 INFO:teuthology.orchestra.run.smithi176.stdout: osd delete sleep = 1 2024-09-11T14:35:39.405 INFO:teuthology.orchestra.run.smithi176.stdout: osd max backfills = 3 2024-09-11T14:35:39.405 INFO:teuthology.orchestra.run.smithi176.stdout: osd max markdown count = 1000 2024-09-11T14:35:39.405 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = seastore 2024-09-11T14:35:39.405 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub min interval = 60 2024-09-11T14:35:39.405 INFO:teuthology.orchestra.run.smithi176.stdout: osd shutdown pgref assert = True 2024-09-11T14:35:39.405 INFO:teuthology.orchestra.run.smithi176.stdout: osd snap trim sleep = 2 2024-09-11T14:35:39.405 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.406 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2024-09-11T14:35:39.406 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-11T14:35:39.406 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2024-09-11T14:35:39.406 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-11T14:35:39.406 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-11T14:35:39.406 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-11T14:35:39.406 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-11T14:35:39.406 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2024-09-11T14:35:39.406 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.406 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2024-09-11T14:35:39.406 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-11T14:35:39.406 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-11T14:35:39.406 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2024-09-11T14:35:39.406 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-11T14:35:39.407 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2024-09-11T14:35:39.407 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2024-09-11T14:35:39.407 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-11T14:35:39.407 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2024-09-11T14:35:39.407 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2024-09-11T14:35:39.407 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-11T14:35:39.407 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.407 INFO:teuthology.orchestra.run.smithi176.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T14:35:39.407 INFO:teuthology.orchestra.run.smithi176.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T14:35:39.407 INFO:teuthology.orchestra.run.smithi176.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T14:35:39.407 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.407 INFO:teuthology.orchestra.run.smithi176.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T14:35:39.407 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T14:35:39.407 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T14:35:39.407 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.408 INFO:teuthology.orchestra.run.smithi176.stdout: # 1m isn't quite enough 2024-09-11T14:35:39.408 INFO:teuthology.orchestra.run.smithi176.stdout: mon_down_mkfs_grace = 2m 2024-09-11T14:35:39.408 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.408 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_filestore_osds = false 2024-09-11T14:35:39.408 INFO:teuthology.orchestra.run.smithi176.stdout: mon min osdmap epochs = 50 2024-09-11T14:35:39.408 INFO:teuthology.orchestra.run.smithi176.stdout: mon osdmap full prune interval = 2 2024-09-11T14:35:39.408 INFO:teuthology.orchestra.run.smithi176.stdout: mon osdmap full prune min = 15 2024-09-11T14:35:39.408 INFO:teuthology.orchestra.run.smithi176.stdout: mon osdmap full prune txsize = 2 2024-09-11T14:35:39.408 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default crimson = True 2024-09-11T14:35:39.408 INFO:teuthology.orchestra.run.smithi176.stdout: paxos service trim min = 10 2024-09-11T14:35:39.408 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-11T14:35:39.408 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2024-09-11T14:35:39.408 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2024-09-11T14:35:39.408 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2024-09-11T14:35:39.409 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2024-09-11T14:35:39.409 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T14:35:39.409 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T14:35:39.409 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2024-09-11T14:35:39.409 INFO:teuthology.orchestra.run.smithi176.stdout:[client.0] 2024-09-11T14:35:39.409 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-11T14:35:39.409 INFO:teuthology.orchestra.run.smithi176.stdout: debug objecter = 20 2024-09-11T14:35:39.409 INFO:teuthology.orchestra.run.smithi176.stdout: debug rados = 20 2024-09-11T14:35:39.409 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.0] 2024-09-11T14:35:39.409 INFO:teuthology.orchestra.run.smithi176.stdout: crimson seastar cpu cores = 0-2 2024-09-11T14:35:39.409 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.1] 2024-09-11T14:35:39.409 INFO:teuthology.orchestra.run.smithi176.stdout: crimson seastar cpu cores = 3-5 2024-09-11T14:35:39.409 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.2] 2024-09-11T14:35:39.409 INFO:teuthology.orchestra.run.smithi176.stdout: crimson seastar cpu cores = 0-2 2024-09-11T14:35:39.410 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.3] 2024-09-11T14:35:39.410 INFO:teuthology.orchestra.run.smithi176.stdout: crimson seastar cpu cores = 3-5 2024-09-11T14:35:39.410 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-11T14:35:39.410 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-11T14:35:39.502 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-11T14:35:39.502 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T14:35:39.502 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-11T14:35:39.517 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T14:35:39.517 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-11T14:35:39.572 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi103.front.sepia.ceph.com 2024-09-11T14:35:39.572 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T14:35:39.573 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T14:35:39.573 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T14:35:39.647 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T14:35:39.647 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:35:39.702 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi176.front.sepia.ceph.com 2024-09-11T14:35:39.702 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-11T14:35:39.702 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T14:35:39.702 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T14:35:39.738 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-11T14:35:39.768 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:35:39.793 INFO:tasks.ceph:Setting up mon nodes... 2024-09-11T14:35:39.794 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-11T14:35:39.794 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T14:35:39.899 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T14:35:39.903 INFO:tasks.ceph:Setting up mds nodes... 2024-09-11T14:35:39.903 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-11T14:35:39.903 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T14:35:39.953 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-11T14:35:39.966 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-11T14:35:40.016 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-11T14:35:40.030 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-11T14:35:40.030 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-11T14:35:40.030 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-11T14:35:40.054 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-11T14:35:40.054 INFO:tasks.ceph:role: osd.0 2024-09-11T14:35:40.054 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-11T14:35:40.055 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T14:35:40.126 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T14:35:40.126 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T14:35:40.126 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T14:35:40.126 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T14:35:40.126 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T14:35:40.126 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-11T14:35:40.126 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T14:35:40.126 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T14:35:40.127 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T14:35:40.127 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T14:35:40.629 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-11T14:35:40.632 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-11T14:35:40.632 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-11T14:35:40.776 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-11T14:35:40.809 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-11T14:35:40.876 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-11T14:35:40.876 INFO:tasks.ceph:role: osd.1 2024-09-11T14:35:40.876 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-11T14:35:40.876 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T14:35:40.948 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T14:35:40.948 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T14:35:40.948 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T14:35:40.948 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T14:35:40.948 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T14:35:40.949 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-11T14:35:40.949 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T14:35:40.949 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T14:35:40.949 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T14:35:40.949 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T14:35:41.398 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-11T14:35:41.400 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-11T14:35:41.400 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-11T14:35:41.495 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-11T14:35:41.525 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:35:41.816 INFO:teuthology.orchestra.run.smithi103.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:35:41.817 INFO:teuthology.orchestra.run.smithi103.stderr:INFO 2024-09-11 14:35:41,817 seastar - Reactor backend: linux-aio 2024-09-11T14:35:41.829 INFO:teuthology.orchestra.run.smithi103.stderr:==27723==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:35:41.952 INFO:teuthology.orchestra.run.smithi103.stderr:INFO 2024-09-11 14:35:41,951 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-11T14:35:41.952 INFO:teuthology.orchestra.run.smithi103.stderr:INFO 2024-09-11 14:35:41,951 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-11T14:35:41.953 INFO:teuthology.orchestra.run.smithi103.stderr:DEBUG 2024-09-11 14:35:41,952 [shard 0:main] seastar - reactor::drain 2024-09-11T14:35:42.472 INFO:teuthology.orchestra.run.smithi103.stderr:----------------------------------------------------- 2024-09-11T14:35:42.473 INFO:teuthology.orchestra.run.smithi103.stderr:Suppressions used: 2024-09-11T14:35:42.473 INFO:teuthology.orchestra.run.smithi103.stderr: count bytes template 2024-09-11T14:35:42.473 INFO:teuthology.orchestra.run.smithi103.stderr: 1 8 MallocExtension::Register 2024-09-11T14:35:42.473 INFO:teuthology.orchestra.run.smithi103.stderr:----------------------------------------------------- 2024-09-11T14:35:42.473 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:35:42.529 INFO:teuthology.orchestra.run.smithi103.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:35:42.533 INFO:teuthology.orchestra.run.smithi103.stderr:INFO 2024-09-11 14:35:42,533 seastar - Reactor backend: linux-aio 2024-09-11T14:35:42.543 INFO:teuthology.orchestra.run.smithi103.stderr:==27721==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:35:42.608 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x4b137 0x5ff0c59 0x603fd4b 0x5fbfef6 0x5fc00d0 0x5fc065c 0x5e081e5 0x5e20427 0x715ebc2 0x7170395 0x7171832 0x71718b7 0x71719b9 0x7171ab1 0x7171cbe 0x7171ea4 0x71721f3 0x7172597 0x71727c7 0x7172a31 0x7172cfe 0x7172f1c 0x7172fd4 0x717309a 0x717317b 0x5c6b026 0x5c6b130 0x5c6b1ec 0x5c6b2a8 0x5c6b364 0x5c6b4b1 0x5c6b63c 0x5c6b9fd 0x5c85800 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:42.608 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:42.831 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x162be2 0x422c4 0x3ef7b 0xfd531 0xba2d45f 0xb9d2631 0x9b01657 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:42.832 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x8b56c 0x10d76c 0xdd31a 0x4ab1c 0x3acdafe 0x3b9225d 0xba3bcee 0xb9d61d4 0x984ae51 0x9b0161a 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:42.832 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 0xffffffffffffff80 0xffffffffa868c7a4 0xffffffffa92d1d62 0xffffffffa9400bb2 2024-09-11T14:35:42.832 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:42.889 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x41e59 0x4214e 0x3ecea 0xfc9b1 0x38833ab 0x3883747 0x9b05da3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:42.889 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x8b558 0x10d76c 0xdd31a 0x4b7ec 0xba4095e 0xba40b6e 0xb9e0f68 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b05f61 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:42.889 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:42.889 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:43.086 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x554963d 0x9e3b02e 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:43.086 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:43.143 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x554a0e1 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:43.143 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:43.177 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x5549172 0x554a11c 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:43.178 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:43.178 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x133c3f 0xdd332 0x4ab1c 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:43.178 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:43.235 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 122 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x554943a 0x9e3b019 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:43.235 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:43.236 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x5549a63 0x9e3b03b 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:43.236 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:43.550 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x10a2c4 0xfe63e 0x959fd4a 0x959fe2b 0x95a0038 0x984ae8e 0x9b0161a 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93195d6 0x931a07a 0x931a0fd 0x931a182 0x931a284 0x931a37c 0x931a402 0x931a4bb 0x931a671 0x931a7a9 0x931a824 0x931a8a9 0x931aa04 0x931ab1e 0x931aba3 0x931ac81 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:43.550 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:43.551 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x3b92234 0xb9f0927 0xb9f1bfa 0xb9f1e74 0xb9f201c 0xb9f3dd7 0xb9f3fd3 0xba38ebd 0xb9e038f 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93195d6 0x931a07a 0x931a0fd 0x931a182 0x931a284 0x931a37c 0x931a402 0x931a4bb 0x931a671 0x931a7a9 0x931a824 0x931a8a9 0x931aa04 0x931ab1e 0x931aba3 0x931ac81 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:43.551 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:43.709 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x554a10a 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:43.710 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:43.767 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x9e3b019 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:43.767 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:44.622 INFO:teuthology.orchestra.run.smithi103.stderr:----------------------------------------------------- 2024-09-11T14:35:44.622 INFO:teuthology.orchestra.run.smithi103.stderr:Suppressions used: 2024-09-11T14:35:44.622 INFO:teuthology.orchestra.run.smithi103.stderr: count bytes template 2024-09-11T14:35:44.622 INFO:teuthology.orchestra.run.smithi103.stderr: 1 8 MallocExtension::Register 2024-09-11T14:35:44.622 INFO:teuthology.orchestra.run.smithi103.stderr:----------------------------------------------------- 2024-09-11T14:35:44.622 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:35:44.650 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T14:35:44.675 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:35:44.952 INFO:teuthology.orchestra.run.smithi103.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:35:44.953 INFO:teuthology.orchestra.run.smithi103.stderr:INFO 2024-09-11 14:35:44,952 seastar - Reactor backend: linux-aio 2024-09-11T14:35:44.958 INFO:teuthology.orchestra.run.smithi103.stderr:==27770==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:35:45.065 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x5ff96d8 0x603f9c1 0x603fbc9 0x603fda9 0x5fbfef6 0x5fc042a 0x5e081e5 0x5e20427 0x715ebc2 0x7170395 0x7171832 0x71718b7 0x71719b9 0x7171ab1 0x7171cbe 0x7171ea4 0x71721f3 0x7172597 0x71727c7 0x7172a31 0x7172cfe 0x7172f1c 0x7172fd4 0x717309a 0x717317b 0x5c6b026 0x5c6b130 0x5c6b1ec 0x5c6b2a8 0x5c6b364 0x5c6b4b1 0x5c6b63c 0x5c6b9fd 0x5c85800 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x3968bb0 0x396a38a 0x380ac18 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:45.065 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:45.085 INFO:teuthology.orchestra.run.smithi103.stderr:INFO 2024-09-11 14:35:45,084 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-11T14:35:45.085 INFO:teuthology.orchestra.run.smithi103.stderr:INFO 2024-09-11 14:35:45,084 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-11T14:35:45.085 INFO:teuthology.orchestra.run.smithi103.stderr:DEBUG 2024-09-11 14:35:45,085 [shard 0:main] seastar - reactor::drain 2024-09-11T14:35:45.589 INFO:teuthology.orchestra.run.smithi103.stderr:----------------------------------------------------- 2024-09-11T14:35:45.589 INFO:teuthology.orchestra.run.smithi103.stderr:Suppressions used: 2024-09-11T14:35:45.589 INFO:teuthology.orchestra.run.smithi103.stderr: count bytes template 2024-09-11T14:35:45.589 INFO:teuthology.orchestra.run.smithi103.stderr: 1 8 MallocExtension::Register 2024-09-11T14:35:45.589 INFO:teuthology.orchestra.run.smithi103.stderr:----------------------------------------------------- 2024-09-11T14:35:45.589 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:35:45.652 INFO:teuthology.orchestra.run.smithi103.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:35:45.656 INFO:teuthology.orchestra.run.smithi103.stderr:INFO 2024-09-11 14:35:45,656 seastar - Reactor backend: linux-aio 2024-09-11T14:35:45.671 INFO:teuthology.orchestra.run.smithi103.stderr:==27768==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:35:45.967 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x4003f 0x444c7 0xfe5da 0x5cca65c 0x5cca836 0x5ccaaed 0x5ccaab2 0x5ccabe2 0x963e4bc 0x9b01947 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:45.968 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xb85a6b1 0xb85a87a 0xb85a963 0xb85ac23 0xba2e325 0xba2e414 0xba2e694 0xba2ec3f 0xba2f101 0xba2f559 0xb9d3126 0xba2fa98 0xba2fcdf 0xba2fd8f 0xb9df75d 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:45.968 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:45.968 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:46.025 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xb9f200c 0xb9f3dd7 0xb9f3fd3 0xba38ebd 0xb9e038f 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b05f61 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:46.026 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:46.026 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x3870008 0xb85a732 0xb85a87a 0xb85a963 0xb85ac23 0xb85ad16 0xb85adf6 0xb85b4b6 0xb85b621 0xb85ba2c 0xb85bceb 0xba2d647 0xb9e284d 0xb9ced56 0xb9cf13a 0x9b05f61 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:46.026 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:46.027 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x42198 0x3ef7b 0xfd531 0xb85ab4d 0xb85ac00 0xb85ad16 0xb85adf6 0xb85b4b6 0xb85b621 0xb85ba2c 0xb85bceb 0xba2da49 0xba2fa57 0xba2fcdf 0xba2fd8f 0xb9df75d 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x927c472 0x927c98e 0x927cb17 0x927cd5e 0x927d036 0x927d0eb 0x959a3a8 0x959a60d 0x95d25f3 0x96d6bde 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:46.028 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 0xffffffffffffff80 0xffffffffa868c7a4 0xffffffffa92d1d62 0xffffffffa9400bb2 2024-09-11T14:35:46.084 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 123 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xba2f544 0xb9d3126 0xba2fa98 0xba2fcdf 0xba2fd8f 0xb9df75d 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x927c472 0x927c98e 0x927cb17 0x927cd5e 0x927d036 0x927d0eb 0x959a3a8 0x959a60d 0x95d25f3 0x96d6bde 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:46.084 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:46.224 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x554966a 0x9e3b02e 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:46.224 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:46.281 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x133c52 0xdd332 0x4ab1c 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:46.282 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:46.325 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x5549680 0x9e3b02e 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:46.325 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:46.326 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x133c5b 0xdd332 0x4ab1c 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:46.326 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:46.383 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x554929d 0x9e3b019 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:46.383 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:46.383 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 122 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x10252a 0x10d76c 0xdd31a 0x4ab1c 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:46.384 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:46.694 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x4449e 0xfe5da 0x5cca65c 0x5cca836 0x5ccaaed 0x5ccaab2 0x5ccabe2 0xba24174 0xb9e408e 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93195d6 0x931a07a 0x931a0fd 0x931a182 0x931a284 0x931a37c 0x931a402 0x931a4bb 0x931a671 0x931a7a9 0x931a824 0x931a8a9 0x931aa04 0x931ab1e 0x931aba3 0x931ac81 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:46.694 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x133c2c 0xdd332 0x4b14c 0xb9f1ec8 0xb9f201c 0xb9f45e7 0xb9e014c 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93195d6 0x931a07a 0x931a0fd 0x931a182 0x931a284 0x931a37c 0x931a402 0x931a4bb 0x931a671 0x931a7a9 0x931a824 0x931a8a9 0x931aa04 0x931ab1e 0x931aba3 0x931ac81 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:46.694 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:46.694 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:46.853 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xdd339 0x4ab1c 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:46.853 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-11T14:35:47.754 INFO:teuthology.orchestra.run.smithi103.stderr:----------------------------------------------------- 2024-09-11T14:35:47.754 INFO:teuthology.orchestra.run.smithi103.stderr:Suppressions used: 2024-09-11T14:35:47.754 INFO:teuthology.orchestra.run.smithi103.stderr: count bytes template 2024-09-11T14:35:47.754 INFO:teuthology.orchestra.run.smithi103.stderr: 1 8 MallocExtension::Register 2024-09-11T14:35:47.754 INFO:teuthology.orchestra.run.smithi103.stderr:----------------------------------------------------- 2024-09-11T14:35:47.754 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:35:47.781 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T14:35:47.806 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-11T14:35:47.837 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-11T14:35:47.837 INFO:tasks.ceph:role: osd.2 2024-09-11T14:35:47.837 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-11T14:35:47.837 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T14:35:47.912 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T14:35:47.913 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T14:35:47.913 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T14:35:47.913 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T14:35:47.913 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T14:35:47.913 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-11T14:35:47.913 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T14:35:47.913 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T14:35:47.913 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T14:35:47.913 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T14:35:48.428 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-09-11T14:35:48.430 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-11T14:35:48.431 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-11T14:35:48.547 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-11T14:35:48.579 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-11T14:35:48.644 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-11T14:35:48.644 INFO:tasks.ceph:role: osd.3 2024-09-11T14:35:48.644 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-11T14:35:48.644 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T14:35:48.724 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T14:35:48.724 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T14:35:48.724 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T14:35:48.724 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T14:35:48.724 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T14:35:48.724 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-11T14:35:48.724 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T14:35:48.724 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T14:35:48.724 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T14:35:48.724 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T14:35:49.179 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-09-11T14:35:49.182 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-11T14:35:49.182 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-09-11T14:35:49.267 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-11T14:35:49.295 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:35:49.626 INFO:teuthology.orchestra.run.smithi176.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:35:49.627 INFO:teuthology.orchestra.run.smithi176.stderr:INFO 2024-09-11 14:35:49,626 seastar - Reactor backend: linux-aio 2024-09-11T14:35:49.642 INFO:teuthology.orchestra.run.smithi176.stderr:==27522==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:35:49.767 INFO:teuthology.orchestra.run.smithi176.stderr:INFO 2024-09-11 14:35:49,767 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-11T14:35:49.767 INFO:teuthology.orchestra.run.smithi176.stderr:INFO 2024-09-11 14:35:49,767 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-11T14:35:49.768 INFO:teuthology.orchestra.run.smithi176.stderr:DEBUG 2024-09-11 14:35:49,768 [shard 0:main] seastar - reactor::drain 2024-09-11T14:35:50.306 INFO:teuthology.orchestra.run.smithi176.stderr:----------------------------------------------------- 2024-09-11T14:35:50.306 INFO:teuthology.orchestra.run.smithi176.stderr:Suppressions used: 2024-09-11T14:35:50.306 INFO:teuthology.orchestra.run.smithi176.stderr: count bytes template 2024-09-11T14:35:50.306 INFO:teuthology.orchestra.run.smithi176.stderr: 1 8 MallocExtension::Register 2024-09-11T14:35:50.306 INFO:teuthology.orchestra.run.smithi176.stderr:----------------------------------------------------- 2024-09-11T14:35:50.306 INFO:teuthology.orchestra.run.smithi176.stderr: 2024-09-11T14:35:50.360 INFO:teuthology.orchestra.run.smithi176.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:35:50.364 INFO:teuthology.orchestra.run.smithi176.stderr:INFO 2024-09-11 14:35:50,363 seastar - Reactor backend: linux-aio 2024-09-11T14:35:50.373 INFO:teuthology.orchestra.run.smithi176.stderr:==27518==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:35:50.438 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x4476f 0xfe5da 0x362d869 0x362d983 0x5fc0c74 0x5e081e5 0x5e20427 0x715ebc2 0x7170395 0x7171832 0x71718b7 0x71719b9 0x7171ab1 0x7171cbe 0x7171ea4 0x71721f3 0x7172597 0x71727c7 0x7172a31 0x7172cfe 0x7172f1c 0x7172fd4 0x717309a 0x717317b 0x5c6b026 0x5c6b130 0x5c6b1ec 0x5c6b2a8 0x5c6b364 0x5c6b4b1 0x5c6b63c 0x5c6b9fd 0x5c85800 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:50.439 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:50.664 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x42198 0x3ecea 0xfc9b1 0x3870209 0xba2d8b2 0xba312a0 0xb9e403b 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:50.665 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x162b9f 0x422c4 0x3ef7b 0xfd531 0xb85ab4d 0xba3afec 0xba3b11e 0xba3b29a 0xba3ba49 0xb9d61d4 0x984ae51 0x9b01034 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:50.665 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff833f606c 0xffffffff833f64c0 0xffffffff832908cb 0xffffffff835a8239 0xffffffff8358e2a3 0xffffffff83596a3b 0xffffffff83596ebc 0xffffffff8328c884 0xffffffff83ed1d62 0xffffffff84000bb2 2024-09-11T14:35:50.665 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff8384801d 0xffffffff835bb303 0xffffffff835bb929 0xffffffff835bd9d9 0xffffffff835bee42 0xffffffff835bf6b7 0xffffffff835e4853 0xffffffff8358ebde 0xffffffff83596a3b 0xffffffff83596ebc 0xffffffff8328c884 0xffffffff83ed1d62 0xffffffff84000bb2 2024-09-11T14:35:50.722 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xc03ad 0x13f4d6 0x9b06961 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:50.722 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x162bff 0x422c4 0x3ef7b 0xfd531 0x3c3af50 0x556073c 0x9ed85bd 0x9ed8b76 0x9ed8f1e 0x9edc2f8 0x9edcf54 0x9edd217 0x9edde8e 0x9e293f2 0x9a07671 0x9a07c77 0x98fcbb0 0x93358b1 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:50.722 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:50.722 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff8361f3b1 0xffffffff83620be9 0xffffffff8358ebf9 0xffffffff83596a3b 0xffffffff83596ebc 0xffffffff8328c884 0xffffffff83ed1d62 0xffffffff84000bb2 2024-09-11T14:35:50.723 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xc9235 0xc9e39 0x360e4e8 0x3b92070 0x3b92268 0xb9f0927 0xb9f1bfa 0xb9f1e74 0xb9f201c 0xb9fceab 0xb9fd36e 0xba38afd 0xba390d8 0xb9e038f 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x927c472 0x927c98e 0x927cb17 0x927cd5e 0x927d036 0x927d0eb 0x959a3a8 0x959a60d 0x95d25f3 0x96d6bde 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:50.723 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:50.781 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 123 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x156dc 0xdd312 0x4ab1c 0x611b8e4 0xba3becf 0xba3bf95 0xba3c1ec 0xba3c388 0xba3c71e 0xba3c930 0xb9d97af 0xb9d9bd4 0xb9dfb97 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x927c472 0x927c98e 0x927cb17 0x927cd5e 0x927d036 0x927d0eb 0x959a3a8 0x959a60d 0x95d25f3 0x96d6bde 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:50.781 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:50.916 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x8b56c 0x10d76c 0xdd31a 0x4ab1c 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:50.916 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:50.974 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xdd323 0x4ab1c 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:50.974 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:51.005 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x4ab3d 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:51.005 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:51.005 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x5549a78 0x9e3b03b 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:51.005 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:51.062 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x5549fa6 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:51.063 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:51.063 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 122 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x554a09c 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:51.063 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:51.366 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x44699 0xfe5da 0x5cca65c 0x5cca836 0x5ccaaed 0x5ccabe2 0x963e4bc 0x9b01760 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93195d6 0x931a07a 0x931a0fd 0x931a182 0x931a284 0x931a37c 0x931a402 0x931a4bb 0x931a671 0x931a7a9 0x931a824 0x931a8a9 0x931aa04 0x931ab1e 0x931aba3 0x931ac81 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:51.366 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:51.366 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x3acda67 0x3b9225d 0xb9f0927 0xb9f1bfa 0xb9f1e74 0xb9f201c 0xb9f3dd7 0xb9f4222 0xb9e014c 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93195d6 0x931a07a 0x931a0fd 0x931a182 0x931a284 0x931a37c 0x931a402 0x931a4bb 0x931a671 0x931a7a9 0x931a824 0x931a8a9 0x931aa04 0x931ab1e 0x931aba3 0x931ac81 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:51.366 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:52.432 INFO:teuthology.orchestra.run.smithi176.stderr:----------------------------------------------------- 2024-09-11T14:35:52.432 INFO:teuthology.orchestra.run.smithi176.stderr:Suppressions used: 2024-09-11T14:35:52.432 INFO:teuthology.orchestra.run.smithi176.stderr: count bytes template 2024-09-11T14:35:52.432 INFO:teuthology.orchestra.run.smithi176.stderr: 1 8 MallocExtension::Register 2024-09-11T14:35:52.432 INFO:teuthology.orchestra.run.smithi176.stderr:----------------------------------------------------- 2024-09-11T14:35:52.432 INFO:teuthology.orchestra.run.smithi176.stderr: 2024-09-11T14:35:52.460 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T14:35:52.485 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:35:52.764 INFO:teuthology.orchestra.run.smithi176.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:35:52.765 INFO:teuthology.orchestra.run.smithi176.stderr:INFO 2024-09-11 14:35:52,765 seastar - Reactor backend: linux-aio 2024-09-11T14:35:52.771 INFO:teuthology.orchestra.run.smithi176.stderr:==27570==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:35:52.893 INFO:teuthology.orchestra.run.smithi176.stderr:INFO 2024-09-11 14:35:52,892 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-11T14:35:52.893 INFO:teuthology.orchestra.run.smithi176.stderr:INFO 2024-09-11 14:35:52,892 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-11T14:35:52.893 INFO:teuthology.orchestra.run.smithi176.stderr:DEBUG 2024-09-11 14:35:52,893 [shard 0:main] seastar - reactor::drain 2024-09-11T14:35:53.403 INFO:teuthology.orchestra.run.smithi176.stderr:----------------------------------------------------- 2024-09-11T14:35:53.404 INFO:teuthology.orchestra.run.smithi176.stderr:Suppressions used: 2024-09-11T14:35:53.404 INFO:teuthology.orchestra.run.smithi176.stderr: count bytes template 2024-09-11T14:35:53.404 INFO:teuthology.orchestra.run.smithi176.stderr: 1 8 MallocExtension::Register 2024-09-11T14:35:53.404 INFO:teuthology.orchestra.run.smithi176.stderr:----------------------------------------------------- 2024-09-11T14:35:53.404 INFO:teuthology.orchestra.run.smithi176.stderr: 2024-09-11T14:35:53.466 INFO:teuthology.orchestra.run.smithi176.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:35:53.470 INFO:teuthology.orchestra.run.smithi176.stderr:INFO 2024-09-11 14:35:53,469 seastar - Reactor backend: linux-aio 2024-09-11T14:35:53.484 INFO:teuthology.orchestra.run.smithi176.stderr:==27568==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:35:53.766 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x42198 0x3ecea 0xfc9b1 0x3870209 0xb85c3db 0xba2d476 0xb9d2631 0x9b01071 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:53.766 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff83ee3f2b 0xffffffff83550214 0xffffffff83550308 0xffffffff8358e2bd 0xffffffff83596a3b 0xffffffff83596ebc 0xffffffff8328c884 0xffffffff83ed1d62 0xffffffff84000bb2 2024-09-11T14:35:53.766 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x6119588 0x611b622 0x611b717 0x611b99f 0xba3becf 0xba3bf95 0xba3c1ec 0xba3c388 0xba3c71e 0xba3c930 0xb9d97af 0xb9d9bd4 0xb9dfb97 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:53.766 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:53.823 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x117f8f 0x60f1a24 0x9ed80e5 0x9ed889c 0x9ed8b76 0x9ed8f1e 0x9edc2f8 0x9edcf54 0x9edd217 0x9edde8e 0x9e293f2 0x9a07671 0x9a07c77 0x98fcbb0 0x93358b1 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:53.823 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:53.824 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xb9f0776 0xb9f1bfa 0xb9f1e74 0xb9f201c 0xb9f3dd7 0xb9f3fd3 0xba38ebd 0xb9e038f 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b066a9 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:53.824 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:53.824 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xfc989 0x3870209 0xb85c113 0xba2d476 0xb9d2631 0x9b01657 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x927c472 0x927c98e 0x927cb17 0x927cd5e 0x927d036 0x927d0eb 0x959a3a8 0x959a60d 0x95d25f3 0x96d6bde 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:53.824 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:53.882 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 123 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x41e4c 0x4214e 0x3ef7b 0xfd531 0xb85ab4d 0xb85ac00 0xba2e325 0xba2e414 0xba2ead4 0xba2ec3f 0xba2f101 0xb9d3249 0xba2fa98 0xba2fcdf 0xba2fd8f 0xb9df75d 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x927c472 0x927c98e 0x927cb17 0x927cd5e 0x927d036 0x927d0eb 0x959a3a8 0x959a60d 0x95d25f3 0x96d6bde 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:53.882 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:53.944 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xfd4bb 0xb85ab4d 0xb85ac00 0xb85ad16 0xb85adf6 0xb85b076 0xb85b12f 0xb85b621 0xb85ba2c 0xb85bceb 0xba2d647 0xb9e284d 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x927c472 0x927c98e 0x927cb17 0x927cd5e 0x927d036 0x927d0eb 0x959a3a8 0x959a60d 0x95d25f3 0x96d6bde 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:53.944 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:54.016 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x5549b0e 0x9e3b03b 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:54.016 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:54.074 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x10797f 0xdd2e1 0x4ab1c 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:54.074 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:54.117 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xdd339 0x4ab1c 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:54.117 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:54.121 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x554965d 0x9e3b02e 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:54.121 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:54.174 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x133caf 0xdd332 0x4ab1c 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:54.174 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:54.179 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 122 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x4ab3d 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:54.179 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:54.485 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x161d1f 0xc928c 0xc9e39 0x360e4e8 0x3b92070 0x3b92268 0xb9f0927 0xb9f1bfa 0xb9f1e74 0xb9f201c 0xb9f3dd7 0xb9f4222 0xb9e014c 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93195d6 0x931a07a 0x931a0fd 0x931a182 0x931a284 0x931a37c 0x931a402 0x931a4bb 0x931a671 0x931a7a9 0x931a824 0x931a8a9 0x931aa04 0x931ab1e 0x931aba3 0x931ac81 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:35:54.485 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:54.643 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x8b56c 0x10d76c 0xdd31a 0x4ab1c 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:35:54.643 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-11T14:35:55.552 INFO:teuthology.orchestra.run.smithi176.stderr:----------------------------------------------------- 2024-09-11T14:35:55.552 INFO:teuthology.orchestra.run.smithi176.stderr:Suppressions used: 2024-09-11T14:35:55.552 INFO:teuthology.orchestra.run.smithi176.stderr: count bytes template 2024-09-11T14:35:55.552 INFO:teuthology.orchestra.run.smithi176.stderr: 1 8 MallocExtension::Register 2024-09-11T14:35:55.553 INFO:teuthology.orchestra.run.smithi176.stderr:----------------------------------------------------- 2024-09-11T14:35:55.553 INFO:teuthology.orchestra.run.smithi176.stderr: 2024-09-11T14:35:55.578 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T14:35:55.603 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-11T14:35:55.603 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T14:35:55.604 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-11T14:35:55.635 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T14:35:55.635 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-11T14:35:55.704 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-11T14:35:55.704 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-11T14:35:55.729 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-11T14:35:55.729 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-11T14:35:55.793 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-11T14:35:55.793 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-11T14:35:55.857 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T14:35:55.857 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-11T14:35:55.876 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-11T14:35:55.877 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-11T14:35:55.912 INFO:tasks.ceph:Adding keys to all mons... 2024-09-11T14:35:55.912 DEBUG:teuthology.orchestra.run.smithi103:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T14:35:55.944 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.0] 2024-09-11T14:35:55.944 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQC+quFm4D4kKRAAMXy2TrRdfnWq8jDeCutFUw== 2024-09-11T14:35:55.944 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.1] 2024-09-11T14:35:55.944 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDBquFm2WUoMRAAEUpz9EISD2WH6F3pQVhxCw== 2024-09-11T14:35:55.944 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.x] 2024-09-11T14:35:55.944 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQC7quFmEsegNRAAxZM0FNRRkNuxau7NtbaW8w== 2024-09-11T14:35:55.944 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.2] 2024-09-11T14:35:55.944 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDGquFmNmcMHxAAGe77/PC1fKX8E5N+YgdOeQ== 2024-09-11T14:35:55.944 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.3] 2024-09-11T14:35:55.944 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDJquFmvatuJRAAlGnTsPbvkpYOfNhloawItQ== 2024-09-11T14:35:55.945 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-09-11T14:35:55.945 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQC7quFmjt7NOBAAGlZaDCS9w4k3tWQFT2Co3Q== 2024-09-11T14:35:55.945 INFO:teuthology.orchestra.run.smithi103.stdout:[client.1] 2024-09-11T14:35:55.945 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQC8quFmD2T1ABAAyBut8x8M64mqU6F61ovVVw== 2024-09-11T14:35:55.946 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T14:35:56.053 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T14:35:56.115 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T14:35:56.176 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T14:35:56.237 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T14:35:56.298 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T14:35:56.362 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T14:35:56.428 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-11T14:35:56.428 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-11T14:35:56.452 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T14:35:56.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:35:56.559+0000 7fa7aa430c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:56.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:35:56.559+0000 7fa7aa430c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:56.575 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-11T14:35:56.599 DEBUG:teuthology.orchestra.run.smithi103:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:35:56.655 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-11T14:35:56.655 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T14:35:56.655 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T14:35:56.697 INFO:tasks.ceph.mon.a:Started 2024-09-11T14:35:56.697 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-11T14:35:56.697 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-11T14:35:56.697 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-11T14:35:56.700 INFO:tasks.ceph.mgr.x:Started 2024-09-11T14:35:56.700 DEBUG:tasks.ceph:set 0 configs 2024-09-11T14:35:56.700 INFO:tasks.ceph:Setting crush tunables to default 2024-09-11T14:35:56.700 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd crush tunables default 2024-09-11T14:35:56.779 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-11T14:35:56.777+0000 7f4cc02ddc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:56.779 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-11T14:35:56.777+0000 7f4cc02ddc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:56.779 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-11T14:35:56.777+0000 7f4cc02ddc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:56.794 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-11T14:35:56.793+0000 7f5d8423a000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:56.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:35:56.800+0000 7f6635d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:56.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:35:56.819+0000 7f6635d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:56.822 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-11T14:35:56.820+0000 7f5d8423a000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:56.822 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-11T14:35:56.821+0000 7f5d8423a000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:56.892 INFO:teuthology.orchestra.run.smithi103.stderr:adjusted tunables profile to default 2024-09-11T14:35:56.903 INFO:tasks.ceph:check_enable_crimson: True 2024-09-11T14:35:56.904 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-11T14:35:56.904 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-11T14:35:57.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:35:57.001+0000 7fd552391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:57.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:35:57.011+0000 7fd552391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:57.092 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-11T14:35:57.090+0000 7f4cb6ff4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-11T14:35:57.092 INFO:tasks.ceph.mon.a.smithi103.stderr:Please be aware that this feature is experimental, untested, 2024-09-11T14:35:57.092 INFO:tasks.ceph.mon.a.smithi103.stderr:unsupported, and may result in data corruption, data loss, 2024-09-11T14:35:57.092 INFO:tasks.ceph.mon.a.smithi103.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-11T14:35:57.092 INFO:tasks.ceph.mon.a.smithi103.stderr:feature with important data. 2024-09-11T14:35:57.092 INFO:tasks.ceph.mon.a.smithi103.stderr: 2024-09-11T14:35:57.907 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-11T14:35:57.907 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T14:35:57.908 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-11T14:35:57.935 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T14:35:57.935 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-11T14:35:58.002 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-11T14:35:58.003 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-11T14:35:58.027 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-11T14:35:58.028 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-11T14:35:58.093 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 63bc9ac5-48b1-4a61-8362-266abf9e0d26 0 2024-09-11T14:35:58.241 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-11T14:35:58.234+0000 7f9560591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:58.244 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-11T14:35:58.243+0000 7f9560591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:58.322 INFO:teuthology.orchestra.run.smithi176.stdout:0 2024-09-11T14:35:58.334 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 7cc4e987-5784-4376-aadb-d80950d62fb6 1 2024-09-11T14:35:58.441 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-11T14:35:58.433+0000 7f1b5c511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:58.444 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-11T14:35:58.443+0000 7f1b5c511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:58.522 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-11T14:35:58.533 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new ba65111c-1360-4d9c-9d4d-171dd71c6fbf 2 2024-09-11T14:35:58.642 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-11T14:35:58.635+0000 7fce32274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:58.645 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-11T14:35:58.644+0000 7fce32274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:58.726 INFO:teuthology.orchestra.run.smithi176.stdout:2 2024-09-11T14:35:58.738 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 99584cad-6ea4-4cee-89a2-ae07c08ba388 3 2024-09-11T14:35:58.846 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-11T14:35:58.839+0000 7fc6aa191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:58.850 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-11T14:35:58.848+0000 7fc6aa191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:58.930 INFO:teuthology.orchestra.run.smithi176.stdout:3 2024-09-11T14:35:58.942 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-11T14:35:58.976 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-11T14:35:58.976 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-11T14:35:59.019 INFO:tasks.ceph.osd.0:Started 2024-09-11T14:35:59.019 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-11T14:35:59.050 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T14:35:59.051 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-11T14:35:59.093 INFO:tasks.ceph.osd.1:Started 2024-09-11T14:35:59.093 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-11T14:35:59.125 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T14:35:59.125 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-11T14:35:59.168 INFO:tasks.ceph.osd.2:Started 2024-09-11T14:35:59.168 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-09-11T14:35:59.198 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-11T14:35:59.199 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-11T14:35:59.241 INFO:tasks.ceph.osd.3:Started 2024-09-11T14:35:59.241 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:35:59.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:35:59.350+0000 7fd77e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:59.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:35:59.358+0000 7fd77e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:59.429 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:35:59.429 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":7,"fsid":"dc3d4a5d-c4e2-4e8c-9b89-77a2b35b981a","created":"2024-09-11T14:35:56.808520+0000","modified":"2024-09-11T14:35:58.926553+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T14:35:58.926553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"63bc9ac5-48b1-4a61-8362-266abf9e0d26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7cc4e987-5784-4376-aadb-d80950d62fb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ba65111c-1360-4d9c-9d4d-171dd71c6fbf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"99584cad-6ea4-4cee-89a2-ae07c08ba388","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:35:59.441 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-11T14:35:59.441 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-11T14:35:59.845 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T14:35:59.950 INFO:teuthology.misc.health.smithi103.stderr:2024-09-11T14:35:59.943+0000 7f47a4991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:35:59.954 INFO:teuthology.misc.health.smithi103.stderr:2024-09-11T14:35:59.952+0000 7f47a4991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:00.024 INFO:teuthology.misc.health.smithi103.stdout: 2024-09-11T14:36:00.024 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":7,"fsid":"dc3d4a5d-c4e2-4e8c-9b89-77a2b35b981a","created":"2024-09-11T14:35:56.808520+0000","modified":"2024-09-11T14:35:58.926553+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T14:35:58.926553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"63bc9ac5-48b1-4a61-8362-266abf9e0d26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7cc4e987-5784-4376-aadb-d80950d62fb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ba65111c-1360-4d9c-9d4d-171dd71c6fbf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"99584cad-6ea4-4cee-89a2-ae07c08ba388","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:36:00.034 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-11T14:36:02.222 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-11T14:36:02.220+0000 7f5d2195c640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-11T14:36:06.438 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T14:36:06.541 INFO:teuthology.misc.health.smithi103.stderr:2024-09-11T14:36:06.536+0000 7f41bf284640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:06.545 INFO:teuthology.misc.health.smithi103.stderr:2024-09-11T14:36:06.544+0000 7f41bf284640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:06.743 INFO:teuthology.misc.health.smithi103.stdout: 2024-09-11T14:36:06.743 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":12,"fsid":"dc3d4a5d-c4e2-4e8c-9b89-77a2b35b981a","created":"2024-09-11T14:35:56.808520+0000","modified":"2024-09-11T14:36:06.286345+0000","last_up_change":"2024-09-11T14:36:04.272759+0000","last_in_change":"2024-09-11T14:35:58.926553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:36:05.238841+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63bc9ac5-48b1-4a61-8362-266abf9e0d26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6801","nonce":2844832911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2844832911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6807","nonce":2844832911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2844832911}]},"public_addr":"172.21.15.103:6801/2844832911","cluster_addr":"172.21.15.103:6800/2844832911","heartbeat_back_addr":"172.21.15.103:6807/2844832911","heartbeat_front_addr":"172.21.15.103:6810/2844832911","state":["exists","up"]},{"osd":1,"uuid":"7cc4e987-5784-4376-aadb-d80950d62fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6803","nonce":2605657741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2605657741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6809","nonce":2605657741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2605657741}]},"public_addr":"172.21.15.103:6803/2605657741","cluster_addr":"172.21.15.103:6802/2605657741","heartbeat_back_addr":"172.21.15.103:6809/2605657741","heartbeat_front_addr":"172.21.15.103:6808/2605657741","state":["exists","up"]},{"osd":2,"uuid":"ba65111c-1360-4d9c-9d4d-171dd71c6fbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":594934649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6803","nonce":594934649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":594934649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6807","nonce":594934649}]},"public_addr":"172.21.15.176:6802/594934649","cluster_addr":"172.21.15.176:6803/594934649","heartbeat_back_addr":"172.21.15.176:6806/594934649","heartbeat_front_addr":"172.21.15.176:6807/594934649","state":["exists","up"]},{"osd":3,"uuid":"99584cad-6ea4-4cee-89a2-ae07c08ba388","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1173823068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6811","nonce":1173823068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":1173823068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1173823068}]},"public_addr":"172.21.15.176:6810/1173823068","cluster_addr":"172.21.15.176:6811/1173823068","heartbeat_back_addr":"172.21.15.176:6815/1173823068","heartbeat_front_addr":"172.21.15.176:6814/1173823068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:36:06.754 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-11T14:36:06.755 INFO:tasks.ceph:Creating RBD pool 2024-09-11T14:36:06.755 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-11T14:36:06.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:06.857+0000 7fd3f9591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:06.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:06.914+0000 7fd3f9591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:07.291 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'rbd' created 2024-09-11T14:36:07.307 DEBUG:teuthology.orchestra.run.smithi103:> rbd --cluster ceph pool init rbd 2024-09-11T14:36:07.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:07.417+0000 7f569dc52ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:07.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:07.417+0000 7f569dc52ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:07.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:07.423+0000 7f569dc52ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:10.410 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-11T14:36:10.410 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-11T14:36:10.411 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-11T14:36:10.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:10.515+0000 7fe070c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:10.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:10.524+0000 7fe070c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:10.715 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:36:10.728 INFO:teuthology.orchestra.run.smithi103.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-11T14:36:10.729 INFO:tasks.ceph_manager:config epoch is 1 2024-09-11T14:36:10.729 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T14:36:10.729 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-11T14:36:10.729 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-11T14:36:10.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:10.832+0000 7f4640f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:10.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:10.840+0000 7f4640f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:11.073 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:36:11.084 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2041583468},{"type":"v1","addr":"172.21.15.176:6801","nonce":2041583468}]},"active_addr":"172.21.15.176:6801/2041583468","active_change":"2024-09-11T14:36:01.205224+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":3576965880}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":3830874505}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":1692544385}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":3279459384}]}]} 2024-09-11T14:36:11.088 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-11T14:36:11.089 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T14:36:11.089 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:36:11.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:11.191+0000 7fbf1ec74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:11.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:11.199+0000 7fbf1ec74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:11.389 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:36:11.389 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":16,"fsid":"dc3d4a5d-c4e2-4e8c-9b89-77a2b35b981a","created":"2024-09-11T14:35:56.808520+0000","modified":"2024-09-11T14:36:10.337979+0000","last_up_change":"2024-09-11T14:36:04.272759+0000","last_in_change":"2024-09-11T14:35:58.926553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:36:05.238841+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T14:36:07.115201+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63bc9ac5-48b1-4a61-8362-266abf9e0d26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6801","nonce":2844832911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2844832911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6807","nonce":2844832911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2844832911}]},"public_addr":"172.21.15.103:6801/2844832911","cluster_addr":"172.21.15.103:6800/2844832911","heartbeat_back_addr":"172.21.15.103:6807/2844832911","heartbeat_front_addr":"172.21.15.103:6810/2844832911","state":["exists","up"]},{"osd":1,"uuid":"7cc4e987-5784-4376-aadb-d80950d62fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6803","nonce":2605657741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2605657741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6809","nonce":2605657741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2605657741}]},"public_addr":"172.21.15.103:6803/2605657741","cluster_addr":"172.21.15.103:6802/2605657741","heartbeat_back_addr":"172.21.15.103:6809/2605657741","heartbeat_front_addr":"172.21.15.103:6808/2605657741","state":["exists","up"]},{"osd":2,"uuid":"ba65111c-1360-4d9c-9d4d-171dd71c6fbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":594934649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6803","nonce":594934649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":594934649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6807","nonce":594934649}]},"public_addr":"172.21.15.176:6802/594934649","cluster_addr":"172.21.15.176:6803/594934649","heartbeat_back_addr":"172.21.15.176:6806/594934649","heartbeat_front_addr":"172.21.15.176:6807/594934649","state":["exists","up"]},{"osd":3,"uuid":"99584cad-6ea4-4cee-89a2-ae07c08ba388","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1173823068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6811","nonce":1173823068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":1173823068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1173823068}]},"public_addr":"172.21.15.176:6810/1173823068","cluster_addr":"172.21.15.176:6811/1173823068","heartbeat_back_addr":"172.21.15.176:6815/1173823068","heartbeat_front_addr":"172.21.15.176:6814/1173823068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:36:11.402 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T14:36:11.402 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:36:11.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:11.506+0000 7f8442791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:11.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:11.513+0000 7f8442791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:11.700 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:36:11.700 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":16,"fsid":"dc3d4a5d-c4e2-4e8c-9b89-77a2b35b981a","created":"2024-09-11T14:35:56.808520+0000","modified":"2024-09-11T14:36:10.337979+0000","last_up_change":"2024-09-11T14:36:04.272759+0000","last_in_change":"2024-09-11T14:35:58.926553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:36:05.238841+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T14:36:07.115201+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63bc9ac5-48b1-4a61-8362-266abf9e0d26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6801","nonce":2844832911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2844832911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6807","nonce":2844832911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2844832911}]},"public_addr":"172.21.15.103:6801/2844832911","cluster_addr":"172.21.15.103:6800/2844832911","heartbeat_back_addr":"172.21.15.103:6807/2844832911","heartbeat_front_addr":"172.21.15.103:6810/2844832911","state":["exists","up"]},{"osd":1,"uuid":"7cc4e987-5784-4376-aadb-d80950d62fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6803","nonce":2605657741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2605657741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6809","nonce":2605657741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2605657741}]},"public_addr":"172.21.15.103:6803/2605657741","cluster_addr":"172.21.15.103:6802/2605657741","heartbeat_back_addr":"172.21.15.103:6809/2605657741","heartbeat_front_addr":"172.21.15.103:6808/2605657741","state":["exists","up"]},{"osd":2,"uuid":"ba65111c-1360-4d9c-9d4d-171dd71c6fbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":594934649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6803","nonce":594934649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":594934649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6807","nonce":594934649}]},"public_addr":"172.21.15.176:6802/594934649","cluster_addr":"172.21.15.176:6803/594934649","heartbeat_back_addr":"172.21.15.176:6806/594934649","heartbeat_front_addr":"172.21.15.176:6807/594934649","state":["exists","up"]},{"osd":3,"uuid":"99584cad-6ea4-4cee-89a2-ae07c08ba388","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1173823068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6811","nonce":1173823068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":1173823068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1173823068}]},"public_addr":"172.21.15.176:6810/1173823068","cluster_addr":"172.21.15.176:6811/1173823068","heartbeat_back_addr":"172.21.15.176:6815/1173823068","heartbeat_front_addr":"172.21.15.176:6814/1173823068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:36:11.714 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T14:36:11.714 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T14:36:11.714 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T14:36:11.715 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T14:36:11.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:11.827+0000 7f13f2951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:11.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:11.827+0000 7f823387d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:11.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:11.827+0000 7fee4de7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:11.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:11.827+0000 7fa150d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:11.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:11.837+0000 7fee4de7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:11.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:11.837+0000 7f13f2951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:11.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:11.837+0000 7fa150d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:11.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:11.837+0000 7f823387d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:11.873 INFO:teuthology.orchestra.run.smithi103.stdout:42949672967 2024-09-11T14:36:11.873 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T14:36:11.874 INFO:teuthology.orchestra.run.smithi103.stdout:38654705672 2024-09-11T14:36:11.874 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T14:36:11.882 INFO:teuthology.orchestra.run.smithi103.stdout:38654705672 2024-09-11T14:36:11.882 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T14:36:11.883 INFO:teuthology.orchestra.run.smithi103.stdout:38654705672 2024-09-11T14:36:11.884 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T14:36:11.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:11.988+0000 7efc65791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:12.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:12.001+0000 7efc65791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:12.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:12.034+0000 7ffac46c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:12.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:12.036+0000 7f724ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:12.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:12.045+0000 7ffac46c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:12.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:12.046+0000 7f724ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:12.038+0000 7f6650911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:12.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:12.052+0000 7f6650911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:12.221 INFO:teuthology.orchestra.run.smithi103.stdout:42949672964 2024-09-11T14:36:12.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672967 got 42949672964 for osd.3 2024-09-11T14:36:12.249 INFO:teuthology.orchestra.run.smithi103.stdout:38654705668 2024-09-11T14:36:12.259 INFO:teuthology.orchestra.run.smithi103.stdout:38654705668 2024-09-11T14:36:12.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705668 for osd.0 2024-09-11T14:36:12.270 INFO:teuthology.orchestra.run.smithi103.stdout:38654705668 2024-09-11T14:36:12.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705668 for osd.1 2024-09-11T14:36:12.282 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705668 for osd.2 2024-09-11T14:36:13.238 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T14:36:13.263 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T14:36:13.273 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T14:36:13.283 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T14:36:13.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:13.359+0000 7f9e58348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:13.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:13.371+0000 7f9e58348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:13.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:13.397+0000 7f4993d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:13.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:13.400+0000 7fc8c2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:13.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:13.407+0000 7f4993d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:13.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:13.412+0000 7fc8c2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:13.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:13.446+0000 7ffa34f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:13.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:13.455+0000 7ffa34f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:13.587 INFO:teuthology.orchestra.run.smithi103.stdout:42949672967 2024-09-11T14:36:13.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672967 got 42949672967 for osd.3 2024-09-11T14:36:13.605 DEBUG:teuthology.parallel:result is None 2024-09-11T14:36:13.631 INFO:teuthology.orchestra.run.smithi103.stdout:38654705672 2024-09-11T14:36:13.634 INFO:teuthology.orchestra.run.smithi103.stdout:38654705672 2024-09-11T14:36:13.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.1 2024-09-11T14:36:13.645 DEBUG:teuthology.parallel:result is None 2024-09-11T14:36:13.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.0 2024-09-11T14:36:13.648 DEBUG:teuthology.parallel:result is None 2024-09-11T14:36:13.667 INFO:teuthology.orchestra.run.smithi103.stdout:38654705672 2024-09-11T14:36:13.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.2 2024-09-11T14:36:13.680 DEBUG:teuthology.parallel:result is None 2024-09-11T14:36:13.680 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T14:36:13.680 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:36:13.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:13.824+0000 7fcbb9aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:13.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:13.831+0000 7fcbb9aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:14.015 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:36:14.016 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:36:14.028 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2024-09-11T14:36:13.217812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5112,"kb_used_data":5112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185800,"statfs":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.896247"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.371244+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:36:10.371244+0000","last_peered":"2024-09-11T14:36:10.371244+0000","last_clean":"2024-09-11T14:36:10.371244+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:36:10.371244+0000","last_undegraded":"2024-09-11T14:36:10.371244+0000","last_fullsized":"2024-09-11T14:36:10.371244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.373029+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:10.373029+0000","last_peered":"2024-09-11T14:36:10.373029+0000","last_clean":"2024-09-11T14:36:10.373029+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:36:10.373029+0000","last_undegraded":"2024-09-11T14:36:10.373029+0000","last_fullsized":"2024-09-11T14:36:10.373029+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.372693+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:10.372693+0000","last_peered":"2024-09-11T14:36:10.372693+0000","last_clean":"2024-09-11T14:36:10.372693+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:36:10.372693+0000","last_undegraded":"2024-09-11T14:36:10.372693+0000","last_fullsized":"2024-09-11T14:36:10.372693+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.373019+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:36:10.373019+0000","last_peered":"2024-09-11T14:36:10.373019+0000","last_clean":"2024-09-11T14:36:10.373019+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:36:10.373019+0000","last_undegraded":"2024-09-11T14:36:10.373019+0000","last_fullsized":"2024-09-11T14:36:10.373019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.372994+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:36:10.372994+0000","last_peered":"2024-09-11T14:36:10.372994+0000","last_clean":"2024-09-11T14:36:10.372994+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:36:10.372994+0000","last_undegraded":"2024-09-11T14:36:10.372994+0000","last_fullsized":"2024-09-11T14:36:10.372994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.366779+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:36:10.366779+0000","last_peered":"2024-09-11T14:36:10.366779+0000","last_clean":"2024-09-11T14:36:10.366779+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:36:10.366779+0000","last_undegraded":"2024-09-11T14:36:10.366779+0000","last_fullsized":"2024-09-11T14:36:10.366779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.375528+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:36:10.375528+0000","last_peered":"2024-09-11T14:36:10.375528+0000","last_clean":"2024-09-11T14:36:10.375528+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:36:10.375528+0000","last_undegraded":"2024-09-11T14:36:10.375528+0000","last_fullsized":"2024-09-11T14:36:10.375528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.372433+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:36:10.372433+0000","last_peered":"2024-09-11T14:36:10.372433+0000","last_clean":"2024-09-11T14:36:10.372433+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:36:10.372433+0000","last_undegraded":"2024-09-11T14:36:10.372433+0000","last_fullsized":"2024-09-11T14:36:10.372433+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":88,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.369820+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:36:10.369820+0000","last_peered":"2024-09-11T14:36:10.369820+0000","last_clean":"2024-09-11T14:36:10.369820+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:36:10.369820+0000","last_undegraded":"2024-09-11T14:36:10.369820+0000","last_fullsized":"2024-09-11T14:36:10.369820+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1244,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296484,"statfs":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1632,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296096,"statfs":{"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1568,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296160,"statfs":{"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":668,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297060,"statfs":{"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:36:14.029 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:36:14.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:14.132+0000 7f6c34b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:14.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:14.140+0000 7f6c34b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:14.326 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:36:14.327 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:36:14.340 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2024-09-11T14:36:13.217812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5112,"kb_used_data":5112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185800,"statfs":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.896247"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.371244+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:36:10.371244+0000","last_peered":"2024-09-11T14:36:10.371244+0000","last_clean":"2024-09-11T14:36:10.371244+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:36:10.371244+0000","last_undegraded":"2024-09-11T14:36:10.371244+0000","last_fullsized":"2024-09-11T14:36:10.371244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.373029+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:10.373029+0000","last_peered":"2024-09-11T14:36:10.373029+0000","last_clean":"2024-09-11T14:36:10.373029+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:36:10.373029+0000","last_undegraded":"2024-09-11T14:36:10.373029+0000","last_fullsized":"2024-09-11T14:36:10.373029+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.372693+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:10.372693+0000","last_peered":"2024-09-11T14:36:10.372693+0000","last_clean":"2024-09-11T14:36:10.372693+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:36:10.372693+0000","last_undegraded":"2024-09-11T14:36:10.372693+0000","last_fullsized":"2024-09-11T14:36:10.372693+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.373019+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:36:10.373019+0000","last_peered":"2024-09-11T14:36:10.373019+0000","last_clean":"2024-09-11T14:36:10.373019+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:36:10.373019+0000","last_undegraded":"2024-09-11T14:36:10.373019+0000","last_fullsized":"2024-09-11T14:36:10.373019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.372994+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:36:10.372994+0000","last_peered":"2024-09-11T14:36:10.372994+0000","last_clean":"2024-09-11T14:36:10.372994+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:36:10.372994+0000","last_undegraded":"2024-09-11T14:36:10.372994+0000","last_fullsized":"2024-09-11T14:36:10.372994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.366779+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:36:10.366779+0000","last_peered":"2024-09-11T14:36:10.366779+0000","last_clean":"2024-09-11T14:36:10.366779+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:36:10.366779+0000","last_undegraded":"2024-09-11T14:36:10.366779+0000","last_fullsized":"2024-09-11T14:36:10.366779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.375528+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:36:10.375528+0000","last_peered":"2024-09-11T14:36:10.375528+0000","last_clean":"2024-09-11T14:36:10.375528+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:36:10.375528+0000","last_undegraded":"2024-09-11T14:36:10.375528+0000","last_fullsized":"2024-09-11T14:36:10.375528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.372433+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:36:10.372433+0000","last_peered":"2024-09-11T14:36:10.372433+0000","last_clean":"2024-09-11T14:36:10.372433+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:36:10.372433+0000","last_undegraded":"2024-09-11T14:36:10.372433+0000","last_fullsized":"2024-09-11T14:36:10.372433+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":88,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.369820+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:36:10.369820+0000","last_peered":"2024-09-11T14:36:10.369820+0000","last_clean":"2024-09-11T14:36:10.369820+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:36:10.369820+0000","last_undegraded":"2024-09-11T14:36:10.369820+0000","last_fullsized":"2024-09-11T14:36:10.369820+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1244,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296484,"statfs":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1632,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296096,"statfs":{"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1568,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296160,"statfs":{"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":668,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297060,"statfs":{"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:36:14.341 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T14:36:14.341 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T14:36:14.341 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-11T14:36:14.341 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T14:36:14.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:14.444+0000 7faa19493640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:14.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:14.450+0000 7faa19493640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:14.673 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:36:14.673 INFO:teuthology.orchestra.run.smithi103.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T14:36:14.686 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-11T14:36:14.687 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-11T14:36:14.697 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-11T14:36:14.697 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore ompap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'wip-matanb-crimson-seastore-logs', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': 'dbebf1a3db6db7b5579464ee715edcf1b3e9cce2'}} 2024-09-11T14:36:14.697 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 4, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-11T14:36:14.697 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-11T14:36:14.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:14.801+0000 7fcb8a751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:14.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:14.812+0000 7fcb8a751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:15.015 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-11T14:36:15.015 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T14:36:15.015 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:36:15.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:15.119+0000 7f01716d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:15.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:15.126+0000 7f01716d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:15.314 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:36:15.315 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:36:15.327 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-09-11T14:36:15.218447+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5112,"kb_used_data":5112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185800,"statfs":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.896882"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.371244+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:36:10.371244+0000","last_peered":"2024-09-11T14:36:10.371244+0000","last_clean":"2024-09-11T14:36:10.371244+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:36:10.371244+0000","last_undegraded":"2024-09-11T14:36:10.371244+0000","last_fullsized":"2024-09-11T14:36:10.371244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.373029+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:10.373029+0000","last_peered":"2024-09-11T14:36:10.373029+0000","last_clean":"2024-09-11T14:36:10.373029+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:36:10.373029+0000","last_undegraded":"2024-09-11T14:36:10.373029+0000","last_fullsized":"2024-09-11T14:36:10.373029+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.372693+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:10.372693+0000","last_peered":"2024-09-11T14:36:10.372693+0000","last_clean":"2024-09-11T14:36:10.372693+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:36:10.372693+0000","last_undegraded":"2024-09-11T14:36:10.372693+0000","last_fullsized":"2024-09-11T14:36:10.372693+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.373019+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:36:10.373019+0000","last_peered":"2024-09-11T14:36:10.373019+0000","last_clean":"2024-09-11T14:36:10.373019+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:36:10.373019+0000","last_undegraded":"2024-09-11T14:36:10.373019+0000","last_fullsized":"2024-09-11T14:36:10.373019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.372994+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:36:10.372994+0000","last_peered":"2024-09-11T14:36:10.372994+0000","last_clean":"2024-09-11T14:36:10.372994+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:36:10.372994+0000","last_undegraded":"2024-09-11T14:36:10.372994+0000","last_fullsized":"2024-09-11T14:36:10.372994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.366779+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:36:10.366779+0000","last_peered":"2024-09-11T14:36:10.366779+0000","last_clean":"2024-09-11T14:36:10.366779+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:36:10.366779+0000","last_undegraded":"2024-09-11T14:36:10.366779+0000","last_fullsized":"2024-09-11T14:36:10.366779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.375528+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:36:10.375528+0000","last_peered":"2024-09-11T14:36:10.375528+0000","last_clean":"2024-09-11T14:36:10.375528+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:36:10.375528+0000","last_undegraded":"2024-09-11T14:36:10.375528+0000","last_fullsized":"2024-09-11T14:36:10.375528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.372433+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:36:10.372433+0000","last_peered":"2024-09-11T14:36:10.372433+0000","last_clean":"2024-09-11T14:36:10.372433+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:36:10.372433+0000","last_undegraded":"2024-09-11T14:36:10.372433+0000","last_fullsized":"2024-09-11T14:36:10.372433+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":88,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.369820+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:36:10.369820+0000","last_peered":"2024-09-11T14:36:10.369820+0000","last_clean":"2024-09-11T14:36:10.369820+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:36:10.369820+0000","last_undegraded":"2024-09-11T14:36:10.369820+0000","last_fullsized":"2024-09-11T14:36:10.369820+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1244,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296484,"statfs":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1632,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296096,"statfs":{"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1568,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296160,"statfs":{"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":668,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297060,"statfs":{"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:36:15.328 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:36:15.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:15.432+0000 7f6d13351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:15.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:15.440+0000 7f6d13351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:15.625 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:36:15.626 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:36:15.638 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-09-11T14:36:15.218447+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5112,"kb_used_data":5112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185800,"statfs":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.896882"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.371244+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:36:10.371244+0000","last_peered":"2024-09-11T14:36:10.371244+0000","last_clean":"2024-09-11T14:36:10.371244+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:36:10.371244+0000","last_undegraded":"2024-09-11T14:36:10.371244+0000","last_fullsized":"2024-09-11T14:36:10.371244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.373029+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:10.373029+0000","last_peered":"2024-09-11T14:36:10.373029+0000","last_clean":"2024-09-11T14:36:10.373029+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:36:10.373029+0000","last_undegraded":"2024-09-11T14:36:10.373029+0000","last_fullsized":"2024-09-11T14:36:10.373029+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.372693+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:10.372693+0000","last_peered":"2024-09-11T14:36:10.372693+0000","last_clean":"2024-09-11T14:36:10.372693+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:36:10.372693+0000","last_undegraded":"2024-09-11T14:36:10.372693+0000","last_fullsized":"2024-09-11T14:36:10.372693+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.373019+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:36:10.373019+0000","last_peered":"2024-09-11T14:36:10.373019+0000","last_clean":"2024-09-11T14:36:10.373019+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:36:10.373019+0000","last_undegraded":"2024-09-11T14:36:10.373019+0000","last_fullsized":"2024-09-11T14:36:10.373019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.372994+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:36:10.372994+0000","last_peered":"2024-09-11T14:36:10.372994+0000","last_clean":"2024-09-11T14:36:10.372994+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:36:10.372994+0000","last_undegraded":"2024-09-11T14:36:10.372994+0000","last_fullsized":"2024-09-11T14:36:10.372994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.366779+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:36:10.366779+0000","last_peered":"2024-09-11T14:36:10.366779+0000","last_clean":"2024-09-11T14:36:10.366779+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:36:10.366779+0000","last_undegraded":"2024-09-11T14:36:10.366779+0000","last_fullsized":"2024-09-11T14:36:10.366779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.375528+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:36:10.375528+0000","last_peered":"2024-09-11T14:36:10.375528+0000","last_clean":"2024-09-11T14:36:10.375528+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:36:10.375528+0000","last_undegraded":"2024-09-11T14:36:10.375528+0000","last_fullsized":"2024-09-11T14:36:10.375528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.372433+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:36:10.372433+0000","last_peered":"2024-09-11T14:36:10.372433+0000","last_clean":"2024-09-11T14:36:10.372433+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:36:10.372433+0000","last_undegraded":"2024-09-11T14:36:10.372433+0000","last_fullsized":"2024-09-11T14:36:10.372433+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":88,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.369820+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:36:10.369820+0000","last_peered":"2024-09-11T14:36:10.369820+0000","last_clean":"2024-09-11T14:36:10.369820+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:36:10.369820+0000","last_undegraded":"2024-09-11T14:36:10.369820+0000","last_fullsized":"2024-09-11T14:36:10.369820+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1244,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296484,"statfs":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1632,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296096,"statfs":{"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1568,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296160,"statfs":{"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":668,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297060,"statfs":{"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:36:15.639 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T14:36:15.639 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-11T14:36:15.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:15.741+0000 7eff4f0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:15.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:15.749+0000 7eff4f0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:15.939 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 16 2024-09-11T14:36:15.939 INFO:teuthology.orchestra.run.smithi103.stdout:fsid dc3d4a5d-c4e2-4e8c-9b89-77a2b35b981a 2024-09-11T14:36:15.939 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-11T14:35:56.808520+0000 2024-09-11T14:36:15.939 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-11T14:36:10.337979+0000 2024-09-11T14:36:15.939 INFO:teuthology.orchestra.run.smithi103.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-11T14:36:15.940 INFO:teuthology.orchestra.run.smithi103.stdout:crush_version 4 2024-09-11T14:36:15.940 INFO:teuthology.orchestra.run.smithi103.stdout:full_ratio 0.95 2024-09-11T14:36:15.940 INFO:teuthology.orchestra.run.smithi103.stdout:backfillfull_ratio 0.9 2024-09-11T14:36:15.940 INFO:teuthology.orchestra.run.smithi103.stdout:nearfull_ratio 0.85 2024-09-11T14:36:15.940 INFO:teuthology.orchestra.run.smithi103.stdout:require_min_compat_client luminous 2024-09-11T14:36:15.940 INFO:teuthology.orchestra.run.smithi103.stdout:min_compat_client jewel 2024-09-11T14:36:15.940 INFO:teuthology.orchestra.run.smithi103.stdout:require_osd_release squid 2024-09-11T14:36:15.940 INFO:teuthology.orchestra.run.smithi103.stdout:stretch_mode_enabled false 2024-09-11T14:36:15.940 INFO:teuthology.orchestra.run.smithi103.stdout:allow_crimson=true 2024-09-11T14:36:15.940 INFO:teuthology.orchestra.run.smithi103.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 13 flags hashpspool,nopgchange,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2024-09-11T14:36:15.940 INFO:teuthology.orchestra.run.smithi103.stdout:pool 2 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 16 flags hashpspool,nopgchange,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 1.50 2024-09-11T14:36:15.940 INFO:teuthology.orchestra.run.smithi103.stdout: removed_snaps_queue [2~1] 2024-09-11T14:36:15.941 INFO:teuthology.orchestra.run.smithi103.stdout:max_osd 4 2024-09-11T14:36:15.941 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 up in weight 1 up_from 9 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.103:6801/2844832911 v2:172.21.15.103:6800/2844832911 exists,up 63bc9ac5-48b1-4a61-8362-266abf9e0d26 2024-09-11T14:36:15.941 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 up in weight 1 up_from 9 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.103:6803/2605657741 v2:172.21.15.103:6802/2605657741 exists,up 7cc4e987-5784-4376-aadb-d80950d62fb6 2024-09-11T14:36:15.941 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 up in weight 1 up_from 9 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.176:6802/594934649 v2:172.21.15.176:6803/594934649 exists,up ba65111c-1360-4d9c-9d4d-171dd71c6fbf 2024-09-11T14:36:15.941 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 up in weight 1 up_from 10 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.176:6810/1173823068 v2:172.21.15.176:6811/1173823068 exists,up 99584cad-6ea4-4cee-89a2-ae07c08ba388 2024-09-11T14:36:15.953 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 9 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.103:6801/2844832911 v2:172.21.15.103:6800/2844832911 exists,up 63bc9ac5-48b1-4a61-8362-266abf9e0d26', 'osd.1 up in weight 1 up_from 9 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.103:6803/2605657741 v2:172.21.15.103:6802/2605657741 exists,up 7cc4e987-5784-4376-aadb-d80950d62fb6', 'osd.2 up in weight 1 up_from 9 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.176:6802/594934649 v2:172.21.15.176:6803/594934649 exists,up ba65111c-1360-4d9c-9d4d-171dd71c6fbf', 'osd.3 up in weight 1 up_from 10 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.176:6810/1173823068 v2:172.21.15.176:6811/1173823068 exists,up 99584cad-6ea4-4cee-89a2-ae07c08ba388'] 2024-09-11T14:36:15.953 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-11T14:36:16.059 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T14:36:16.059 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mon.a", 2024-09-11T14:36:16.059 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster": "ceph", 2024-09-11T14:36:16.059 INFO:teuthology.orchestra.run.smithi103.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-11T14:36:16.059 INFO:teuthology.orchestra.run.smithi103.stdout: "admin_socket_mode": "", 2024-09-11T14:36:16.059 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-11T14:36:16.059 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_client_required": "cephx, none", 2024-09-11T14:36:16.059 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_cluster_required": "cephx", 2024-09-11T14:36:16.059 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_debug": "true", 2024-09-11T14:36:16.059 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-11T14:36:16.059 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-11T14:36:16.060 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_service_required": "cephx", 2024-09-11T14:36:16.060 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-11T14:36:16.060 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_supported": "cephx", 2024-09-11T14:36:16.060 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_aio": "true", 2024-09-11T14:36:16.060 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-11T14:36:16.060 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_aio_poll_ms": "250", 2024-09-11T14:36:16.060 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_aio_reap_max": "16", 2024-09-11T14:36:16.060 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_async_discard_threads": "0", 2024-09-11T14:36:16.060 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_block_size": "4096", 2024-09-11T14:36:16.060 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_debug_aio": "false", 2024-09-11T14:36:16.060 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-11T14:36:16.060 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-11T14:36:16.060 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_debug_inflight_ios": "false", 2024-09-11T14:36:16.060 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_enable_discard": "false", 2024-09-11T14:36:16.061 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_flock_retry": "3", 2024-09-11T14:36:16.061 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-11T14:36:16.061 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_inject_crash": "0", 2024-09-11T14:36:16.061 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-11T14:36:16.061 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_ioring": "false", 2024-09-11T14:36:16.061 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_ioring_hipri": "false", 2024-09-11T14:36:16.061 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-11T14:36:16.061 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-11T14:36:16.061 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-11T14:36:16.061 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-11T14:36:16.061 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-11T14:36:16.061 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-11T14:36:16.062 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_type": "", 2024-09-11T14:36:16.062 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_alloc_size": "1048576", 2024-09-11T14:36:16.062 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_allocator": "hybrid", 2024-09-11T14:36:16.062 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_buffered_io": "true", 2024-09-11T14:36:16.062 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_check_for_zeros": "false", 2024-09-11T14:36:16.062 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-11T14:36:16.062 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-11T14:36:16.062 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_compact_log_sync": "false", 2024-09-11T14:36:16.062 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-11T14:36:16.062 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-11T14:36:16.062 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-11T14:36:16.062 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-11T14:36:16.062 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_max_log_runway": "4194304", 2024-09-11T14:36:16.062 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_max_prefetch": "1048576", 2024-09-11T14:36:16.062 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_min_flush_size": "524288", 2024-09-11T14:36:16.063 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_min_log_runway": "1048576", 2024-09-11T14:36:16.063 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_replay_recovery": "false", 2024-09-11T14:36:16.063 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-11T14:36:16.063 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-11T14:36:16.063 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_sync_write": "false", 2024-09-11T14:36:16.063 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-11T14:36:16.063 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-11T14:36:16.063 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-11T14:36:16.063 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_allocation_from_file": "true", 2024-09-11T14:36:16.063 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_allocator": "hybrid", 2024-09-11T14:36:16.063 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_async_db_compaction": "true", 2024-09-11T14:36:16.063 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-11T14:36:16.063 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-11T14:36:16.064 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-11T14:36:16.064 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-11T14:36:16.064 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_bdev_label_multi": "true", 2024-09-11T14:36:16.064 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-11T14:36:16.064 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-11T14:36:16.064 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-11T14:36:16.064 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-11T14:36:16.064 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-11T14:36:16.064 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_create": "true", 2024-09-11T14:36:16.064 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_db_create": "false", 2024-09-11T14:36:16.064 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_db_path": "", 2024-09-11T14:36:16.064 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_db_size": "0", 2024-09-11T14:36:16.064 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_path": "", 2024-09-11T14:36:16.064 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_preallocate_file": "false", 2024-09-11T14:36:16.065 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_size": "107374182400", 2024-09-11T14:36:16.065 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_wal_create": "false", 2024-09-11T14:36:16.065 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_wal_path": "", 2024-09-11T14:36:16.065 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_wal_size": "100663296", 2024-09-11T14:36:16.065 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_bluefs": "true", 2024-09-11T14:36:16.065 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-11T14:36:16.065 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-11T14:36:16.065 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-11T14:36:16.065 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-11T14:36:16.065 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-11T14:36:16.065 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-11T14:36:16.065 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-11T14:36:16.065 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-11T14:36:16.066 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-11T14:36:16.066 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_autotune": "true", 2024-09-11T14:36:16.066 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-11T14:36:16.066 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-11T14:36:16.066 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-11T14:36:16.066 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-11T14:36:16.066 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_size": "0", 2024-09-11T14:36:16.066 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-11T14:36:16.066 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-11T14:36:16.066 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-11T14:36:16.066 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-11T14:36:16.066 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_type": "2q", 2024-09-11T14:36:16.066 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-11T14:36:16.066 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_clone_cow": "true", 2024-09-11T14:36:16.067 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-11T14:36:16.067 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-11T14:36:16.067 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-11T14:36:16.067 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-11T14:36:16.067 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-11T14:36:16.067 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-11T14:36:16.067 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-11T14:36:16.067 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_compression_mode": "none", 2024-09-11T14:36:16.067 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-11T14:36:16.067 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_csum_type": "crc32c", 2024-09-11T14:36:16.067 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-11T14:36:16.067 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-11T14:36:16.067 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_freelist": "false", 2024-09-11T14:36:16.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-11T14:36:16.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-11T14:36:16.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-11T14:36:16.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-11T14:36:16.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-11T14:36:16.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-11T14:36:16.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-11T14:36:16.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-11T14:36:16.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-11T14:36:16.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-11T14:36:16.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-11T14:36:16.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-11T14:36:16.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_small_allocations": "0", 2024-09-11T14:36:16.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-11T14:36:16.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_default_buffered_read": "true", 2024-09-11T14:36:16.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_default_buffered_write": "false", 2024-09-11T14:36:16.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-11T14:36:16.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-11T14:36:16.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-11T14:36:16.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-11T14:36:16.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-11T14:36:16.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-11T14:36:16.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-11T14:36:16.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-11T14:36:16.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-11T14:36:16.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fail_eio": "false", 2024-09-11T14:36:16.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-11T14:36:16.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-11T14:36:16.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-11T14:36:16.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-11T14:36:16.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-11T14:36:16.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-11T14:36:16.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_on_mount": "false", 2024-09-11T14:36:16.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-11T14:36:16.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_on_umount": "false", 2024-09-11T14:36:16.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-11T14:36:16.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-11T14:36:16.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-11T14:36:16.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-11T14:36:16.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-11T14:36:16.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-11T14:36:16.071 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-11T14:36:16.071 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-11T14:36:16.071 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_ignore_data_csum": "false", 2024-09-11T14:36:16.071 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-11T14:36:16.071 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-11T14:36:16.071 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-11T14:36:16.071 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-11T14:36:16.071 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_log_op_age": "5.000000", 2024-09-11T14:36:16.071 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_max_alloc_size": "0", 2024-09-11T14:36:16.071 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_max_blob_size": "0", 2024-09-11T14:36:16.071 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-11T14:36:16.071 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-11T14:36:16.071 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-11T14:36:16.071 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_max_deferred_txc": "32", 2024-09-11T14:36:16.072 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_min_alloc_size": "0", 2024-09-11T14:36:16.072 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-11T14:36:16.072 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-11T14:36:16.072 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_nid_prealloc": "1024", 2024-09-11T14:36:16.072 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-11T14:36:16.072 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-11T14:36:16.072 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-11T14:36:16.072 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-11T14:36:16.072 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_retry_disk_reads": "3", 2024-09-11T14:36:16.072 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_rocksdb_cf": "true", 2024-09-11T14:36:16.072 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-11T14:36:16.072 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-11T14:36:16.072 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-11T14:36:16.073 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-11T14:36:16.073 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-11T14:36:16.073 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-11T14:36:16.073 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-11T14:36:16.073 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-11T14:36:16.073 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_spdk_mem": "512", 2024-09-11T14:36:16.073 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-11T14:36:16.073 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-11T14:36:16.073 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-11T14:36:16.073 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-11T14:36:16.073 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-11T14:36:16.073 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-11T14:36:16.073 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-11T14:36:16.074 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_tracing": "false", 2024-09-11T14:36:16.074 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-11T14:36:16.074 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-11T14:36:16.074 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-11T14:36:16.074 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-11T14:36:16.074 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-11T14:36:16.074 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-11T14:36:16.074 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-11T14:36:16.074 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-11T14:36:16.074 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-11T14:36:16.074 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_write_v2": "false", 2024-09-11T14:36:16.074 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_write_v2_random": "false", 2024-09-11T14:36:16.074 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_zero_block_detection": "false", 2024-09-11T14:36:16.074 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-11T14:36:16.075 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-11T14:36:16.075 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-11T14:36:16.075 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-11T14:36:16.075 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-11T14:36:16.075 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-11T14:36:16.075 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-11T14:36:16.075 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-11T14:36:16.075 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-11T14:36:16.075 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-11T14:36:16.075 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-11T14:36:16.075 INFO:teuthology.orchestra.run.smithi103.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-11T14:36:16.075 INFO:teuthology.orchestra.run.smithi103.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-11T14:36:16.075 INFO:teuthology.orchestra.run.smithi103.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-11T14:36:16.075 INFO:teuthology.orchestra.run.smithi103.stdout: "cephx_cluster_require_signatures": "false", 2024-09-11T14:36:16.075 INFO:teuthology.orchestra.run.smithi103.stdout: "cephx_cluster_require_version": "2", 2024-09-11T14:36:16.076 INFO:teuthology.orchestra.run.smithi103.stdout: "cephx_require_signatures": "false", 2024-09-11T14:36:16.076 INFO:teuthology.orchestra.run.smithi103.stdout: "cephx_require_version": "2", 2024-09-11T14:36:16.076 INFO:teuthology.orchestra.run.smithi103.stdout: "cephx_service_require_signatures": "false", 2024-09-11T14:36:16.076 INFO:teuthology.orchestra.run.smithi103.stdout: "cephx_service_require_version": "2", 2024-09-11T14:36:16.076 INFO:teuthology.orchestra.run.smithi103.stdout: "cephx_sign_messages": "true", 2024-09-11T14:36:16.076 INFO:teuthology.orchestra.run.smithi103.stdout: "chdir": "", 2024-09-11T14:36:16.076 INFO:teuthology.orchestra.run.smithi103.stdout: "client_acl_type": "", 2024-09-11T14:36:16.076 INFO:teuthology.orchestra.run.smithi103.stdout: "client_asio_thread_count": "2", 2024-09-11T14:36:16.076 INFO:teuthology.orchestra.run.smithi103.stdout: "client_cache_mid": "0.750000", 2024-09-11T14:36:16.076 INFO:teuthology.orchestra.run.smithi103.stdout: "client_cache_size": "16384", 2024-09-11T14:36:16.076 INFO:teuthology.orchestra.run.smithi103.stdout: "client_caps_release_delay": "5", 2024-09-11T14:36:16.076 INFO:teuthology.orchestra.run.smithi103.stdout: "client_check_pool_perm": "true", 2024-09-11T14:36:16.076 INFO:teuthology.orchestra.run.smithi103.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-11T14:36:16.077 INFO:teuthology.orchestra.run.smithi103.stdout: "client_debug_force_sync_read": "false", 2024-09-11T14:36:16.077 INFO:teuthology.orchestra.run.smithi103.stdout: "client_debug_getattr_caps": "false", 2024-09-11T14:36:16.077 INFO:teuthology.orchestra.run.smithi103.stdout: "client_debug_inject_features": "", 2024-09-11T14:36:16.077 INFO:teuthology.orchestra.run.smithi103.stdout: "client_debug_inject_tick_delay": "0", 2024-09-11T14:36:16.077 INFO:teuthology.orchestra.run.smithi103.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-11T14:36:16.077 INFO:teuthology.orchestra.run.smithi103.stdout: "client_die_on_failed_remount": "false", 2024-09-11T14:36:16.077 INFO:teuthology.orchestra.run.smithi103.stdout: "client_dirsize_rbytes": "true", 2024-09-11T14:36:16.077 INFO:teuthology.orchestra.run.smithi103.stdout: "client_force_lazyio": "false", 2024-09-11T14:36:16.077 INFO:teuthology.orchestra.run.smithi103.stdout: "client_fs": "", 2024-09-11T14:36:16.077 INFO:teuthology.orchestra.run.smithi103.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-11T14:36:16.077 INFO:teuthology.orchestra.run.smithi103.stdout: "client_inject_release_failure": "false", 2024-09-11T14:36:16.077 INFO:teuthology.orchestra.run.smithi103.stdout: "client_max_inline_size": "4096", 2024-09-11T14:36:16.077 INFO:teuthology.orchestra.run.smithi103.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-11T14:36:16.077 INFO:teuthology.orchestra.run.smithi103.stdout: "client_mds_namespace": "", 2024-09-11T14:36:16.078 INFO:teuthology.orchestra.run.smithi103.stdout: "client_metadata": "", 2024-09-11T14:36:16.078 INFO:teuthology.orchestra.run.smithi103.stdout: "client_mount_gid": "-1", 2024-09-11T14:36:16.078 INFO:teuthology.orchestra.run.smithi103.stdout: "client_mount_timeout": "300", 2024-09-11T14:36:16.078 INFO:teuthology.orchestra.run.smithi103.stdout: "client_mount_uid": "-1", 2024-09-11T14:36:16.078 INFO:teuthology.orchestra.run.smithi103.stdout: "client_mountpoint": "/", 2024-09-11T14:36:16.078 INFO:teuthology.orchestra.run.smithi103.stdout: "client_notify_timeout": "10", 2024-09-11T14:36:16.078 INFO:teuthology.orchestra.run.smithi103.stdout: "client_oc": "true", 2024-09-11T14:36:16.078 INFO:teuthology.orchestra.run.smithi103.stdout: "client_oc_max_dirty": "104857600", 2024-09-11T14:36:16.078 INFO:teuthology.orchestra.run.smithi103.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-11T14:36:16.078 INFO:teuthology.orchestra.run.smithi103.stdout: "client_oc_max_objects": "1000", 2024-09-11T14:36:16.078 INFO:teuthology.orchestra.run.smithi103.stdout: "client_oc_size": "209715200", 2024-09-11T14:36:16.078 INFO:teuthology.orchestra.run.smithi103.stdout: "client_oc_target_dirty": "8388608", 2024-09-11T14:36:16.078 INFO:teuthology.orchestra.run.smithi103.stdout: "client_permissions": "true", 2024-09-11T14:36:16.079 INFO:teuthology.orchestra.run.smithi103.stdout: "client_quota": "true", 2024-09-11T14:36:16.079 INFO:teuthology.orchestra.run.smithi103.stdout: "client_quota_df": "true", 2024-09-11T14:36:16.079 INFO:teuthology.orchestra.run.smithi103.stdout: "client_readahead_max_bytes": "0", 2024-09-11T14:36:16.079 INFO:teuthology.orchestra.run.smithi103.stdout: "client_readahead_max_periods": "4", 2024-09-11T14:36:16.079 INFO:teuthology.orchestra.run.smithi103.stdout: "client_readahead_min": "131072", 2024-09-11T14:36:16.079 INFO:teuthology.orchestra.run.smithi103.stdout: "client_reconnect_stale": "false", 2024-09-11T14:36:16.079 INFO:teuthology.orchestra.run.smithi103.stdout: "client_shutdown_timeout": "30", 2024-09-11T14:36:16.079 INFO:teuthology.orchestra.run.smithi103.stdout: "client_snapdir": ".snap", 2024-09-11T14:36:16.079 INFO:teuthology.orchestra.run.smithi103.stdout: "client_tick_interval": "1", 2024-09-11T14:36:16.079 INFO:teuthology.orchestra.run.smithi103.stdout: "client_trace": "", 2024-09-11T14:36:16.079 INFO:teuthology.orchestra.run.smithi103.stdout: "client_try_dentry_invalidate": "false", 2024-09-11T14:36:16.079 INFO:teuthology.orchestra.run.smithi103.stdout: "client_use_faked_inos": "false", 2024-09-11T14:36:16.079 INFO:teuthology.orchestra.run.smithi103.stdout: "client_use_random_mds": "false", 2024-09-11T14:36:16.079 INFO:teuthology.orchestra.run.smithi103.stdout: "clog_to_graylog": "false", 2024-09-11T14:36:16.080 INFO:teuthology.orchestra.run.smithi103.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-11T14:36:16.080 INFO:teuthology.orchestra.run.smithi103.stdout: "clog_to_graylog_port": "12201", 2024-09-11T14:36:16.080 INFO:teuthology.orchestra.run.smithi103.stdout: "clog_to_monitors": "default=true", 2024-09-11T14:36:16.080 INFO:teuthology.orchestra.run.smithi103.stdout: "clog_to_syslog": "false", 2024-09-11T14:36:16.080 INFO:teuthology.orchestra.run.smithi103.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-11T14:36:16.080 INFO:teuthology.orchestra.run.smithi103.stdout: "clog_to_syslog_level": "info", 2024-09-11T14:36:16.080 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "-", 2024-09-11T14:36:16.080 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_network": "", 2024-09-11T14:36:16.080 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_network_interface": "", 2024-09-11T14:36:16.080 INFO:teuthology.orchestra.run.smithi103.stdout: "compressor_zlib_isal": "false", 2024-09-11T14:36:16.080 INFO:teuthology.orchestra.run.smithi103.stdout: "compressor_zlib_level": "5", 2024-09-11T14:36:16.080 INFO:teuthology.orchestra.run.smithi103.stdout: "compressor_zlib_winsize": "-15", 2024-09-11T14:36:16.080 INFO:teuthology.orchestra.run.smithi103.stdout: "compressor_zstd_level": "1", 2024-09-11T14:36:16.081 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-11T14:36:16.081 INFO:teuthology.orchestra.run.smithi103.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-11T14:36:16.081 INFO:teuthology.orchestra.run.smithi103.stdout: "crimson_alien_op_num_threads": "6", 2024-09-11T14:36:16.081 INFO:teuthology.orchestra.run.smithi103.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-11T14:36:16.081 INFO:teuthology.orchestra.run.smithi103.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-11T14:36:16.081 INFO:teuthology.orchestra.run.smithi103.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-11T14:36:16.081 INFO:teuthology.orchestra.run.smithi103.stdout: "crimson_osd_stat_interval": "0", 2024-09-11T14:36:16.081 INFO:teuthology.orchestra.run.smithi103.stdout: "crimson_seastar_cpu_cores": "", 2024-09-11T14:36:16.081 INFO:teuthology.orchestra.run.smithi103.stdout: "crimson_seastar_num_threads": "0", 2024-09-11T14:36:16.081 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "", 2024-09-11T14:36:16.081 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location_hook": "", 2024-09-11T14:36:16.081 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location_hook_timeout": "10", 2024-09-11T14:36:16.081 INFO:teuthology.orchestra.run.smithi103.stdout: "daemonize": "false", 2024-09-11T14:36:16.081 INFO:teuthology.orchestra.run.smithi103.stdout: "daos_pool": "tank", 2024-09-11T14:36:16.082 INFO:teuthology.orchestra.run.smithi103.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-11T14:36:16.082 INFO:teuthology.orchestra.run.smithi103.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-11T14:36:16.082 INFO:teuthology.orchestra.run.smithi103.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-11T14:36:16.082 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_alienstore": "0/5", 2024-09-11T14:36:16.082 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_allow_any_pool_priority": "false", 2024-09-11T14:36:16.082 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_asok": "1/5", 2024-09-11T14:36:16.082 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_asok_assert_abort": "false", 2024-09-11T14:36:16.082 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_asserts_on_shutdown": "true", 2024-09-11T14:36:16.082 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_auth": "20/20", 2024-09-11T14:36:16.082 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_bdev": "1/3", 2024-09-11T14:36:16.082 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_bluefs": "1/5", 2024-09-11T14:36:16.082 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_bluestore": "1/5", 2024-09-11T14:36:16.082 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_buffer": "0/1", 2024-09-11T14:36:16.082 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_ceph_dedup": "0/5", 2024-09-11T14:36:16.082 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_ceph_exporter": "1/5", 2024-09-11T14:36:16.083 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_cephfs_mirror": "0/5", 2024-09-11T14:36:16.083 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_cephsqlite": "0/5", 2024-09-11T14:36:16.083 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_client": "0/5", 2024-09-11T14:36:16.083 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_compressor": "1/5", 2024-09-11T14:36:16.083 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_context": "0/1", 2024-09-11T14:36:16.083 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_crimson_interrupt": "0/5", 2024-09-11T14:36:16.083 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_crush": "1/1", 2024-09-11T14:36:16.083 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_crypto": "1/5", 2024-09-11T14:36:16.083 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_cyanstore": "0/5", 2024-09-11T14:36:16.083 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_deliberately_leak_memory": "false", 2024-09-11T14:36:16.083 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_disable_randomized_ping": "false", 2024-09-11T14:36:16.083 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_dpdk": "1/5", 2024-09-11T14:36:16.083 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_eventtrace": "1/5", 2024-09-11T14:36:16.083 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_filer": "0/1", 2024-09-11T14:36:16.084 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_filestore": "1/3", 2024-09-11T14:36:16.084 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_finisher": "1/1", 2024-09-11T14:36:16.084 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_fuse": "1/5", 2024-09-11T14:36:16.084 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_heartbeat_testing_span": "0", 2024-09-11T14:36:16.084 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_heartbeatmap": "1/5", 2024-09-11T14:36:16.084 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-11T14:36:16.084 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_javaclient": "1/5", 2024-09-11T14:36:16.084 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_journal": "1/3", 2024-09-11T14:36:16.084 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_journaler": "0/5", 2024-09-11T14:36:16.084 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_kstore": "1/5", 2024-09-11T14:36:16.084 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_lockdep": "0/1", 2024-09-11T14:36:16.084 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mclock": "1/5", 2024-09-11T14:36:16.084 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mds": "1/5", 2024-09-11T14:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mds_balancer": "1/5", 2024-09-11T14:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mds_locker": "1/5", 2024-09-11T14:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mds_log": "1/5", 2024-09-11T14:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mds_log_expire": "1/5", 2024-09-11T14:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mds_migrator": "1/5", 2024-09-11T14:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mds_quiesce": "3/5", 2024-09-11T14:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_memstore": "1/5", 2024-09-11T14:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mgr": "2/5", 2024-09-11T14:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mgrc": "1/5", 2024-09-11T14:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mon": "20/20", 2024-09-11T14:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_monc": "0/10", 2024-09-11T14:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_ms": "1/1", 2024-09-11T14:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_none": "0/5", 2024-09-11T14:36:16.086 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_objclass": "0/5", 2024-09-11T14:36:16.086 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_objectcacher": "0/5", 2024-09-11T14:36:16.086 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_objecter": "0/1", 2024-09-11T14:36:16.086 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_optracker": "0/5", 2024-09-11T14:36:16.086 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_osd": "1/5", 2024-09-11T14:36:16.086 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_paxos": "20/20", 2024-09-11T14:36:16.086 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_perfcounter": "1/5", 2024-09-11T14:36:16.086 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_prioritycache": "1/5", 2024-09-11T14:36:16.086 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rados": "0/5", 2024-09-11T14:36:16.086 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rbd": "0/5", 2024-09-11T14:36:16.086 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rbd_mirror": "0/5", 2024-09-11T14:36:16.086 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rbd_pwl": "0/5", 2024-09-11T14:36:16.086 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rbd_replay": "0/5", 2024-09-11T14:36:16.086 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_refs": "0/0", 2024-09-11T14:36:16.086 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_reserver": "1/1", 2024-09-11T14:36:16.087 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rgw": "1/5", 2024-09-11T14:36:16.087 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rgw_access": "1/5", 2024-09-11T14:36:16.087 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rgw_datacache": "1/5", 2024-09-11T14:36:16.087 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rgw_dbstore": "1/5", 2024-09-11T14:36:16.087 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rgw_flight": "1/5", 2024-09-11T14:36:16.087 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-11T14:36:16.087 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rgw_notification": "1/5", 2024-09-11T14:36:16.087 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rgw_sync": "1/5", 2024-09-11T14:36:16.087 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rocksdb": "4/5", 2024-09-11T14:36:16.087 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore": "0/5", 2024-09-11T14:36:16.087 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_backref": "0/5", 2024-09-11T14:36:16.087 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_cache": "0/5", 2024-09-11T14:36:16.087 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_cleaner": "0/5", 2024-09-11T14:36:16.087 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_device": "0/5", 2024-09-11T14:36:16.088 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_epm": "0/5", 2024-09-11T14:36:16.088 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-11T14:36:16.088 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_journal": "0/5", 2024-09-11T14:36:16.088 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_lba": "0/5", 2024-09-11T14:36:16.088 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_odata": "0/5", 2024-09-11T14:36:16.088 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_omap": "0/5", 2024-09-11T14:36:16.088 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_onode": "0/5", 2024-09-11T14:36:16.088 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_t": "0/5", 2024-09-11T14:36:16.088 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_tm": "0/5", 2024-09-11T14:36:16.088 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_striper": "0/1", 2024-09-11T14:36:16.088 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_test": "0/5", 2024-09-11T14:36:16.088 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_throttle": "1/1", 2024-09-11T14:36:16.088 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_timer": "0/1", 2024-09-11T14:36:16.088 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_tp": "0/5", 2024-09-11T14:36:16.088 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_trace": "1/5", 2024-09-11T14:36:16.089 INFO:teuthology.orchestra.run.smithi103.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-11T14:36:16.089 INFO:teuthology.orchestra.run.smithi103.stdout: "device_failure_prediction_mode": "none", 2024-09-11T14:36:16.089 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2024-09-11T14:36:16.089 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-11T14:36:16.089 INFO:teuthology.orchestra.run.smithi103.stdout: "err_to_graylog": "false", 2024-09-11T14:36:16.089 INFO:teuthology.orchestra.run.smithi103.stdout: "err_to_journald": "false", 2024-09-11T14:36:16.092 INFO:teuthology.orchestra.run.smithi103.stdout: "err_to_stderr": "true", 2024-09-11T14:36:16.092 INFO:teuthology.orchestra.run.smithi103.stdout: "err_to_syslog": "false", 2024-09-11T14:36:16.092 INFO:teuthology.orchestra.run.smithi103.stdout: "event_tracing": "false", 2024-09-11T14:36:16.092 INFO:teuthology.orchestra.run.smithi103.stdout: "exporter_addr": "0.0.0.0", 2024-09-11T14:36:16.092 INFO:teuthology.orchestra.run.smithi103.stdout: "exporter_cert_file": "", 2024-09-11T14:36:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "exporter_http_port": "9926", 2024-09-11T14:36:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "exporter_key_file": "", 2024-09-11T14:36:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "exporter_prio_limit": "5", 2024-09-11T14:36:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-11T14:36:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "exporter_sort_metrics": "true", 2024-09-11T14:36:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "exporter_stats_period": "5", 2024-09-11T14:36:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "fake_statfs_for_testing": "0", 2024-09-11T14:36:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "fatal_signal_handlers": "true", 2024-09-11T14:36:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "filer_max_purge_ops": "10", 2024-09-11T14:36:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "filer_max_truncate_ops": "128", 2024-09-11T14:36:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_apply_finisher_threads": "1", 2024-09-11T14:36:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_blackhole": "false", 2024-09-11T14:36:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_btrfs_clone_range": "true", 2024-09-11T14:36:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_btrfs_snap": "true", 2024-09-11T14:36:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_caller_concurrency": "10", 2024-09-11T14:36:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_collect_device_partition_information": "true", 2024-09-11T14:36:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_commit_timeout": "600.000000", 2024-09-11T14:36:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_debug_inject_read_err": "false", 2024-09-11T14:36:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_debug_omap_check": "false", 2024-09-11T14:36:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_debug_verify_split": "false", 2024-09-11T14:36:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_dump_file": "", 2024-09-11T14:36:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-11T14:36:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-11T14:36:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_fadvise": "true", 2024-09-11T14:36:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_fail_eio": "true", 2024-09-11T14:36:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_fd_cache_shards": "16", 2024-09-11T14:36:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_fd_cache_size": "128", 2024-09-11T14:36:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_fiemap": "false", 2024-09-11T14:36:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_fiemap_threshold": "4096", 2024-09-11T14:36:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-11T14:36:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-11T14:36:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_inject_stall": "0", 2024-09-11T14:36:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_journal_parallel": "false", 2024-09-11T14:36:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_journal_trailing": "false", 2024-09-11T14:36:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_journal_writeahead": "false", 2024-09-11T14:36:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_kill_at": "0", 2024-09-11T14:36:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-11T14:36:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-11T14:36:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-11T14:36:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-11T14:36:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-11T14:36:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_inline_xattrs": "0", 2024-09-11T14:36:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-11T14:36:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-11T14:36:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-11T14:36:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-11T14:36:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_xattr_value_size": "0", 2024-09-11T14:36:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-11T14:36:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-11T14:36:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-11T14:36:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_merge_threshold": "-10", 2024-09-11T14:36:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-11T14:36:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_odsync_write": "false", 2024-09-11T14:36:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_omap_backend": "rocksdb", 2024-09-11T14:36:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_omap_backend_path": "", 2024-09-11T14:36:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-11T14:36:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-11T14:36:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-11T14:36:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_op_thread_timeout": "60", 2024-09-11T14:36:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_op_threads": "2", 2024-09-11T14:36:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_punch_hole": "false", 2024-09-11T14:36:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-11T14:36:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-11T14:36:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-11T14:36:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-11T14:36:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-11T14:36:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-11T14:36:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-11T14:36:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-11T14:36:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-11T14:36:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_max_ops": "50", 2024-09-11T14:36:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-11T14:36:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_seek_data_hole": "false", 2024-09-11T14:36:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_sloppy_crc": "false", 2024-09-11T14:36:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-11T14:36:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_splice": "false", 2024-09-11T14:36:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_split_multiple": "2", 2024-09-11T14:36:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_split_rand_factor": "20", 2024-09-11T14:36:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_update_to": "1000", 2024-09-11T14:36:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-11T14:36:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-11T14:36:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-11T14:36:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-11T14:36:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-11T14:36:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-11T14:36:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_enable": "true", 2024-09-11T14:36:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-11T14:36:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-11T14:36:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-11T14:36:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-11T14:36:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-11T14:36:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-11T14:36:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_xfs_extsize": "false", 2024-09-11T14:36:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_zfs_snap": "false", 2024-09-11T14:36:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "fio_dir": "/tmp/fio", 2024-09-11T14:36:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "dc3d4a5d-c4e2-4e8c-9b89-77a2b35b981a", 2024-09-11T14:36:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_allow_other": "true", 2024-09-11T14:36:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_atomic_o_trunc": "true", 2024-09-11T14:36:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_big_writes": "true", 2024-09-11T14:36:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_debug": "false", 2024-09-11T14:36:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_default_permissions": "false", 2024-09-11T14:36:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_disable_pagecache": "false", 2024-09-11T14:36:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_max_write": "0", 2024-09-11T14:36:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_multithreaded": "true", 2024-09-11T14:36:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_require_active_mds": "true", 2024-09-11T14:36:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_set_user_groups": "true", 2024-09-11T14:36:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_splice_move": "true", 2024-09-11T14:36:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_splice_read": "true", 2024-09-11T14:36:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_splice_write": "true", 2024-09-11T14:36:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-11T14:36:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_use_invalidate_cb": "true", 2024-09-11T14:36:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-11T14:36:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "gss_target_name": "ceph", 2024-09-11T14:36:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_file": "", 2024-09-11T14:36:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_inject_failure": "0", 2024-09-11T14:36:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_interval": "5", 2024-09-11T14:36:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "host": "smithi103", 2024-09-11T14:36:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-11T14:36:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-11T14:36:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-11T14:36:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-11T14:36:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-11T14:36:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-11T14:36:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-11T14:36:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-11T14:36:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-11T14:36:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-11T14:36:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-11T14:36:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-11T14:36:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-11T14:36:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "inject_early_sigterm": "false", 2024-09-11T14:36:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "jaeger_agent_port": "6799", 2024-09-11T14:36:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "jaeger_tracing_enable": "false", 2024-09-11T14:36:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_aio": "true", 2024-09-11T14:36:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_align_min_size": "65536", 2024-09-11T14:36:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_block_align": "true", 2024-09-11T14:36:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_block_size": "4096", 2024-09-11T14:36:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_dio": "true", 2024-09-11T14:36:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_discard": "false", 2024-09-11T14:36:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_force_aio": "false", 2024-09-11T14:36:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_ignore_corruption": "false", 2024-09-11T14:36:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_max_write_bytes": "10485760", 2024-09-11T14:36:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_max_write_entries": "100", 2024-09-11T14:36:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_replay_from": "0", 2024-09-11T14:36:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-11T14:36:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-11T14:36:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-11T14:36:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-11T14:36:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_write_header_frequency": "0", 2024-09-11T14:36:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_zero_on_create": "false", 2024-09-11T14:36:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "journaler_prefetch_periods": "10", 2024-09-11T14:36:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "journaler_prezero_periods": "5", 2024-09-11T14:36:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "journaler_write_head_interval": "15", 2024-09-11T14:36:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "", 2024-09-11T14:36:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "keyfile": "", 2024-09-11T14:36:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-11T14:36:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_backend": "rocksdb", 2024-09-11T14:36:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_default_stripe_size": "65536", 2024-09-11T14:36:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_fsck_on_mount": "false", 2024-09-11T14:36:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-11T14:36:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_max_bytes": "67108864", 2024-09-11T14:36:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_max_ops": "512", 2024-09-11T14:36:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_nid_prealloc": "1024", 2024-09-11T14:36:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_onode_map_size": "1024", 2024-09-11T14:36:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-11T14:36:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_sync_submit_transaction": "false", 2024-09-11T14:36:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_sync_transaction": "false", 2024-09-11T14:36:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "librados_thread_count": "2", 2024-09-11T14:36:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "lockdep": "false", 2024-09-11T14:36:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "lockdep_force_backtrace": "false", 2024-09-11T14:36:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "log_coarse_timestamps": "true", 2024-09-11T14:36:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-11T14:36:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "log_flush_on_exit": "false", 2024-09-11T14:36:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "log_graylog_host": "127.0.0.1", 2024-09-11T14:36:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "log_graylog_port": "12201", 2024-09-11T14:36:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "log_max_new": "1000", 2024-09-11T14:36:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "log_max_recent": "10000", 2024-09-11T14:36:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "log_stderr_prefix": "", 2024-09-11T14:36:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "log_stop_at_utilization": "0.970000", 2024-09-11T14:36:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": "true", 2024-09-11T14:36:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_graylog": "false", 2024-09-11T14:36:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_journald": "false", 2024-09-11T14:36:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_stderr": "false", 2024-09-11T14:36:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_syslog": "false", 2024-09-11T14:36:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "max_rotating_auth_attempts": "10", 2024-09-11T14:36:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-11T14:36:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_action_on_write_error": "1", 2024-09-11T14:36:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_alternate_name_max": "8192", 2024-09-11T14:36:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_asio_thread_count": "2", 2024-09-11T14:36:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_export_pin": "true", 2024-09-11T14:36:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_fragment_dirs": "true", 2024-09-11T14:36:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-11T14:36:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_fragment_interval": "5", 2024-09-11T14:36:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-11T14:36:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-11T14:36:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_interval": "10", 2024-09-11T14:36:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_max": "-1", 2024-09-11T14:36:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_max_until": "-1", 2024-09-11T14:36:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_merge_size": "50", 2024-09-11T14:36:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_midchunk": "0.300000", 2024-09-11T14:36:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-11T14:36:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_min_start": "0.200000", 2024-09-11T14:36:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_minchunk": "0.001000", 2024-09-11T14:36:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_mode": "0", 2024-09-11T14:36:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_need_max": "1.200000", 2024-09-11T14:36:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_need_min": "0.800000", 2024-09-11T14:36:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_overload_epochs": "2", 2024-09-11T14:36:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-11T14:36:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-11T14:36:16.108 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_split_bits": "3", 2024-09-11T14:36:16.108 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-11T14:36:16.108 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_split_size": "10000", 2024-09-11T14:36:16.108 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-11T14:36:16.108 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_target_decay": "10.000000", 2024-09-11T14:36:16.108 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-11T14:36:16.108 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_beacon_grace": "15.000000", 2024-09-11T14:36:16.108 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_beacon_interval": "4.000000", 2024-09-11T14:36:16.108 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-11T14:36:16.108 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-11T14:36:16.108 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_mid": "0.700000", 2024-09-11T14:36:16.108 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-11T14:36:16.108 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_quiesce_delay": "0", 2024-09-11T14:36:16.109 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-11T14:36:16.109 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-11T14:36:16.109 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-11T14:36:16.109 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_release_free_interval": "10", 2024-09-11T14:36:16.109 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_reservation": "0.050000", 2024-09-11T14:36:16.109 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-11T14:36:16.109 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_trim_interval": "1", 2024-09-11T14:36:16.109 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_trim_threshold": "262144", 2024-09-11T14:36:16.109 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-11T14:36:16.109 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-11T14:36:16.109 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-11T14:36:16.109 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_client_prealloc_inos": "1000", 2024-09-11T14:36:16.109 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-11T14:36:16.110 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_connect_bootstrapping": "false", 2024-09-11T14:36:16.110 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_damage_table_max_entries": "10000", 2024-09-11T14:36:16.110 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-11T14:36:16.110 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_debug_auth_pins": "false", 2024-09-11T14:36:16.110 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_debug_frag": "false", 2024-09-11T14:36:16.110 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_debug_scatterstat": "false", 2024-09-11T14:36:16.110 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_debug_subtrees": "false", 2024-09-11T14:36:16.110 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_decay_halflife": "5.000000", 2024-09-11T14:36:16.110 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_default_dir_hash": "2", 2024-09-11T14:36:16.110 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_defer_session_stale": "true", 2024-09-11T14:36:16.110 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_deny_all_reconnect": "false", 2024-09-11T14:36:16.110 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_dir_keys_per_op": "16384", 2024-09-11T14:36:16.110 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_dir_max_commit_size": "10", 2024-09-11T14:36:16.110 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_dir_max_entries": "0", 2024-09-11T14:36:16.111 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_dir_prefetch": "true", 2024-09-11T14:36:16.111 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-11T14:36:16.111 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-11T14:36:16.111 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_dump_cache_on_map": "false", 2024-09-11T14:36:16.111 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-11T14:36:16.111 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-11T14:36:16.111 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_early_reply": "true", 2024-09-11T14:36:16.111 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_enable_op_tracker": "true", 2024-09-11T14:36:16.111 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_enforce_unique_name": "true", 2024-09-11T14:36:16.111 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-11T14:36:16.111 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-11T14:36:16.111 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_export_ephemeral_random": "true", 2024-09-11T14:36:16.111 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-11T14:36:16.112 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-11T14:36:16.112 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-11T14:36:16.112 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-11T14:36:16.112 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-11T14:36:16.112 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-11T14:36:16.112 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-11T14:36:16.112 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-11T14:36:16.112 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_health_summarize_threshold": "10", 2024-09-11T14:36:16.112 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-11T14:36:16.112 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-11T14:36:16.112 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_inject_health_dummy": "false", 2024-09-11T14:36:16.112 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-11T14:36:16.112 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_inject_migrator_session_race": "false", 2024-09-11T14:36:16.112 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-11T14:36:16.113 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-11T14:36:16.113 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-11T14:36:16.113 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_join_fs": "", 2024-09-11T14:36:16.113 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_journal_format": "1", 2024-09-11T14:36:16.113 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-11T14:36:16.113 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_create_at": "0", 2024-09-11T14:36:16.113 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_dirfrag_at": "0", 2024-09-11T14:36:16.113 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_export_at": "0", 2024-09-11T14:36:16.113 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_import_at": "0", 2024-09-11T14:36:16.113 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_journal_at": "0", 2024-09-11T14:36:16.113 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_journal_expire_at": "0", 2024-09-11T14:36:16.113 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_journal_replay_at": "0", 2024-09-11T14:36:16.113 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_link_at": "0", 2024-09-11T14:36:16.114 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_mdstable_at": "0", 2024-09-11T14:36:16.114 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_openc_at": "0", 2024-09-11T14:36:16.114 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_rename_at": "0", 2024-09-11T14:36:16.114 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_shutdown_at": "0", 2024-09-11T14:36:16.114 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_event_large_threshold": "524288", 2024-09-11T14:36:16.114 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_events_per_segment": "1024", 2024-09-11T14:36:16.114 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-11T14:36:16.114 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_max_events": "-1", 2024-09-11T14:36:16.114 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_max_segments": "128", 2024-09-11T14:36:16.114 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_pause": "false", 2024-09-11T14:36:16.114 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_segment_size": "0", 2024-09-11T14:36:16.114 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-11T14:36:16.114 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-11T14:36:16.114 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-11T14:36:16.115 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_trim_threshold": "128", 2024-09-11T14:36:16.115 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-11T14:36:16.115 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_warn_factor": "2.000000", 2024-09-11T14:36:16.115 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_caps_per_client": "1048576", 2024-09-11T14:36:16.115 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_completed_flushes": "100000", 2024-09-11T14:36:16.115 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_completed_requests": "100000", 2024-09-11T14:36:16.115 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_export_size": "20971520", 2024-09-11T14:36:16.115 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_file_recover": "32", 2024-09-11T14:36:16.115 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_purge_files": "64", 2024-09-11T14:36:16.115 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_purge_ops": "8192", 2024-09-11T14:36:16.115 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-11T14:36:16.115 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-11T14:36:16.115 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_snaps_per_dir": "100", 2024-09-11T14:36:16.115 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_metrics_update_interval": "2", 2024-09-11T14:36:16.116 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_min_caps_per_client": "100", 2024-09-11T14:36:16.116 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_min_caps_working_set": "10000", 2024-09-11T14:36:16.116 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-11T14:36:16.116 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_numa_node": "-1", 2024-09-11T14:36:16.116 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-11T14:36:16.116 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_op_complaint_time": "30.000000", 2024-09-11T14:36:16.116 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_op_history_duration": "600", 2024-09-11T14:36:16.116 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_op_history_size": "20", 2024-09-11T14:36:16.116 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_op_history_slow_op_size": "20", 2024-09-11T14:36:16.116 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-11T14:36:16.116 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_op_log_threshold": "5", 2024-09-11T14:36:16.116 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_ping_grace": "15", 2024-09-11T14:36:16.116 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_ping_interval": "5", 2024-09-11T14:36:16.116 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-11T14:36:16.117 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-11T14:36:16.117 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_recall_max_caps": "30000", 2024-09-11T14:36:16.117 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-11T14:36:16.117 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-11T14:36:16.117 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-11T14:36:16.117 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_recall_warning_threshold": "262144", 2024-09-11T14:36:16.117 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-11T14:36:16.117 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_replay_interval": "1.000000", 2024-09-11T14:36:16.117 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-11T14:36:16.117 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-11T14:36:16.117 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_root_ino_gid": "0", 2024-09-11T14:36:16.117 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_root_ino_uid": "0", 2024-09-11T14:36:16.117 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-11T14:36:16.118 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_scrub_stats_review_period": "1", 2024-09-11T14:36:16.118 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-11T14:36:16.118 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-11T14:36:16.118 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-11T14:36:16.118 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-11T14:36:16.118 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-11T14:36:16.118 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-11T14:36:16.118 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-11T14:36:16.118 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-11T14:36:16.118 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-11T14:36:16.118 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-11T14:36:16.118 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-11T14:36:16.118 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_shutdown_check": "0", 2024-09-11T14:36:16.118 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_skip_ino": "0", 2024-09-11T14:36:16.118 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-11T14:36:16.119 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_snap_max_uid": "4294967294", 2024-09-11T14:36:16.119 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_snap_min_uid": "0", 2024-09-11T14:36:16.119 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_snap_rstat": "false", 2024-09-11T14:36:16.119 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_standby_replay_damaged": "false", 2024-09-11T14:36:16.119 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_symlink_recovery": "true", 2024-09-11T14:36:16.119 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-11T14:36:16.119 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_thrash_exports": "0", 2024-09-11T14:36:16.119 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_thrash_fragments": "0", 2024-09-11T14:36:16.119 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_tick_interval": "5.000000", 2024-09-11T14:36:16.119 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_valgrind_exit": "false", 2024-09-11T14:36:16.119 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_verify_backtrace": "1", 2024-09-11T14:36:16.119 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_verify_scatter": "false", 2024-09-11T14:36:16.119 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-11T14:36:16.119 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_wipe_sessions": "false", 2024-09-11T14:36:16.120 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool_debug": "false", 2024-09-11T14:36:16.120 INFO:teuthology.orchestra.run.smithi103.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-11T14:36:16.120 INFO:teuthology.orchestra.run.smithi103.stdout: "memstore_device_bytes": "1073741824", 2024-09-11T14:36:16.120 INFO:teuthology.orchestra.run.smithi103.stdout: "memstore_page_set": "false", 2024-09-11T14:36:16.120 INFO:teuthology.orchestra.run.smithi103.stdout: "memstore_page_size": "65536", 2024-09-11T14:36:16.120 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_client_bytes": "134217728", 2024-09-11T14:36:16.120 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_client_messages": "512", 2024-09-11T14:36:16.120 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-11T14:36:16.120 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-11T14:36:16.120 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-11T14:36:16.120 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-11T14:36:16.120 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_disabled_modules": "", 2024-09-11T14:36:16.120 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_enable_op_tracker": "true", 2024-09-11T14:36:16.120 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-11T14:36:16.121 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_max_pg_creating": "1024", 2024-09-11T14:36:16.121 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_max_pg_num_change": "128", 2024-09-11T14:36:16.121 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_mds_bytes": "134217728", 2024-09-11T14:36:16.121 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_mds_messages": "128", 2024-09-11T14:36:16.121 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-11T14:36:16.121 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_mon_bytes": "134217728", 2024-09-11T14:36:16.121 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_mon_messages": "128", 2024-09-11T14:36:16.121 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-11T14:36:16.121 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-11T14:36:16.121 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_op_history_duration": "600", 2024-09-11T14:36:16.121 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_op_history_size": "20", 2024-09-11T14:36:16.121 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-11T14:36:16.121 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-11T14:36:16.122 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_op_log_threshold": "5", 2024-09-11T14:36:16.122 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_osd_bytes": "536870912", 2024-09-11T14:36:16.122 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_osd_messages": "8192", 2024-09-11T14:36:16.122 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_pool": "true", 2024-09-11T14:36:16.122 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-11T14:36:16.122 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_standby_modules": "true", 2024-09-11T14:36:16.122 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_stats_period": "5", 2024-09-11T14:36:16.122 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_stats_threshold": "5", 2024-09-11T14:36:16.122 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_tick_period": "2", 2024-09-11T14:36:16.122 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-11T14:36:16.122 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-11T14:36:16.122 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_allow_pool_delete": "true", 2024-09-11T14:36:16.122 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_allow_pool_size_one": "true", 2024-09-11T14:36:16.122 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_auth_validate_all_caps": "true", 2024-09-11T14:36:16.123 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-11T14:36:16.123 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-11T14:36:16.123 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_bytes": "104857600", 2024-09-11T14:36:16.123 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_directed_command_retry": "2", 2024-09-11T14:36:16.123 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-11T14:36:16.123 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-11T14:36:16.123 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-11T14:36:16.123 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-11T14:36:16.123 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_hunt_parallel": "3", 2024-09-11T14:36:16.123 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_log_interval": "1.000000", 2024-09-11T14:36:16.123 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-11T14:36:16.123 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_ping_interval": "10.000000", 2024-09-11T14:36:16.123 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-11T14:36:16.123 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_target_rank": "-1", 2024-09-11T14:36:16.124 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-11T14:36:16.124 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-11T14:36:16.124 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-11T14:36:16.124 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_level": "debug", 2024-09-11T14:36:16.124 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_to_file": "true", 2024-09-11T14:36:16.124 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-11T14:36:16.124 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-11T14:36:16.124 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-11T14:36:16.124 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_to_journald": "false", 2024-09-11T14:36:16.124 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-11T14:36:16.124 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-11T14:36:16.124 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-11T14:36:16.124 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_compact_on_bootstrap": "false", 2024-09-11T14:36:16.124 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_compact_on_start": "false", 2024-09-11T14:36:16.125 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_compact_on_trim": "true", 2024-09-11T14:36:16.125 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-11T14:36:16.125 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-11T14:36:16.125 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-11T14:36:16.125 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cpu_threads": "4", 2024-09-11T14:36:16.125 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_crush_min_required_version": "hammer", 2024-09-11T14:36:16.125 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_daemon_bytes": "419430400", 2024-09-11T14:36:16.125 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-11T14:36:16.125 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_data_avail_crit": "5", 2024-09-11T14:36:16.125 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_data_avail_warn": "5", 2024-09-11T14:36:16.126 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_data_size_warn": "16106127360", 2024-09-11T14:36:16.126 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-11T14:36:16.126 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-11T14:36:16.126 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_dump_json": "false", 2024-09-11T14:36:16.126 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-11T14:36:16.126 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_dump_transactions": "false", 2024-09-11T14:36:16.126 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_extra_checks": "false", 2024-09-11T14:36:16.126 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-11T14:36:16.126 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-11T14:36:16.126 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_no_require_reef": "false", 2024-09-11T14:36:16.126 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_no_require_squid": "false", 2024-09-11T14:36:16.126 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-11T14:36:16.126 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-11T14:36:16.126 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-11T14:36:16.126 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_down_mkfs_grace": "120", 2024-09-11T14:36:16.127 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_down_uptime_grace": "60", 2024-09-11T14:36:16.127 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_election_default_strategy": "1", 2024-09-11T14:36:16.127 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_election_timeout": "5.000000", 2024-09-11T14:36:16.127 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-11T14:36:16.127 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_elector_ping_divisor": "2", 2024-09-11T14:36:16.127 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-11T14:36:16.127 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_enable_op_tracker": "true", 2024-09-11T14:36:16.127 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_fake_pool_delete": "false", 2024-09-11T14:36:16.127 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_force_quorum_join": "false", 2024-09-11T14:36:16.127 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-11T14:36:16.127 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_globalid_prealloc": "10000", 2024-09-11T14:36:16.127 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_health_detail_to_clog": "false", 2024-09-11T14:36:16.127 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_health_log_update_period": "5", 2024-09-11T14:36:16.127 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_health_max_detail": "50", 2024-09-11T14:36:16.128 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_health_to_clog": "true", 2024-09-11T14:36:16.128 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_health_to_clog_interval": "600", 2024-09-11T14:36:16.128 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-11T14:36:16.128 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_host": "172.21.15.103", 2024-09-11T14:36:16.128 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_host_override": "", 2024-09-11T14:36:16.128 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_initial_members": "", 2024-09-11T14:36:16.128 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-11T14:36:16.128 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-11T14:36:16.128 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-11T14:36:16.128 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-11T14:36:16.128 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-11T14:36:16.128 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_lease": "5.000000", 2024-09-11T14:36:16.128 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-11T14:36:16.128 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-11T14:36:16.129 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_log_full_interval": "50", 2024-09-11T14:36:16.129 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_log_max": "10000", 2024-09-11T14:36:16.129 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_log_max_summary": "50", 2024-09-11T14:36:16.129 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-11T14:36:16.129 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_max_log_epochs": "500", 2024-09-11T14:36:16.129 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-11T14:36:16.129 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-11T14:36:16.129 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-11T14:36:16.129 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_max_osd": "10000", 2024-09-11T14:36:16.129 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_max_pg_per_osd": "10000", 2024-09-11T14:36:16.129 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_max_pool_pg_num": "65536", 2024-09-11T14:36:16.129 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-11T14:36:16.129 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-11T14:36:16.129 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_mds_force_trim_to": "0", 2024-09-11T14:36:16.130 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_mds_skip_sanity": "false", 2024-09-11T14:36:16.130 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_memory_autotune": "true", 2024-09-11T14:36:16.130 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_memory_target": "2147483648", 2024-09-11T14:36:16.130 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_mgr_beacon_grace": "30", 2024-09-11T14:36:16.130 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-11T14:36:16.130 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_mgr_digest_period": "5", 2024-09-11T14:36:16.130 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_mgr_inactive_grace": "60", 2024-09-11T14:36:16.130 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-11T14:36:16.130 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-11T14:36:16.130 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_min_osdmap_epochs": "50", 2024-09-11T14:36:16.130 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-11T14:36:16.130 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-11T14:36:16.130 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_op_complaint_time": "30", 2024-09-11T14:36:16.131 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_op_history_duration": "600", 2024-09-11T14:36:16.131 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_op_history_size": "20", 2024-09-11T14:36:16.131 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_op_history_slow_op_size": "20", 2024-09-11T14:36:16.131 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-11T14:36:16.131 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_op_log_threshold": "5", 2024-09-11T14:36:16.131 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-11T14:36:16.131 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-11T14:36:16.131 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-11T14:36:16.131 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_auto_mark_in": "false", 2024-09-11T14:36:16.131 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-11T14:36:16.131 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-11T14:36:16.131 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-11T14:36:16.131 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_cache_size": "500", 2024-09-11T14:36:16.131 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-11T14:36:16.132 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-11T14:36:16.132 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-11T14:36:16.132 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_down_out_interval": "600", 2024-09-11T14:36:16.132 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-11T14:36:16.132 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-11T14:36:16.132 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_force_trim_to": "0", 2024-09-11T14:36:16.132 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-11T14:36:16.132 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-11T14:36:16.132 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-11T14:36:16.132 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-11T14:36:16.132 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-11T14:36:16.132 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-11T14:36:16.132 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-11T14:36:16.132 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_min_down_reporters": "2", 2024-09-11T14:36:16.133 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-11T14:36:16.133 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-11T14:36:16.133 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-11T14:36:16.133 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-11T14:36:16.133 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-11T14:36:16.133 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-11T14:36:16.133 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_report_timeout": "900", 2024-09-11T14:36:16.133 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-11T14:36:16.133 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-11T14:36:16.133 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-11T14:36:16.133 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-11T14:36:16.133 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-11T14:36:16.133 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osdmap_full_prune_interval": "2", 2024-09-11T14:36:16.134 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osdmap_full_prune_min": "15", 2024-09-11T14:36:16.134 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osdmap_full_prune_txsize": "2", 2024-09-11T14:36:16.134 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-11T14:36:16.134 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_pg_stuck_threshold": "60", 2024-09-11T14:36:16.134 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-11T14:36:16.134 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-11T14:36:16.134 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-11T14:36:16.134 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-11T14:36:16.134 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-11T14:36:16.134 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-11T14:36:16.134 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_probe_timeout": "2.000000", 2024-09-11T14:36:16.134 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_reweight_max_change": "0.050000", 2024-09-11T14:36:16.134 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_reweight_max_osds": "4", 2024-09-11T14:36:16.134 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-11T14:36:16.134 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-11T14:36:16.135 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-11T14:36:16.135 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-11T14:36:16.135 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-11T14:36:16.135 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_scrub_interval": "86400", 2024-09-11T14:36:16.135 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_scrub_max_keys": "100", 2024-09-11T14:36:16.135 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_scrub_timeout": "300", 2024-09-11T14:36:16.135 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_session_timeout": "300", 2024-09-11T14:36:16.135 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_smart_report_timeout": "5", 2024-09-11T14:36:16.135 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_stat_smooth_intervals": "6", 2024-09-11T14:36:16.135 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-11T14:36:16.135 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_stretch_pool_min_size": "2", 2024-09-11T14:36:16.135 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_stretch_pool_size": "4", 2024-09-11T14:36:16.135 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-11T14:36:16.135 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-11T14:36:16.136 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_sync_debug": "false", 2024-09-11T14:36:16.136 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-11T14:36:16.136 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-11T14:36:16.136 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_sync_provider_kill_at": "0", 2024-09-11T14:36:16.136 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_sync_requester_kill_at": "0", 2024-09-11T14:36:16.136 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_sync_timeout": "60.000000", 2024-09-11T14:36:16.136 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_target_pg_per_osd": "100", 2024-09-11T14:36:16.136 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_tick_interval": "5", 2024-09-11T14:36:16.136 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_timecheck_interval": "300.000000", 2024-09-11T14:36:16.136 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-11T14:36:16.136 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_use_min_delay_socket": "false", 2024-09-11T14:36:16.136 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_older_version_delay": "604800", 2024-09-11T14:36:16.136 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-11T14:36:16.137 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-11T14:36:16.137 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-11T14:36:16.137 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-11T14:36:16.137 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-11T14:36:16.137 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-11T14:36:16.137 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-11T14:36:16.137 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_misplaced": "false", 2024-09-11T14:36:16.137 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-11T14:36:16.137 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_older_version": "true", 2024-09-11T14:36:16.137 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-11T14:36:16.137 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-11T14:36:16.137 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-11T14:36:16.137 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-11T14:36:16.138 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-11T14:36:16.138 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-11T14:36:16.138 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-11T14:36:16.138 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-11T14:36:16.138 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-11T14:36:16.138 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": "", 2024-09-11T14:36:16.138 INFO:teuthology.orchestra.run.smithi103.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-11T14:36:16.138 INFO:teuthology.orchestra.run.smithi103.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-11T14:36:16.138 INFO:teuthology.orchestra.run.smithi103.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-11T14:36:16.138 INFO:teuthology.orchestra.run.smithi103.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-11T14:36:16.138 INFO:teuthology.orchestra.run.smithi103.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-11T14:36:16.138 INFO:teuthology.orchestra.run.smithi103.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-11T14:36:16.138 INFO:teuthology.orchestra.run.smithi103.stdout: "motr_tracing_enabled": "false", 2024-09-11T14:36:16.138 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_op_threads": "3", 2024-09-11T14:36:16.139 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-11T14:36:16.139 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_cm": "false", 2024-09-11T14:36:16.139 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_device_name": "", 2024-09-11T14:36:16.139 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_dscp": "96", 2024-09-11T14:36:16.139 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-11T14:36:16.139 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-11T14:36:16.139 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_local_gid": "", 2024-09-11T14:36:16.139 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-11T14:36:16.139 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_port_num": "1", 2024-09-11T14:36:16.139 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-11T14:36:16.139 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-11T14:36:16.139 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-11T14:36:16.139 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-11T14:36:16.140 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_sl": "3", 2024-09-11T14:36:16.140 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_support_srq": "true", 2024-09-11T14:36:16.140 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_type": "ib", 2024-09-11T14:36:16.140 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_reap_threshold": "5", 2024-09-11T14:36:16.140 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_before_connect": "false", 2024-09-11T14:36:16.140 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_ipv4": "true", 2024-09-11T14:36:16.140 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_ipv6": "false", 2024-09-11T14:36:16.140 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_msgr1": "true", 2024-09-11T14:36:16.140 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_msgr2": "true", 2024-09-11T14:36:16.140 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_port_max": "7568", 2024-09-11T14:36:16.140 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_port_min": "6800", 2024-09-11T14:36:16.140 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-11T14:36:16.140 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_retry_count": "3", 2024-09-11T14:36:16.140 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_retry_delay": "5", 2024-09-11T14:36:16.141 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_blackhole_client": "false", 2024-09-11T14:36:16.141 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_blackhole_mds": "false", 2024-09-11T14:36:16.141 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_blackhole_mgr": "false", 2024-09-11T14:36:16.141 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_blackhole_mon": "false", 2024-09-11T14:36:16.141 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_blackhole_osd": "false", 2024-09-11T14:36:16.141 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_client_mode": "crc", 2024-09-11T14:36:16.141 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-11T14:36:16.141 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_cluster_mode": "crc", 2024-09-11T14:36:16.141 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_cluster_type": "", 2024-09-11T14:36:16.141 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_compress_secure": "false", 2024-09-11T14:36:16.141 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_connection_idle_timeout": "900", 2024-09-11T14:36:16.141 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_connection_ready_timeout": "10", 2024-09-11T14:36:16.141 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_crc_data": "true", 2024-09-11T14:36:16.142 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_crc_header": "true", 2024-09-11T14:36:16.142 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_die_on_bad_msg": "false", 2024-09-11T14:36:16.142 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_die_on_bug": "true", 2024-09-11T14:36:16.142 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_die_on_old_message": "true", 2024-09-11T14:36:16.142 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_die_on_skipped_message": "false", 2024-09-11T14:36:16.142 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-11T14:36:16.142 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-11T14:36:16.142 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_coremask": "0xF", 2024-09-11T14:36:16.142 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-11T14:36:16.142 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-11T14:36:16.142 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_enable_tso": "true", 2024-09-11T14:36:16.142 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-11T14:36:16.142 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-11T14:36:16.142 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_hugepages": "", 2024-09-11T14:36:16.143 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-11T14:36:16.143 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-11T14:36:16.143 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_lro": "true", 2024-09-11T14:36:16.143 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_memory_channel": "4", 2024-09-11T14:36:16.143 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-11T14:36:16.143 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_pmd": "", 2024-09-11T14:36:16.143 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_port_id": "0", 2024-09-11T14:36:16.143 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-11T14:36:16.143 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-11T14:36:16.143 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dump_on_send": "false", 2024-09-11T14:36:16.143 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_initial_backoff": "0.200000", 2024-09-11T14:36:16.143 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_inject_delay_max": "1.000000", 2024-09-11T14:36:16.143 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-11T14:36:16.143 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_inject_delay_type": "", 2024-09-11T14:36:16.144 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-11T14:36:16.144 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_inject_network_congestion": "0", 2024-09-11T14:36:16.144 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_inject_socket_failures": "0", 2024-09-11T14:36:16.144 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_learn_addr_from_peer": "true", 2024-09-11T14:36:16.144 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_max_accept_failures": "4", 2024-09-11T14:36:16.144 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_max_backoff": "15.000000", 2024-09-11T14:36:16.144 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_mon_client_mode": "crc", 2024-09-11T14:36:16.144 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_mon_cluster_mode": "crc", 2024-09-11T14:36:16.144 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_mon_service_mode": "crc", 2024-09-11T14:36:16.144 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_osd_compress_min_size": "1024", 2024-09-11T14:36:16.144 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_osd_compress_mode": "none", 2024-09-11T14:36:16.144 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-11T14:36:16.144 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-11T14:36:16.144 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_pq_min_cost": "65536", 2024-09-11T14:36:16.145 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_public_type": "", 2024-09-11T14:36:16.145 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_service_mode": "crc", 2024-09-11T14:36:16.145 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_tcp_listen_backlog": "512", 2024-09-11T14:36:16.145 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_tcp_nodelay": "true", 2024-09-11T14:36:16.145 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-11T14:36:16.145 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_tcp_rcvbuf": "0", 2024-09-11T14:36:16.145 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-11T14:36:16.145 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_type": "async+posix", 2024-09-11T14:36:16.145 INFO:teuthology.orchestra.run.smithi103.stdout: "no_config_file": "false", 2024-09-11T14:36:16.145 INFO:teuthology.orchestra.run.smithi103.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-11T14:36:16.145 INFO:teuthology.orchestra.run.smithi103.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-11T14:36:16.145 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter_completion_locks_per_session": "32", 2024-09-11T14:36:16.145 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-11T14:36:16.145 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-11T14:36:16.146 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter_inflight_ops": "1024", 2024-09-11T14:36:16.146 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-11T14:36:16.146 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-11T14:36:16.146 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter_tick_interval": "5.000000", 2024-09-11T14:36:16.146 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter_timeout": "10.000000", 2024-09-11T14:36:16.146 INFO:teuthology.orchestra.run.smithi103.stdout: "objectstore_blackhole": "false", 2024-09-11T14:36:16.146 INFO:teuthology.orchestra.run.smithi103.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-11T14:36:16.146 INFO:teuthology.orchestra.run.smithi103.stdout: "openssl_engine_opts": "", 2024-09-11T14:36:16.146 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_agent_delay_time": "5.000000", 2024-09-11T14:36:16.146 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_agent_hist_halflife": "1000", 2024-09-11T14:36:16.146 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_agent_max_low_ops": "2", 2024-09-11T14:36:16.146 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_agent_max_ops": "4", 2024-09-11T14:36:16.146 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-11T14:36:16.146 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-11T14:36:16.147 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_agent_slop": "0.020000", 2024-09-11T14:36:16.147 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-11T14:36:16.147 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-11T14:36:16.147 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_asio_thread_count": "2", 2024-09-11T14:36:16.147 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_async_recovery_min_cost": "100", 2024-09-11T14:36:16.147 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-11T14:36:16.147 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-11T14:36:16.147 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_backfill_scan_max": "512", 2024-09-11T14:36:16.147 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_backfill_scan_min": "64", 2024-09-11T14:36:16.147 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_backoff_on_degraded": "false", 2024-09-11T14:36:16.147 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_backoff_on_peering": "false", 2024-09-11T14:36:16.147 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_backoff_on_unfound": "true", 2024-09-11T14:36:16.147 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_beacon_report_interval": "300", 2024-09-11T14:36:16.147 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bench_duration": "30", 2024-09-11T14:36:16.148 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-11T14:36:16.148 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bench_max_block_size": "67108864", 2024-09-11T14:36:16.148 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-11T14:36:16.148 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_blkin_trace_all": "false", 2024-09-11T14:36:16.148 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-11T14:36:16.148 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-11T14:36:16.148 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-11T14:36:16.148 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-11T14:36:16.148 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_check_for_log_corruption": "false", 2024-09-11T14:36:16.148 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-11T14:36:16.148 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-11T14:36:16.148 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-11T14:36:16.148 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-11T14:36:16.148 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_class_update_on_start": "true", 2024-09-11T14:36:16.149 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_client_message_cap": "256", 2024-09-11T14:36:16.149 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_client_message_size_cap": "524288000", 2024-09-11T14:36:16.149 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_client_op_priority": "63", 2024-09-11T14:36:16.149 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_client_watch_timeout": "30", 2024-09-11T14:36:16.149 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_command_max_records": "256", 2024-09-11T14:36:16.149 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_compact_on_start": "false", 2024-09-11T14:36:16.149 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-11T14:36:16.149 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-11T14:36:16.149 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-11T14:36:16.149 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_crush_update_on_start": "true", 2024-09-11T14:36:16.149 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_crush_update_weight_set": "true", 2024-09-11T14:36:16.149 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-11T14:36:16.149 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-11T14:36:16.149 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-11T14:36:16.150 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-11T14:36:16.150 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-11T14:36:16.150 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_feed_pullee": "-1", 2024-09-11T14:36:16.150 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-11T14:36:16.150 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-11T14:36:16.150 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-11T14:36:16.150 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_misdirected_ops": "false", 2024-09-11T14:36:16.150 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_no_acting_change": "false", 2024-09-11T14:36:16.150 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_no_purge_strays": "false", 2024-09-11T14:36:16.150 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_op_order": "false", 2024-09-11T14:36:16.150 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-11T14:36:16.150 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-11T14:36:16.150 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-11T14:36:16.150 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-11T14:36:16.150 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_shutdown": "false", 2024-09-11T14:36:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-11T14:36:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-11T14:36:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_trim_objects": "false", 2024-09-11T14:36:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-11T14:36:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-11T14:36:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_verify_snaps": "false", 2024-09-11T14:36:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-11T14:36:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-11T14:36:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_deep_scrub_keys": "1024", 2024-09-11T14:36:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-11T14:36:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-11T14:36:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-11T14:36:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_deep_scrub_stride": "524288", 2024-09-11T14:36:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-11T14:36:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-11T14:36:16.152 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_default_notify_timeout": "30", 2024-09-11T14:36:16.152 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_delete_sleep": "0.000000", 2024-09-11T14:36:16.152 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-11T14:36:16.152 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-11T14:36:16.152 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-11T14:36:16.152 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_discard_disconnected_ops": "true", 2024-09-11T14:36:16.152 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_ec_partial_reads": "true", 2024-09-11T14:36:16.152 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_enable_op_tracker": "true", 2024-09-11T14:36:16.152 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-11T14:36:16.152 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-11T14:36:16.152 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-11T14:36:16.152 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-11T14:36:16.152 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_fast_info": "true", 2024-09-11T14:36:16.153 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_fast_shutdown": "true", 2024-09-11T14:36:16.153 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-11T14:36:16.153 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-11T14:36:16.153 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-11T14:36:16.153 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-11T14:36:16.153 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-11T14:36:16.153 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_function_tracing": "false", 2024-09-11T14:36:16.153 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_heartbeat_grace": "20", 2024-09-11T14:36:16.153 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_heartbeat_interval": "6", 2024-09-11T14:36:16.153 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-11T14:36:16.153 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_heartbeat_min_peers": "10", 2024-09-11T14:36:16.153 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_heartbeat_min_size": "2000", 2024-09-11T14:36:16.153 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_heartbeat_stale": "600", 2024-09-11T14:36:16.153 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-11T14:36:16.153 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_hit_set_max_size": "100000", 2024-09-11T14:36:16.154 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_hit_set_min_size": "1000", 2024-09-11T14:36:16.154 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-11T14:36:16.154 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-11T14:36:16.154 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-11T14:36:16.154 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-11T14:36:16.154 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-11T14:36:16.154 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-11T14:36:16.154 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_journal_size": "5120", 2024-09-11T14:36:16.154 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_kill_backfill_at": "0", 2024-09-11T14:36:16.154 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-11T14:36:16.154 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_map_cache_size": "50", 2024-09-11T14:36:16.154 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_map_dedup": "true", 2024-09-11T14:36:16.154 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_map_message_max": "40", 2024-09-11T14:36:16.154 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-11T14:36:16.154 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_map_share_max_epochs": "40", 2024-09-11T14:36:16.155 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_attr_name_len": "100", 2024-09-11T14:36:16.155 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_attr_size": "0", 2024-09-11T14:36:16.155 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_backfills": "1", 2024-09-11T14:36:16.155 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_markdown_count": "5", 2024-09-11T14:36:16.155 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_markdown_period": "600", 2024-09-11T14:36:16.155 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_object_name_len": "2048", 2024-09-11T14:36:16.155 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_object_namespace_len": "256", 2024-09-11T14:36:16.155 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_object_size": "134217728", 2024-09-11T14:36:16.155 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-11T14:36:16.155 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-11T14:36:16.155 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_pg_blocked_by": "16", 2024-09-11T14:36:16.155 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_pg_log_entries": "10000", 2024-09-11T14:36:16.155 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-11T14:36:16.155 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_pgls": "1024", 2024-09-11T14:36:16.156 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_push_cost": "8388608", 2024-09-11T14:36:16.156 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_push_objects": "10", 2024-09-11T14:36:16.156 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_scrubs": "3", 2024-09-11T14:36:16.156 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-11T14:36:16.156 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_trimming_pgs": "2", 2024-09-11T14:36:16.156 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_write_op_reply_len": "64", 2024-09-11T14:36:16.156 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_write_size": "90", 2024-09-11T14:36:16.156 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-11T14:36:16.156 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-11T14:36:16.156 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-11T14:36:16.156 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-11T14:36:16.156 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-11T14:36:16.156 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-11T14:36:16.156 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-11T14:36:16.157 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-11T14:36:16.157 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_profile": "balanced", 2024-09-11T14:36:16.157 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-11T14:36:16.157 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-11T14:36:16.157 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-11T14:36:16.157 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-11T14:36:16.157 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-11T14:36:16.157 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-11T14:36:16.157 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-11T14:36:16.157 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-11T14:36:16.157 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-11T14:36:16.158 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-11T14:36:16.158 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-11T14:36:16.158 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_memory_base": "805306368", 2024-09-11T14:36:16.158 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_memory_cache_min": "134217728", 2024-09-11T14:36:16.158 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-11T14:36:16.158 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-11T14:36:16.158 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_memory_target": "4294967296", 2024-09-11T14:36:16.158 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_memory_target_autotune": "false", 2024-09-11T14:36:16.158 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-11T14:36:16.158 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_min_pg_log_entries": "250", 2024-09-11T14:36:16.158 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_min_recovery_priority": "0", 2024-09-11T14:36:16.159 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-11T14:36:16.159 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-11T14:36:16.159 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mon_report_interval": "5", 2024-09-11T14:36:16.159 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-11T14:36:16.159 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-11T14:36:16.159 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_num_cache_shards": "32", 2024-09-11T14:36:16.159 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_num_op_tracker_shard": "32", 2024-09-11T14:36:16.159 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_numa_auto_affinity": "true", 2024-09-11T14:36:16.159 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_numa_node": "-1", 2024-09-11T14:36:16.159 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_numa_prefer_iface": "true", 2024-09-11T14:36:16.159 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-11T14:36:16.159 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_objecter_finishers": "1", 2024-09-11T14:36:16.159 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_objectstore": "bluestore", 2024-09-11T14:36:16.159 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_objectstore_fuse": "false", 2024-09-11T14:36:16.160 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-11T14:36:16.160 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_objectstore_tracing": "false", 2024-09-11T14:36:16.160 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_complaint_time": "30.000000", 2024-09-11T14:36:16.160 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_history_duration": "600", 2024-09-11T14:36:16.160 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_history_size": "20", 2024-09-11T14:36:16.160 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_history_slow_op_size": "20", 2024-09-11T14:36:16.160 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-11T14:36:16.160 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_log_threshold": "5", 2024-09-11T14:36:16.160 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_num_shards": "0", 2024-09-11T14:36:16.160 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_num_shards_hdd": "5", 2024-09-11T14:36:16.160 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_num_shards_ssd": "8", 2024-09-11T14:36:16.160 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-11T14:36:16.160 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-11T14:36:16.160 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-11T14:36:16.160 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-11T14:36:16.161 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_pq_min_cost": "65536", 2024-09-11T14:36:16.161 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-11T14:36:16.161 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_queue_cut_off": "high", 2024-09-11T14:36:16.161 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-11T14:36:16.161 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_thread_timeout": "15", 2024-09-11T14:36:16.161 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_open_classes_on_start": "true", 2024-09-11T14:36:16.161 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_os_flags": "0", 2024-09-11T14:36:16.161 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_peering_op_priority": "255", 2024-09-11T14:36:16.161 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_delete_cost": "1048576", 2024-09-11T14:36:16.161 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_delete_priority": "5", 2024-09-11T14:36:16.161 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-11T14:36:16.161 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-11T14:36:16.161 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-11T14:36:16.162 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_log_trim_max": "10000", 2024-09-11T14:36:16.162 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_log_trim_min": "100", 2024-09-11T14:36:16.162 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-11T14:36:16.162 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-11T14:36:16.162 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-11T14:36:16.162 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-11T14:36:16.162 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-11T14:36:16.162 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-11T14:36:16.162 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-11T14:36:16.162 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-11T14:36:16.162 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-11T14:36:16.162 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-11T14:36:16.162 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_crimson": "true", 2024-09-11T14:36:16.162 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-11T14:36:16.163 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-11T14:36:16.163 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-11T14:36:16.163 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-11T14:36:16.163 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-11T14:36:16.163 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-11T14:36:16.163 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-11T14:36:16.163 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-11T14:36:16.163 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_flags": "0", 2024-09-11T14:36:16.163 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-11T14:36:16.163 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_min_size": "2", 2024-09-11T14:36:16.163 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-11T14:36:16.163 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_pg_num": "32", 2024-09-11T14:36:16.163 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_pgp_num": "0", 2024-09-11T14:36:16.163 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-11T14:36:16.164 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_read_ratio": "70", 2024-09-11T14:36:16.164 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_size": "3", 2024-09-11T14:36:16.164 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_type": "replicated", 2024-09-11T14:36:16.164 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-11T14:36:16.164 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-11T14:36:16.164 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_push_per_object_cost": "1000", 2024-09-11T14:36:16.164 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-11T14:36:16.164 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recover_clone_overlap": "true", 2024-09-11T14:36:16.164 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-11T14:36:16.164 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_cost": "20971520", 2024-09-11T14:36:16.164 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-11T14:36:16.164 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_max_active": "0", 2024-09-11T14:36:16.164 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-11T14:36:16.165 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-11T14:36:16.165 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-11T14:36:16.165 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-11T14:36:16.165 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_max_single_start": "1", 2024-09-11T14:36:16.165 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_op_priority": "3", 2024-09-11T14:36:16.165 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-11T14:36:16.165 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_priority": "5", 2024-09-11T14:36:16.165 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-11T14:36:16.165 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_sleep": "0.000000", 2024-09-11T14:36:16.165 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-11T14:36:16.165 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-11T14:36:16.165 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-11T14:36:16.165 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_repair_during_recovery": "false", 2024-09-11T14:36:16.165 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_requested_scrub_priority": "120", 2024-09-11T14:36:16.166 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-11T14:36:16.166 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-11T14:36:16.166 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_auto_repair": "false", 2024-09-11T14:36:16.166 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-11T14:36:16.166 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-11T14:36:16.166 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_begin_hour": "0", 2024-09-11T14:36:16.166 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_begin_week_day": "0", 2024-09-11T14:36:16.166 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_chunk_max": "25", 2024-09-11T14:36:16.166 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_chunk_min": "5", 2024-09-11T14:36:16.166 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_cost": "52428800", 2024-09-11T14:36:16.166 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-11T14:36:16.166 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_during_recovery": "false", 2024-09-11T14:36:16.166 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_end_hour": "0", 2024-09-11T14:36:16.166 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_end_week_day": "0", 2024-09-11T14:36:16.167 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_event_cost": "4096", 2024-09-11T14:36:16.167 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-11T14:36:16.167 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-11T14:36:16.167 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_invalid_stats": "true", 2024-09-11T14:36:16.167 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-11T14:36:16.167 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-11T14:36:16.167 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_max_preemptions": "5", 2024-09-11T14:36:16.167 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-11T14:36:16.167 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_priority": "5", 2024-09-11T14:36:16.167 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_retry_after_noscrub": "60", 2024-09-11T14:36:16.167 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_retry_delay": "30", 2024-09-11T14:36:16.167 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_retry_new_interval": "10", 2024-09-11T14:36:16.167 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_retry_pg_state": "60", 2024-09-11T14:36:16.167 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_retry_trimming": "10", 2024-09-11T14:36:16.168 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_sleep": "0.000000", 2024-09-11T14:36:16.168 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-11T14:36:16.168 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-11T14:36:16.168 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-11T14:36:16.168 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-11T14:36:16.168 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_skip_data_digest": "false", 2024-09-11T14:36:16.168 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_smart_report_timeout": "5", 2024-09-11T14:36:16.168 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_snap_trim_cost": "1048576", 2024-09-11T14:36:16.168 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_snap_trim_priority": "5", 2024-09-11T14:36:16.168 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-11T14:36:16.168 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-11T14:36:16.168 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-11T14:36:16.168 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-11T14:36:16.168 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-11T14:36:16.169 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-11T14:36:16.169 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-11T14:36:16.169 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_target_transaction_size": "30", 2024-09-11T14:36:16.169 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-11T14:36:16.169 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-11T14:36:16.169 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-11T14:36:16.169 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-11T14:36:16.169 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-11T14:36:16.169 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-11T14:36:16.169 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-11T14:36:16.169 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-11T14:36:16.169 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-11T14:36:16.169 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-11T14:36:16.170 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tracing": "false", 2024-09-11T14:36:16.170 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_use_stale_snap": "false", 2024-09-11T14:36:16.170 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-11T14:36:16.170 INFO:teuthology.orchestra.run.smithi103.stdout: "osdc_blkin_trace_all": "false", 2024-09-11T14:36:16.170 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_kill_at": "0", 2024-09-11T14:36:16.170 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_max_join_drift": "10", 2024-09-11T14:36:16.170 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_min": "500", 2024-09-11T14:36:16.170 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_min_wait": "0.050000", 2024-09-11T14:36:16.170 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_propose_interval": "1.000000", 2024-09-11T14:36:16.170 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_service_trim_max": "500", 2024-09-11T14:36:16.170 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-11T14:36:16.170 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_service_trim_min": "10", 2024-09-11T14:36:16.170 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_stash_full_interval": "25", 2024-09-11T14:36:16.170 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_trim_max": "500", 2024-09-11T14:36:16.170 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_trim_min": "250", 2024-09-11T14:36:16.171 INFO:teuthology.orchestra.run.smithi103.stdout: "perf": "true", 2024-09-11T14:36:16.171 INFO:teuthology.orchestra.run.smithi103.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-11T14:36:16.171 INFO:teuthology.orchestra.run.smithi103.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-11T14:36:16.171 INFO:teuthology.orchestra.run.smithi103.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-11T14:36:16.171 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "-", 2024-09-11T14:36:16.171 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrv": "", 2024-09-11T14:36:16.171 INFO:teuthology.orchestra.run.smithi103.stdout: "public_bind_addr": "-", 2024-09-11T14:36:16.171 INFO:teuthology.orchestra.run.smithi103.stdout: "public_network": "", 2024-09-11T14:36:16.171 INFO:teuthology.orchestra.run.smithi103.stdout: "public_network_interface": "", 2024-09-11T14:36:16.171 INFO:teuthology.orchestra.run.smithi103.stdout: "qat_compressor_busy_polling": "false", 2024-09-11T14:36:16.171 INFO:teuthology.orchestra.run.smithi103.stdout: "qat_compressor_enabled": "false", 2024-09-11T14:36:16.171 INFO:teuthology.orchestra.run.smithi103.stdout: "qat_compressor_session_max_number": "256", 2024-09-11T14:36:16.171 INFO:teuthology.orchestra.run.smithi103.stdout: "rados_mon_op_timeout": "0", 2024-09-11T14:36:16.171 INFO:teuthology.orchestra.run.smithi103.stdout: "rados_osd_op_timeout": "0", 2024-09-11T14:36:16.171 INFO:teuthology.orchestra.run.smithi103.stdout: "rados_tracing": "false", 2024-09-11T14:36:16.172 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_atime_update_interval": "60", 2024-09-11T14:36:16.172 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-11T14:36:16.172 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_balance_parent_reads": "false", 2024-09-11T14:36:16.172 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_balance_snap_reads": "false", 2024-09-11T14:36:16.172 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_blkin_trace_all": "false", 2024-09-11T14:36:16.172 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-11T14:36:16.172 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-11T14:36:16.172 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_cache": "true", 2024-09-11T14:36:16.172 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-11T14:36:16.172 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-11T14:36:16.172 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-11T14:36:16.172 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-11T14:36:16.172 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_cache_policy": "writearound", 2024-09-11T14:36:16.173 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_cache_size": "33554432", 2024-09-11T14:36:16.173 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-11T14:36:16.173 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-11T14:36:16.173 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_clone_copy_on_read": "false", 2024-09-11T14:36:16.173 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_compression_hint": "none", 2024-09-11T14:36:16.173 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_concurrent_management_ops": "10", 2024-09-11T14:36:16.173 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-11T14:36:16.173 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_clone_format": "auto", 2024-09-11T14:36:16.173 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_data_pool": "", 2024-09-11T14:36:16.173 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_features": "61", 2024-09-11T14:36:16.173 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_format": "2", 2024-09-11T14:36:16.173 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_map_options": "", 2024-09-11T14:36:16.173 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_order": "22", 2024-09-11T14:36:16.173 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_pool": "rbd", 2024-09-11T14:36:16.174 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-11T14:36:16.174 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_stripe_count": "0", 2024-09-11T14:36:16.174 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_stripe_unit": "0", 2024-09-11T14:36:16.174 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-11T14:36:16.174 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-11T14:36:16.174 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-11T14:36:16.174 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_enable_alloc_hint": "true", 2024-09-11T14:36:16.174 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-11T14:36:16.174 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_io_scheduler": "simple", 2024-09-11T14:36:16.174 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-11T14:36:16.174 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-11T14:36:16.174 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-11T14:36:16.174 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-11T14:36:16.174 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-11T14:36:16.174 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-11T14:36:16.175 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-11T14:36:16.175 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-11T14:36:16.175 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-11T14:36:16.175 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_order": "24", 2024-09-11T14:36:16.175 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_pool": "", 2024-09-11T14:36:16.175 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_splay_width": "4", 2024-09-11T14:36:16.175 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_localize_parent_reads": "false", 2024-09-11T14:36:16.175 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_localize_snap_reads": "false", 2024-09-11T14:36:16.175 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-11T14:36:16.175 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-11T14:36:16.175 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-11T14:36:16.175 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-11T14:36:16.175 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-11T14:36:16.175 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-11T14:36:16.175 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-11T14:36:16.176 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-11T14:36:16.176 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-11T14:36:16.176 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-11T14:36:16.176 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-11T14:36:16.176 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-11T14:36:16.176 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-11T14:36:16.176 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-11T14:36:16.176 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-11T14:36:16.176 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-11T14:36:16.176 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-11T14:36:16.176 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-11T14:36:16.176 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-11T14:36:16.176 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-11T14:36:16.176 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-11T14:36:16.177 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-11T14:36:16.177 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-11T14:36:16.177 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-11T14:36:16.177 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-11T14:36:16.177 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-11T14:36:16.177 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-11T14:36:16.177 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-11T14:36:16.177 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-11T14:36:16.177 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-11T14:36:16.177 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-11T14:36:16.177 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mtime_update_interval": "60", 2024-09-11T14:36:16.177 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_non_blocking_aio": "true", 2024-09-11T14:36:16.177 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_op_thread_timeout": "60", 2024-09-11T14:36:16.178 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_op_threads": "1", 2024-09-11T14:36:16.178 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_parent_cache_enabled": "false", 2024-09-11T14:36:16.178 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-11T14:36:16.178 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-11T14:36:16.178 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-11T14:36:16.178 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_plugins": "", 2024-09-11T14:36:16.178 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_bps_burst": "0", 2024-09-11T14:36:16.178 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-11T14:36:16.178 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_bps_limit": "0", 2024-09-11T14:36:16.178 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_exclude_ops": "0", 2024-09-11T14:36:16.178 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_iops_burst": "0", 2024-09-11T14:36:16.178 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-11T14:36:16.178 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_iops_limit": "0", 2024-09-11T14:36:16.179 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-11T14:36:16.179 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-11T14:36:16.179 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-11T14:36:16.179 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-11T14:36:16.179 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-11T14:36:16.179 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-11T14:36:16.179 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-11T14:36:16.179 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-11T14:36:16.179 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-11T14:36:16.179 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-11T14:36:16.179 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-11T14:36:16.179 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-11T14:36:16.179 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-11T14:36:16.179 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-11T14:36:16.179 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_read_from_replica_policy": "default", 2024-09-11T14:36:16.180 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-11T14:36:16.180 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-11T14:36:16.180 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-11T14:36:16.180 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-11T14:36:16.180 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_skip_partial_discard": "true", 2024-09-11T14:36:16.180 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-11T14:36:16.180 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_tracing": "false", 2024-09-11T14:36:16.180 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_validate_names": "true", 2024-09-11T14:36:16.180 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_validate_pool": "true", 2024-09-11T14:36:16.180 INFO:teuthology.orchestra.run.smithi103.stdout: "restapi_base_url": "", 2024-09-11T14:36:16.180 INFO:teuthology.orchestra.run.smithi103.stdout: "restapi_log_level": "", 2024-09-11T14:36:16.180 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-11T14:36:16.180 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-11T14:36:16.180 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_acl_grants_max_num": "100", 2024-09-11T14:36:16.181 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_admin_entry": "admin", 2024-09-11T14:36:16.181 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-11T14:36:16.181 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_asio_assert_yielding": "false", 2024-09-11T14:36:16.181 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_backend_store": "rados", 2024-09-11T14:36:16.181 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_barbican_url": "", 2024-09-11T14:36:16.181 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_beast_enable_async": "true", 2024-09-11T14:36:16.181 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_bucket_counters_cache": "false", 2024-09-11T14:36:16.181 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-11T14:36:16.181 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-11T14:36:16.181 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-11T14:36:16.181 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-11T14:36:16.181 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-11T14:36:16.181 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-11T14:36:16.182 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-11T14:36:16.182 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-11T14:36:16.182 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_cache_enabled": "true", 2024-09-11T14:36:16.182 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_cache_expiry_interval": "900", 2024-09-11T14:36:16.182 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_cache_lru_size": "25000", 2024-09-11T14:36:16.182 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_config_store": "rados", 2024-09-11T14:36:16.182 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_content_length_compat": "false", 2024-09-11T14:36:16.182 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_copy_obj_progress": "true", 2024-09-11T14:36:16.182 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-11T14:36:16.182 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_cors_rules_max_num": "100", 2024-09-11T14:36:16.182 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_cross_domain_policy": "", 2024-09-11T14:36:16.182 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-11T14:36:16.182 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_kmip_addr": "", 2024-09-11T14:36:16.182 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-11T14:36:16.182 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-11T14:36:16.183 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-11T14:36:16.183 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-11T14:36:16.183 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_kmip_password": "", 2024-09-11T14:36:16.183 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-11T14:36:16.183 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_kmip_username": "", 2024-09-11T14:36:16.183 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_require_ssl": "true", 2024-09-11T14:36:16.183 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-11T14:36:16.183 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-11T14:36:16.183 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-11T14:36:16.183 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-11T14:36:16.183 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-11T14:36:16.183 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-11T14:36:16.183 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-11T14:36:16.183 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-11T14:36:16.183 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-11T14:36:16.184 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-11T14:36:16.184 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-11T14:36:16.184 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-11T14:36:16.184 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-11T14:36:16.184 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-11T14:36:16.184 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-11T14:36:16.184 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_addr": "", 2024-09-11T14:36:16.184 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_auth": "token", 2024-09-11T14:36:16.184 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_namespace": "", 2024-09-11T14:36:16.184 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_prefix": "", 2024-09-11T14:36:16.184 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-11T14:36:16.184 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-11T14:36:16.184 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-11T14:36:16.185 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-11T14:36:16.185 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_token_file": "", 2024-09-11T14:36:16.185 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-11T14:36:16.185 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_curl_buffersize": "524288", 2024-09-11T14:36:16.185 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-11T14:36:16.185 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_curl_low_speed_time": "300", 2024-09-11T14:36:16.185 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-11T14:36:16.185 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-11T14:36:16.185 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-11T14:36:16.185 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-11T14:36:16.185 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-11T14:36:16.185 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-11T14:36:16.185 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-11T14:36:16.186 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-11T14:36:16.186 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-11T14:36:16.186 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-11T14:36:16.186 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-11T14:36:16.186 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-11T14:36:16.186 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-11T14:36:16.186 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-11T14:36:16.186 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-11T14:36:16.186 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-11T14:36:16.186 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-11T14:36:16.186 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-11T14:36:16.186 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-11T14:36:16.186 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_data_log_changes_size": "1000", 2024-09-11T14:36:16.186 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_data_log_num_shards": "128", 2024-09-11T14:36:16.186 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-11T14:36:16.187 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_data_log_window": "30", 2024-09-11T14:36:16.187 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-11T14:36:16.187 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-11T14:36:16.187 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-11T14:36:16.187 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-11T14:36:16.187 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-11T14:36:16.187 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-11T14:36:16.187 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-11T14:36:16.187 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-11T14:36:16.187 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-11T14:36:16.187 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-11T14:36:16.187 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-11T14:36:16.187 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-11T14:36:16.187 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-11T14:36:16.188 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_disable_s3select": "false", 2024-09-11T14:36:16.188 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-11T14:36:16.188 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-11T14:36:16.188 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-11T14:36:16.188 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-11T14:36:16.188 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-11T14:36:16.188 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-11T14:36:16.188 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-11T14:36:16.188 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-11T14:36:16.188 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-11T14:36:16.188 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-11T14:36:16.188 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-11T14:36:16.188 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-11T14:36:16.188 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dns_name": "", 2024-09-11T14:36:16.188 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dns_s3website_name": "", 2024-09-11T14:36:16.189 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dynamic_resharding": "true", 2024-09-11T14:36:16.189 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-11T14:36:16.189 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-11T14:36:16.189 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-11T14:36:16.189 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_enable_gc_threads": "true", 2024-09-11T14:36:16.189 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_enable_lc_threads": "true", 2024-09-11T14:36:16.189 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_enable_mdsearch": "true", 2024-09-11T14:36:16.189 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_enable_ops_log": "false", 2024-09-11T14:36:16.189 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_enable_quota_threads": "true", 2024-09-11T14:36:16.189 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_enable_static_website": "false", 2024-09-11T14:36:16.189 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_enable_usage_log": "false", 2024-09-11T14:36:16.189 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_enforce_swift_acls": "true", 2024-09-11T14:36:16.189 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_exit_timeout_secs": "120", 2024-09-11T14:36:16.190 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_expose_bucket": "false", 2024-09-11T14:36:16.190 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_extended_http_attrs": "", 2024-09-11T14:36:16.190 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_filter": "none", 2024-09-11T14:36:16.190 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-11T14:36:16.190 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_frontends": "beast port=7480", 2024-09-11T14:36:16.190 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-11T14:36:16.190 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_gc_max_deferred": "50", 2024-09-11T14:36:16.190 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-11T14:36:16.190 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_gc_max_objs": "32", 2024-09-11T14:36:16.190 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-11T14:36:16.190 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-11T14:36:16.190 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-11T14:36:16.190 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-11T14:36:16.190 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_gc_processor_period": "3600", 2024-09-11T14:36:16.191 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-11T14:36:16.191 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-11T14:36:16.191 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-11T14:36:16.191 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-11T14:36:16.191 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_init_timeout": "300", 2024-09-11T14:36:16.191 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-11T14:36:16.191 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-11T14:36:16.191 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_kafka_connection_idle": "300", 2024-09-11T14:36:16.191 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-11T14:36:16.191 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-11T14:36:16.191 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-11T14:36:16.191 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-11T14:36:16.191 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-11T14:36:16.191 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_admin_domain": "", 2024-09-11T14:36:16.192 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_admin_password": "", 2024-09-11T14:36:16.192 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_admin_password_path": "", 2024-09-11T14:36:16.192 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_admin_project": "", 2024-09-11T14:36:16.192 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_admin_tenant": "", 2024-09-11T14:36:16.192 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_admin_token": "", 2024-09-11T14:36:16.192 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_admin_token_path": "", 2024-09-11T14:36:16.192 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_admin_user": "", 2024-09-11T14:36:16.192 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_barbican_domain": "", 2024-09-11T14:36:16.192 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_barbican_password": "", 2024-09-11T14:36:16.192 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_barbican_project": "", 2024-09-11T14:36:16.192 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-11T14:36:16.192 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_barbican_user": "", 2024-09-11T14:36:16.192 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-11T14:36:16.193 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-11T14:36:16.193 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-11T14:36:16.193 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-11T14:36:16.193 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-11T14:36:16.193 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_url": "", 2024-09-11T14:36:16.193 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-11T14:36:16.193 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lc_debug_interval": "-1", 2024-09-11T14:36:16.193 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lc_lock_max_time": "90", 2024-09-11T14:36:16.193 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lc_max_objs": "32", 2024-09-11T14:36:16.193 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lc_max_rules": "1000", 2024-09-11T14:36:16.193 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lc_max_worker": "3", 2024-09-11T14:36:16.193 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-11T14:36:16.193 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lc_thread_delay": "0", 2024-09-11T14:36:16.194 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-11T14:36:16.194 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ldap_dnattr": "uid", 2024-09-11T14:36:16.194 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-11T14:36:16.194 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ldap_searchfilter": "", 2024-09-11T14:36:16.194 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-11T14:36:16.194 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ldap_uri": "", 2024-09-11T14:36:16.194 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-11T14:36:16.194 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-11T14:36:16.194 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-11T14:36:16.194 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-11T14:36:16.194 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_log_http_headers": "", 2024-09-11T14:36:16.194 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-11T14:36:16.194 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-11T14:36:16.194 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_log_object_name_utc": "false", 2024-09-11T14:36:16.195 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-11T14:36:16.195 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-11T14:36:16.195 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_attr_name_len": "0", 2024-09-11T14:36:16.195 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_attr_size": "0", 2024-09-11T14:36:16.195 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-11T14:36:16.195 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_chunk_size": "4194304", 2024-09-11T14:36:16.195 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-11T14:36:16.195 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-11T14:36:16.195 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-11T14:36:16.195 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_listing_results": "5000", 2024-09-11T14:36:16.195 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_notify_retries": "10", 2024-09-11T14:36:16.195 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-11T14:36:16.195 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_put_param_size": "1048576", 2024-09-11T14:36:16.195 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_put_size": "5368709120", 2024-09-11T14:36:16.196 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_slo_entries": "1000", 2024-09-11T14:36:16.196 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_md_log_max_shards": "64", 2024-09-11T14:36:16.196 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-11T14:36:16.196 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-11T14:36:16.196 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-11T14:36:16.196 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-11T14:36:16.196 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_mp_lock_max_time": "600", 2024-09-11T14:36:16.196 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-11T14:36:16.196 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-11T14:36:16.196 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-11T14:36:16.196 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-11T14:36:16.196 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-11T14:36:16.196 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-11T14:36:16.197 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-11T14:36:16.197 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-11T14:36:16.197 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_max_gc": "300", 2024-09-11T14:36:16.197 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-11T14:36:16.197 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-11T14:36:16.197 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-11T14:36:16.197 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-11T14:36:16.197 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-11T14:36:16.197 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-11T14:36:16.197 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-11T14:36:16.197 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_num_async_rados_threads": "32", 2024-09-11T14:36:16.197 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_num_control_oids": "8", 2024-09-11T14:36:16.197 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_numa_node": "-1", 2024-09-11T14:36:16.197 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-11T14:36:16.198 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-11T14:36:16.198 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_objexp_chunk_size": "100", 2024-09-11T14:36:16.198 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_objexp_gc_interval": "600", 2024-09-11T14:36:16.198 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-11T14:36:16.198 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-11T14:36:16.198 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-11T14:36:16.198 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_op_thread_timeout": "600", 2024-09-11T14:36:16.198 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_op_tracing": "false", 2024-09-11T14:36:16.198 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_opa_token": "", 2024-09-11T14:36:16.198 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_opa_url": "", 2024-09-11T14:36:16.198 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_opa_verify_ssl": "true", 2024-09-11T14:36:16.198 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-11T14:36:16.198 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-11T14:36:16.198 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ops_log_rados": "false", 2024-09-11T14:36:16.199 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ops_log_socket_path": "", 2024-09-11T14:36:16.199 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-11T14:36:16.199 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-11T14:36:16.199 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-11T14:36:16.199 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_period_push_interval": "2.000000", 2024-09-11T14:36:16.199 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-11T14:36:16.199 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-11T14:36:16.199 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-11T14:36:16.199 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-11T14:36:16.199 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_posix_cache_lanes": "3", 2024-09-11T14:36:16.199 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-11T14:36:16.199 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-11T14:36:16.199 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_posix_cache_partitions": "3", 2024-09-11T14:36:16.199 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-11T14:36:16.200 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_print_continue": "true", 2024-09-11T14:36:16.200 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-11T14:36:16.200 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-11T14:36:16.200 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-11T14:36:16.200 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-11T14:36:16.200 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-11T14:36:16.200 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_rados_tracing": "false", 2024-09-11T14:36:16.200 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_realm": "", 2024-09-11T14:36:16.200 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_realm_id": "", 2024-09-11T14:36:16.200 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-11T14:36:16.200 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_region": "", 2024-09-11T14:36:16.200 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-11T14:36:16.200 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-11T14:36:16.200 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-11T14:36:16.201 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-11T14:36:16.201 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_request_uri": "", 2024-09-11T14:36:16.201 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_reshard_batch_size": "64", 2024-09-11T14:36:16.201 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-11T14:36:16.201 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-11T14:36:16.201 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_reshard_max_aio": "128", 2024-09-11T14:36:16.201 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_reshard_num_logs": "16", 2024-09-11T14:36:16.201 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-11T14:36:16.201 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-11T14:36:16.201 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_reshard_thread_interval": "600", 2024-09-11T14:36:16.201 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-11T14:36:16.201 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_resolve_cname": "false", 2024-09-11T14:36:16.201 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-11T14:36:16.201 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_run_sync_thread": "true", 2024-09-11T14:36:16.202 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-11T14:36:16.202 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-11T14:36:16.202 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-11T14:36:16.202 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-11T14:36:16.202 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-11T14:36:16.202 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-11T14:36:16.202 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-11T14:36:16.202 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-11T14:36:16.202 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-11T14:36:16.202 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_scheduler_type": "throttler", 2024-09-11T14:36:16.202 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_script_uri": "", 2024-09-11T14:36:16.202 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_service_provider_name": "", 2024-09-11T14:36:16.202 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-11T14:36:16.203 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sts_client_id": "", 2024-09-11T14:36:16.203 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sts_client_secret": "", 2024-09-11T14:36:16.203 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sts_entry": "sts", 2024-09-11T14:36:16.203 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sts_key": "sts", 2024-09-11T14:36:16.203 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-11T14:36:16.203 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sts_min_session_duration": "900", 2024-09-11T14:36:16.203 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sts_token_introspection_url": "", 2024-09-11T14:36:16.203 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_account_in_url": "false", 2024-09-11T14:36:16.203 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_auth_entry": "auth", 2024-09-11T14:36:16.203 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_auth_url": "", 2024-09-11T14:36:16.203 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_custom_header": "", 2024-09-11T14:36:16.203 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-11T14:36:16.203 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_need_stats": "true", 2024-09-11T14:36:16.203 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_tenant_name": "", 2024-09-11T14:36:16.204 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_token_expiration": "86400", 2024-09-11T14:36:16.204 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_url": "", 2024-09-11T14:36:16.204 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_url_prefix": "swift", 2024-09-11T14:36:16.204 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-11T14:36:16.204 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-11T14:36:16.204 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-11T14:36:16.204 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_lease_period": "120", 2024-09-11T14:36:16.204 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-11T14:36:16.204 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-11T14:36:16.204 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-11T14:36:16.204 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-11T14:36:16.204 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-11T14:36:16.204 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-11T14:36:16.204 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-11T14:36:16.205 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-11T14:36:16.205 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-11T14:36:16.205 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_thread_pool_size": "512", 2024-09-11T14:36:16.205 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-11T14:36:16.205 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-11T14:36:16.205 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-11T14:36:16.205 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-11T14:36:16.205 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_torrent_comment": "", 2024-09-11T14:36:16.205 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_torrent_createby": "", 2024-09-11T14:36:16.205 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_torrent_encoding": "", 2024-09-11T14:36:16.205 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_torrent_flag": "false", 2024-09-11T14:36:16.205 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-11T14:36:16.205 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_torrent_origin": "", 2024-09-11T14:36:16.205 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-11T14:36:16.206 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_torrent_tracker": "", 2024-09-11T14:36:16.206 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_trust_forwarded_https": "false", 2024-09-11T14:36:16.206 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-11T14:36:16.206 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-11T14:36:16.206 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_usage_max_shards": "32", 2024-09-11T14:36:16.206 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_usage_max_user_shards": "1", 2024-09-11T14:36:16.206 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_use_opa_authz": "false", 2024-09-11T14:36:16.206 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_counters_cache": "false", 2024-09-11T14:36:16.206 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-11T14:36:16.206 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-11T14:36:16.206 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-11T14:36:16.206 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_max_buckets": "1000", 2024-09-11T14:36:16.206 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_policies_max_num": "100", 2024-09-11T14:36:16.207 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-11T14:36:16.207 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-11T14:36:16.207 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-11T14:36:16.207 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-11T14:36:16.207 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_unique_email": "true", 2024-09-11T14:36:16.207 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_verify_ssl": "true", 2024-09-11T14:36:16.207 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-11T14:36:16.207 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_zone": "", 2024-09-11T14:36:16.207 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_zone_id": "", 2024-09-11T14:36:16.207 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-11T14:36:16.207 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_zonegroup": "", 2024-09-11T14:36:16.207 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_zonegroup_id": "", 2024-09-11T14:36:16.207 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-11T14:36:16.208 INFO:teuthology.orchestra.run.smithi103.stdout: "rgwlc_auto_session_clear": "true", 2024-09-11T14:36:16.208 INFO:teuthology.orchestra.run.smithi103.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-11T14:36:16.208 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_block_size": "4096", 2024-09-11T14:36:16.208 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-11T14:36:16.208 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-11T14:36:16.208 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-11T14:36:16.208 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-11T14:36:16.208 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-11T14:36:16.208 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_cache_size": "536870912", 2024-09-11T14:36:16.208 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-11T14:36:16.208 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-11T14:36:16.208 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-11T14:36:16.208 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-11T14:36:16.208 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-11T14:36:16.209 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-11T14:36:16.209 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-11T14:36:16.209 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-11T14:36:16.209 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_index_type": "binary_search", 2024-09-11T14:36:16.209 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-11T14:36:16.209 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-11T14:36:16.209 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_partition_filters": "false", 2024-09-11T14:36:16.209 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_perf": "false", 2024-09-11T14:36:16.209 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-11T14:36:16.209 INFO:teuthology.orchestra.run.smithi103.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-11T14:36:16.209 INFO:teuthology.orchestra.run.smithi103.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-11T14:36:16.209 INFO:teuthology.orchestra.run.smithi103.stdout: "run_dir": "/var/run/ceph", 2024-09-11T14:36:16.209 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_block_create": "true", 2024-09-11T14:36:16.210 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_cache_lru_size": "67108864", 2024-09-11T14:36:16.210 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-11T14:36:16.210 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-11T14:36:16.210 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_default_max_object_size": "16777216", 2024-09-11T14:36:16.210 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-11T14:36:16.210 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_device_size": "53687091200", 2024-09-11T14:36:16.210 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-11T14:36:16.210 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_full_integrity_check": "false", 2024-09-11T14:36:16.210 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_journal_batch_capacity": "16", 2024-09-11T14:36:16.210 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-11T14:36:16.210 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-11T14:36:16.210 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-11T14:36:16.210 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_main_device_type": "SSD", 2024-09-11T14:36:16.210 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-11T14:36:16.211 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-11T14:36:16.211 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-11T14:36:16.211 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-11T14:36:16.211 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-11T14:36:16.211 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-11T14:36:16.211 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_segment_size": "67108864", 2024-09-11T14:36:16.211 INFO:teuthology.orchestra.run.smithi103.stdout: "set_keepcaps": "false", 2024-09-11T14:36:16.211 INFO:teuthology.orchestra.run.smithi103.stdout: "setgroup": "", 2024-09-11T14:36:16.211 INFO:teuthology.orchestra.run.smithi103.stdout: "setuser": "", 2024-09-11T14:36:16.211 INFO:teuthology.orchestra.run.smithi103.stdout: "setuser_match_path": "", 2024-09-11T14:36:16.211 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-11T14:36:16.211 INFO:teuthology.orchestra.run.smithi103.stdout: "thp": "false", 2024-09-11T14:36:16.211 INFO:teuthology.orchestra.run.smithi103.stdout: "threadpool_default_timeout": "60", 2024-09-11T14:36:16.211 INFO:teuthology.orchestra.run.smithi103.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-11T14:36:16.212 INFO:teuthology.orchestra.run.smithi103.stdout: "throttler_perf_counter": "true", 2024-09-11T14:36:16.212 INFO:teuthology.orchestra.run.smithi103.stdout: "tmp_dir": "/tmp", 2024-09-11T14:36:16.212 INFO:teuthology.orchestra.run.smithi103.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-11T14:36:16.212 INFO:teuthology.orchestra.run.smithi103.stdout: "uadk_compressor_enabled": "false", 2024-09-11T14:36:16.212 INFO:teuthology.orchestra.run.smithi103.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-11T14:36:16.212 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T14:36:16.214 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-11T14:36:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:16.317+0000 7fa6c6b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:16.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:16.322+0000 7fa6c6b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:16.337 INFO:teuthology.orchestra.run.smithi103.stdout:{} 2024-09-11T14:36:16.337 INFO:teuthology.orchestra.run.smithi103.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T14:36:16.348 DEBUG:teuthology.orchestra.run.smithi103:> type ceph-objectstore-tool 2024-09-11T14:36:16.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-11T14:36:16.362 DEBUG:teuthology.orchestra.run.smithi176:> type ceph-objectstore-tool 2024-09-11T14:36:16.379 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-11T14:36:16.380 INFO:teuthology.run_tasks:Running task full_sequential... 2024-09-11T14:36:16.389 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-11T14:36:16.390 INFO:tasks.radosbench:Beginning radosbench... 2024-09-11T14:36:16.391 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-11T14:36:16.391 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-09-11T14:36:16.391 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-11T14:36:16.391 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:36:16.391 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:36:16.392 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:36:16.392 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-11T14:36:16.392 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:36:16.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:16.525+0000 7fafbcea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:16.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:16.525+0000 7f9090351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:16.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:16.530+0000 7fafbcea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:16.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:16.533+0000 7f9090351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:16.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:16.525+0000 7f20ac4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:16.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:16.538+0000 7f20ac4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:16.730 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:36:16.730 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:36:16.742 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-09-11T14:36:15.218447+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5112,"kb_used_data":5112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185800,"statfs":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.896882"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.371244+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:36:10.371244+0000","last_peered":"2024-09-11T14:36:10.371244+0000","last_clean":"2024-09-11T14:36:10.371244+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:36:10.371244+0000","last_undegraded":"2024-09-11T14:36:10.371244+0000","last_fullsized":"2024-09-11T14:36:10.371244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.373029+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:10.373029+0000","last_peered":"2024-09-11T14:36:10.373029+0000","last_clean":"2024-09-11T14:36:10.373029+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:36:10.373029+0000","last_undegraded":"2024-09-11T14:36:10.373029+0000","last_fullsized":"2024-09-11T14:36:10.373029+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.372693+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:10.372693+0000","last_peered":"2024-09-11T14:36:10.372693+0000","last_clean":"2024-09-11T14:36:10.372693+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:36:10.372693+0000","last_undegraded":"2024-09-11T14:36:10.372693+0000","last_fullsized":"2024-09-11T14:36:10.372693+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.373019+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:36:10.373019+0000","last_peered":"2024-09-11T14:36:10.373019+0000","last_clean":"2024-09-11T14:36:10.373019+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:36:10.373019+0000","last_undegraded":"2024-09-11T14:36:10.373019+0000","last_fullsized":"2024-09-11T14:36:10.373019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.372994+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:36:10.372994+0000","last_peered":"2024-09-11T14:36:10.372994+0000","last_clean":"2024-09-11T14:36:10.372994+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:36:10.372994+0000","last_undegraded":"2024-09-11T14:36:10.372994+0000","last_fullsized":"2024-09-11T14:36:10.372994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.366779+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:36:10.366779+0000","last_peered":"2024-09-11T14:36:10.366779+0000","last_clean":"2024-09-11T14:36:10.366779+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:36:10.366779+0000","last_undegraded":"2024-09-11T14:36:10.366779+0000","last_fullsized":"2024-09-11T14:36:10.366779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.375528+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:36:10.375528+0000","last_peered":"2024-09-11T14:36:10.375528+0000","last_clean":"2024-09-11T14:36:10.375528+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:36:10.375528+0000","last_undegraded":"2024-09-11T14:36:10.375528+0000","last_fullsized":"2024-09-11T14:36:10.375528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.372433+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:36:10.372433+0000","last_peered":"2024-09-11T14:36:10.372433+0000","last_clean":"2024-09-11T14:36:10.372433+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:36:10.372433+0000","last_undegraded":"2024-09-11T14:36:10.372433+0000","last_fullsized":"2024-09-11T14:36:10.372433+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":88,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T14:36:10.369820+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:36:10.369820+0000","last_peered":"2024-09-11T14:36:10.369820+0000","last_clean":"2024-09-11T14:36:10.369820+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:36:10.369820+0000","last_undegraded":"2024-09-11T14:36:10.369820+0000","last_fullsized":"2024-09-11T14:36:10.369820+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1244,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296484,"statfs":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1632,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296096,"statfs":{"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1568,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296160,"statfs":{"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":668,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297060,"statfs":{"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:36:17.352 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_0' created 2024-09-11T14:36:17.374 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-11T14:36:17.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:17.500+0000 7f792c151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:17.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:17.513+0000 7f792c151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:18.353 INFO:teuthology.orchestra.run.smithi103.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-11T14:36:18.651 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:36:18.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:18.760+0000 7ff42426c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:18.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:18.765+0000 7ff42426c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:19.372 DEBUG:teuthology.orchestra.run.smithi103:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 90 write' 2024-09-11T14:36:19.375 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-11T14:36:19.375 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-11T14:36:19.444 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:hints = 1 2024-09-11T14:36:19.444 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-11T14:36:19.444 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object prefix: benchmark_data_smithi103_29857 2024-09-11T14:36:19.444 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:36:19.444 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 0 0 0 0 0 0 - 0 2024-09-11T14:36:20.444 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 1 16 90 74 4.62474 4.625 0.237335 0.188199 2024-09-11T14:36:20.865 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:36:21.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:20.998+0000 7feb150e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:21.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:21.004+0000 7feb150e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:21.444 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 2 16 172 156 4.87464 5.125 0.0909056 0.191587 2024-09-11T14:36:21.743 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:36:21.743 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T14:36:21.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:21.873+0000 7f832f751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:21.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:21.884+0000 7f832f751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:22.372 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T14:36:22.395 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T14:36:22.444 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 3 16 254 238 4.95795 5.125 0.315443 0.192426 2024-09-11T14:36:22.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:22.533+0000 7f314f151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:22.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:22.547+0000 7f314f151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:23.376 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T14:36:23.386 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:36:23.394 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T14:36:23.444 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 4 16 336 320 4.9996 5.125 0.137069 0.190887 2024-09-11T14:36:23.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:23.523+0000 7f84c2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:23.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:23.531+0000 7f84c2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:23.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:23.562+0000 7f2c93711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:23.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:23.577+0000 7f2c93711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:24.381 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T14:36:24.408 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T14:36:24.444 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 5 16 419 403 5.03708 5.1875 0.100751 0.190065 2024-09-11T14:36:24.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:24.554+0000 7f560c2e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:24.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:24.572+0000 7f560c2e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:25.391 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T14:36:25.412 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T14:36:25.413 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:36:25.444 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 6 16 503 487 5.07247 5.25 0.586039 0.192996 2024-09-11T14:36:25.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:25.596+0000 7f1611b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:25.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:25.605+0000 7f1611b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:25.888 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:36:25.889 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:36:25.914 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-11T14:36:25.391617+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23724595,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":434,"num_write_kb":23700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":408,"ondisk_log_size":408,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":110548,"kb_used_data":110548,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209080364,"statfs":{"total":214211493888,"available":214098292736,"internally_reserved":0,"allocated":113201152,"data_stored":113201152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":22592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.171813"},"pg_stats":[{"pgid":"3.f","version":"20'14","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.129863+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:36:23.129863+0000","last_peered":"2024-09-11T14:36:23.129863+0000","last_clean":"2024-09-11T14:36:23.129863+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:36:23.129863+0000","last_undegraded":"2024-09-11T14:36:23.129863+0000","last_fullsized":"2024-09-11T14:36:23.129863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"20'17","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.794031+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:36:22.794031+0000","last_peered":"2024-09-11T14:36:22.794031+0000","last_clean":"2024-09-11T14:36:22.794031+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:36:22.794031+0000","last_undegraded":"2024-09-11T14:36:22.794031+0000","last_fullsized":"2024-09-11T14:36:22.794031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'17","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.157322+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:36:23.157322+0000","last_peered":"2024-09-11T14:36:23.157322+0000","last_clean":"2024-09-11T14:36:23.157322+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:36:23.157322+0000","last_undegraded":"2024-09-11T14:36:23.157322+0000","last_fullsized":"2024-09-11T14:36:23.157322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"20'19","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.113307+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:36:23.113307+0000","last_peered":"2024-09-11T14:36:23.113307+0000","last_clean":"2024-09-11T14:36:23.113307+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:36:23.113307+0000","last_undegraded":"2024-09-11T14:36:23.113307+0000","last_fullsized":"2024-09-11T14:36:23.113307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'26","reported_seq":44,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T14:36:24.165949+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:36:24.165949+0000","last_peered":"2024-09-11T14:36:24.165949+0000","last_clean":"2024-09-11T14:36:24.165949+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:36:24.165949+0000","last_undegraded":"2024-09-11T14:36:24.165949+0000","last_fullsized":"2024-09-11T14:36:24.165949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"20'29","reported_seq":44,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.994766+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:36:22.994766+0000","last_peered":"2024-09-11T14:36:22.994766+0000","last_clean":"2024-09-11T14:36:22.994766+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:36:22.994766+0000","last_undegraded":"2024-09-11T14:36:22.994766+0000","last_fullsized":"2024-09-11T14:36:22.994766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"20'19","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.223612+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:36:23.223612+0000","last_peered":"2024-09-11T14:36:23.223612+0000","last_clean":"2024-09-11T14:36:23.223612+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:36:23.223612+0000","last_undegraded":"2024-09-11T14:36:23.223612+0000","last_fullsized":"2024-09-11T14:36:23.223612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"20'20","reported_seq":35,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.012137+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:36:23.012137+0000","last_peered":"2024-09-11T14:36:23.012137+0000","last_clean":"2024-09-11T14:36:23.012137+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:36:23.012137+0000","last_undegraded":"2024-09-11T14:36:23.012137+0000","last_fullsized":"2024-09-11T14:36:23.012137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":103,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.480973+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:36:23.480973+0000","last_peered":"2024-09-11T14:36:23.480973+0000","last_clean":"2024-09-11T14:36:23.480973+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:36:23.480973+0000","last_undegraded":"2024-09-11T14:36:23.480973+0000","last_fullsized":"2024-09-11T14:36:23.480973+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.465941+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:36:22.465941+0000","last_peered":"2024-09-11T14:36:22.465941+0000","last_clean":"2024-09-11T14:36:22.465941+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:36:22.465941+0000","last_undegraded":"2024-09-11T14:36:22.465941+0000","last_fullsized":"2024-09-11T14:36:22.465941+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'15","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.464853+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:36:22.464853+0000","last_peered":"2024-09-11T14:36:22.464853+0000","last_clean":"2024-09-11T14:36:22.464853+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:36:22.464853+0000","last_undegraded":"2024-09-11T14:36:22.464853+0000","last_fullsized":"2024-09-11T14:36:22.464853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.413256+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:36:22.413256+0000","last_peered":"2024-09-11T14:36:22.413256+0000","last_clean":"2024-09-11T14:36:22.413256+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:36:22.413256+0000","last_undegraded":"2024-09-11T14:36:22.413256+0000","last_fullsized":"2024-09-11T14:36:22.413256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"21'28","reported_seq":46,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T14:36:24.082402+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:36:24.082402+0000","last_peered":"2024-09-11T14:36:24.082402+0000","last_clean":"2024-09-11T14:36:24.082402+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:36:24.082402+0000","last_undegraded":"2024-09-11T14:36:24.082402+0000","last_fullsized":"2024-09-11T14:36:24.082402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.456761+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:36:22.456761+0000","last_peered":"2024-09-11T14:36:22.456761+0000","last_clean":"2024-09-11T14:36:22.456761+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:36:22.456761+0000","last_undegraded":"2024-09-11T14:36:22.456761+0000","last_fullsized":"2024-09-11T14:36:22.456761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"21'32","reported_seq":50,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.798972+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:36:23.798972+0000","last_peered":"2024-09-11T14:36:23.798972+0000","last_clean":"2024-09-11T14:36:23.798972+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:36:23.798972+0000","last_undegraded":"2024-09-11T14:36:23.798972+0000","last_fullsized":"2024-09-11T14:36:23.798972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.408784+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:36:22.408784+0000","last_peered":"2024-09-11T14:36:22.408784+0000","last_clean":"2024-09-11T14:36:22.408784+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:36:22.408784+0000","last_undegraded":"2024-09-11T14:36:22.408784+0000","last_fullsized":"2024-09-11T14:36:22.408784+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"20'28","reported_seq":43,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.175804+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:36:23.175804+0000","last_peered":"2024-09-11T14:36:23.175804+0000","last_clean":"2024-09-11T14:36:23.175804+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:36:23.175804+0000","last_undegraded":"2024-09-11T14:36:23.175804+0000","last_fullsized":"2024-09-11T14:36:23.175804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"20'27","reported_seq":42,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.970304+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:36:22.970304+0000","last_peered":"2024-09-11T14:36:22.970304+0000","last_clean":"2024-09-11T14:36:22.970304+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:36:22.970304+0000","last_undegraded":"2024-09-11T14:36:22.970304+0000","last_fullsized":"2024-09-11T14:36:22.970304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.544372+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:36:22.544372+0000","last_peered":"2024-09-11T14:36:22.544372+0000","last_clean":"2024-09-11T14:36:22.544372+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:36:22.544372+0000","last_undegraded":"2024-09-11T14:36:22.544372+0000","last_fullsized":"2024-09-11T14:36:22.544372+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"20'15","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.036137+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:36:23.036137+0000","last_peered":"2024-09-11T14:36:23.036137+0000","last_clean":"2024-09-11T14:36:23.036137+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:36:23.036137+0000","last_undegraded":"2024-09-11T14:36:23.036137+0000","last_fullsized":"2024-09-11T14:36:23.036137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.485812+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:23.485812+0000","last_peered":"2024-09-11T14:36:23.485812+0000","last_clean":"2024-09-11T14:36:23.485812+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:36:23.485812+0000","last_undegraded":"2024-09-11T14:36:23.485812+0000","last_fullsized":"2024-09-11T14:36:23.485812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"21'24","reported_seq":42,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T14:36:24.113372+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:36:24.113372+0000","last_peered":"2024-09-11T14:36:24.113372+0000","last_clean":"2024-09-11T14:36:24.113372+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:36:24.113372+0000","last_undegraded":"2024-09-11T14:36:24.113372+0000","last_fullsized":"2024-09-11T14:36:24.113372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.542578+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:22.542578+0000","last_peered":"2024-09-11T14:36:22.542578+0000","last_clean":"2024-09-11T14:36:22.542578+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:36:22.542578+0000","last_undegraded":"2024-09-11T14:36:22.542578+0000","last_fullsized":"2024-09-11T14:36:22.542578+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"20'23","reported_seq":38,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.659139+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:36:22.659139+0000","last_peered":"2024-09-11T14:36:22.659139+0000","last_clean":"2024-09-11T14:36:22.659139+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:36:22.659139+0000","last_undegraded":"2024-09-11T14:36:22.659139+0000","last_fullsized":"2024-09-11T14:36:22.659139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.462496+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:36:22.462496+0000","last_peered":"2024-09-11T14:36:22.462496+0000","last_clean":"2024-09-11T14:36:22.462496+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:36:22.462496+0000","last_undegraded":"2024-09-11T14:36:22.462496+0000","last_fullsized":"2024-09-11T14:36:22.462496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":22592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214065983488,"internally_reserved":0,"allocated":145510400,"data_stored":145510400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":353,"ondisk_log_size":353,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214065983488,"internally_reserved":0,"allocated":145510400,"data_stored":145510400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53504643072,"internally_reserved":0,"allocated":48230400,"data_stored":48230400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":37720,"kb_used_data":37720,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52260008,"statfs":{"total":53552873472,"available":53514248192,"internally_reserved":0,"allocated":38625280,"data_stored":38625280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705683,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24896,"kb_used_data":24896,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272832,"statfs":{"total":53552873472,"available":53527379968,"internally_reserved":0,"allocated":25493504,"data_stored":25493504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705683,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":23168,"kb_used_data":23168,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52274560,"statfs":{"total":53552873472,"available":53529149440,"internally_reserved":0,"allocated":23724032,"data_stored":23724032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705683,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24764,"kb_used_data":24764,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272964,"statfs":{"total":53552873472,"available":53527515136,"internally_reserved":0,"allocated":25358336,"data_stored":25358336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53504643072,"internally_reserved":0,"allocated":48230400,"data_stored":48230400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53523222528,"internally_reserved":0,"allocated":29650944,"data_stored":29650944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53518790656,"internally_reserved":0,"allocated":34082816,"data_stored":34082816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53519458304,"internally_reserved":0,"allocated":33415168,"data_stored":33415168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53504512000,"internally_reserved":0,"allocated":48361472,"data_stored":48361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53523222528,"internally_reserved":0,"allocated":29650944,"data_stored":29650944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53518790656,"internally_reserved":0,"allocated":34082816,"data_stored":34082816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53519458304,"internally_reserved":0,"allocated":33415168,"data_stored":33415168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53504512000,"internally_reserved":0,"allocated":48361472,"data_stored":48361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:36:25.915 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:36:25.941 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:36:26.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:26.064+0000 7fe78d551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:26.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:26.076+0000 7fe78d551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:26.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:26.127+0000 7f9d49b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:26.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:26.138+0000 7f9d49b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:26.444 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 7 16 601 585 5.22275 6.125 0.0521373 0.187458 2024-09-11T14:36:26.446 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:36:26.446 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:36:26.466 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-11T14:36:25.391617+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23724595,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":434,"num_write_kb":23700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":408,"ondisk_log_size":408,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":110548,"kb_used_data":110548,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209080364,"statfs":{"total":214211493888,"available":214098292736,"internally_reserved":0,"allocated":113201152,"data_stored":113201152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":22592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.171813"},"pg_stats":[{"pgid":"3.f","version":"20'14","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.129863+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:36:23.129863+0000","last_peered":"2024-09-11T14:36:23.129863+0000","last_clean":"2024-09-11T14:36:23.129863+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:36:23.129863+0000","last_undegraded":"2024-09-11T14:36:23.129863+0000","last_fullsized":"2024-09-11T14:36:23.129863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"20'17","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.794031+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:36:22.794031+0000","last_peered":"2024-09-11T14:36:22.794031+0000","last_clean":"2024-09-11T14:36:22.794031+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:36:22.794031+0000","last_undegraded":"2024-09-11T14:36:22.794031+0000","last_fullsized":"2024-09-11T14:36:22.794031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'17","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.157322+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:36:23.157322+0000","last_peered":"2024-09-11T14:36:23.157322+0000","last_clean":"2024-09-11T14:36:23.157322+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:36:23.157322+0000","last_undegraded":"2024-09-11T14:36:23.157322+0000","last_fullsized":"2024-09-11T14:36:23.157322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"20'19","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.113307+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:36:23.113307+0000","last_peered":"2024-09-11T14:36:23.113307+0000","last_clean":"2024-09-11T14:36:23.113307+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:36:23.113307+0000","last_undegraded":"2024-09-11T14:36:23.113307+0000","last_fullsized":"2024-09-11T14:36:23.113307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'26","reported_seq":44,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T14:36:24.165949+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:36:24.165949+0000","last_peered":"2024-09-11T14:36:24.165949+0000","last_clean":"2024-09-11T14:36:24.165949+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:36:24.165949+0000","last_undegraded":"2024-09-11T14:36:24.165949+0000","last_fullsized":"2024-09-11T14:36:24.165949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"20'29","reported_seq":44,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.994766+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:36:22.994766+0000","last_peered":"2024-09-11T14:36:22.994766+0000","last_clean":"2024-09-11T14:36:22.994766+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:36:22.994766+0000","last_undegraded":"2024-09-11T14:36:22.994766+0000","last_fullsized":"2024-09-11T14:36:22.994766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"20'19","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.223612+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:36:23.223612+0000","last_peered":"2024-09-11T14:36:23.223612+0000","last_clean":"2024-09-11T14:36:23.223612+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:36:23.223612+0000","last_undegraded":"2024-09-11T14:36:23.223612+0000","last_fullsized":"2024-09-11T14:36:23.223612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"20'20","reported_seq":35,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.012137+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:36:23.012137+0000","last_peered":"2024-09-11T14:36:23.012137+0000","last_clean":"2024-09-11T14:36:23.012137+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:36:23.012137+0000","last_undegraded":"2024-09-11T14:36:23.012137+0000","last_fullsized":"2024-09-11T14:36:23.012137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":103,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.480973+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:36:23.480973+0000","last_peered":"2024-09-11T14:36:23.480973+0000","last_clean":"2024-09-11T14:36:23.480973+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:36:23.480973+0000","last_undegraded":"2024-09-11T14:36:23.480973+0000","last_fullsized":"2024-09-11T14:36:23.480973+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.465941+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:36:22.465941+0000","last_peered":"2024-09-11T14:36:22.465941+0000","last_clean":"2024-09-11T14:36:22.465941+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:36:22.465941+0000","last_undegraded":"2024-09-11T14:36:22.465941+0000","last_fullsized":"2024-09-11T14:36:22.465941+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'15","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.464853+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:36:22.464853+0000","last_peered":"2024-09-11T14:36:22.464853+0000","last_clean":"2024-09-11T14:36:22.464853+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:36:22.464853+0000","last_undegraded":"2024-09-11T14:36:22.464853+0000","last_fullsized":"2024-09-11T14:36:22.464853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.413256+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:36:22.413256+0000","last_peered":"2024-09-11T14:36:22.413256+0000","last_clean":"2024-09-11T14:36:22.413256+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:36:22.413256+0000","last_undegraded":"2024-09-11T14:36:22.413256+0000","last_fullsized":"2024-09-11T14:36:22.413256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"21'28","reported_seq":46,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T14:36:24.082402+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:36:24.082402+0000","last_peered":"2024-09-11T14:36:24.082402+0000","last_clean":"2024-09-11T14:36:24.082402+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:36:24.082402+0000","last_undegraded":"2024-09-11T14:36:24.082402+0000","last_fullsized":"2024-09-11T14:36:24.082402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.456761+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:36:22.456761+0000","last_peered":"2024-09-11T14:36:22.456761+0000","last_clean":"2024-09-11T14:36:22.456761+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:36:22.456761+0000","last_undegraded":"2024-09-11T14:36:22.456761+0000","last_fullsized":"2024-09-11T14:36:22.456761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"21'32","reported_seq":50,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.798972+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:36:23.798972+0000","last_peered":"2024-09-11T14:36:23.798972+0000","last_clean":"2024-09-11T14:36:23.798972+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:36:23.798972+0000","last_undegraded":"2024-09-11T14:36:23.798972+0000","last_fullsized":"2024-09-11T14:36:23.798972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.408784+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:36:22.408784+0000","last_peered":"2024-09-11T14:36:22.408784+0000","last_clean":"2024-09-11T14:36:22.408784+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:36:22.408784+0000","last_undegraded":"2024-09-11T14:36:22.408784+0000","last_fullsized":"2024-09-11T14:36:22.408784+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"20'28","reported_seq":43,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.175804+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:36:23.175804+0000","last_peered":"2024-09-11T14:36:23.175804+0000","last_clean":"2024-09-11T14:36:23.175804+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:36:23.175804+0000","last_undegraded":"2024-09-11T14:36:23.175804+0000","last_fullsized":"2024-09-11T14:36:23.175804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"20'27","reported_seq":42,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.970304+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:36:22.970304+0000","last_peered":"2024-09-11T14:36:22.970304+0000","last_clean":"2024-09-11T14:36:22.970304+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:36:22.970304+0000","last_undegraded":"2024-09-11T14:36:22.970304+0000","last_fullsized":"2024-09-11T14:36:22.970304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.544372+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:36:22.544372+0000","last_peered":"2024-09-11T14:36:22.544372+0000","last_clean":"2024-09-11T14:36:22.544372+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:36:22.544372+0000","last_undegraded":"2024-09-11T14:36:22.544372+0000","last_fullsized":"2024-09-11T14:36:22.544372+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"20'15","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.036137+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:36:23.036137+0000","last_peered":"2024-09-11T14:36:23.036137+0000","last_clean":"2024-09-11T14:36:23.036137+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:36:23.036137+0000","last_undegraded":"2024-09-11T14:36:23.036137+0000","last_fullsized":"2024-09-11T14:36:23.036137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.485812+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:23.485812+0000","last_peered":"2024-09-11T14:36:23.485812+0000","last_clean":"2024-09-11T14:36:23.485812+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:36:23.485812+0000","last_undegraded":"2024-09-11T14:36:23.485812+0000","last_fullsized":"2024-09-11T14:36:23.485812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"21'24","reported_seq":42,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T14:36:24.113372+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:36:24.113372+0000","last_peered":"2024-09-11T14:36:24.113372+0000","last_clean":"2024-09-11T14:36:24.113372+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:36:24.113372+0000","last_undegraded":"2024-09-11T14:36:24.113372+0000","last_fullsized":"2024-09-11T14:36:24.113372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.542578+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:22.542578+0000","last_peered":"2024-09-11T14:36:22.542578+0000","last_clean":"2024-09-11T14:36:22.542578+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:36:22.542578+0000","last_undegraded":"2024-09-11T14:36:22.542578+0000","last_fullsized":"2024-09-11T14:36:22.542578+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"20'23","reported_seq":38,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.659139+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:36:22.659139+0000","last_peered":"2024-09-11T14:36:22.659139+0000","last_clean":"2024-09-11T14:36:22.659139+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:36:22.659139+0000","last_undegraded":"2024-09-11T14:36:22.659139+0000","last_fullsized":"2024-09-11T14:36:22.659139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.462496+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:36:22.462496+0000","last_peered":"2024-09-11T14:36:22.462496+0000","last_clean":"2024-09-11T14:36:22.462496+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:36:22.462496+0000","last_undegraded":"2024-09-11T14:36:22.462496+0000","last_fullsized":"2024-09-11T14:36:22.462496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":22592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214065983488,"internally_reserved":0,"allocated":145510400,"data_stored":145510400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":353,"ondisk_log_size":353,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214065983488,"internally_reserved":0,"allocated":145510400,"data_stored":145510400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53504643072,"internally_reserved":0,"allocated":48230400,"data_stored":48230400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":37720,"kb_used_data":37720,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52260008,"statfs":{"total":53552873472,"available":53514248192,"internally_reserved":0,"allocated":38625280,"data_stored":38625280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705683,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24896,"kb_used_data":24896,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272832,"statfs":{"total":53552873472,"available":53527379968,"internally_reserved":0,"allocated":25493504,"data_stored":25493504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705683,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":23168,"kb_used_data":23168,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52274560,"statfs":{"total":53552873472,"available":53529149440,"internally_reserved":0,"allocated":23724032,"data_stored":23724032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705683,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24764,"kb_used_data":24764,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272964,"statfs":{"total":53552873472,"available":53527515136,"internally_reserved":0,"allocated":25358336,"data_stored":25358336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53504643072,"internally_reserved":0,"allocated":48230400,"data_stored":48230400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53523222528,"internally_reserved":0,"allocated":29650944,"data_stored":29650944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53518790656,"internally_reserved":0,"allocated":34082816,"data_stored":34082816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53519458304,"internally_reserved":0,"allocated":33415168,"data_stored":33415168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53504512000,"internally_reserved":0,"allocated":48361472,"data_stored":48361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53523222528,"internally_reserved":0,"allocated":29650944,"data_stored":29650944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53518790656,"internally_reserved":0,"allocated":34082816,"data_stored":34082816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53519458304,"internally_reserved":0,"allocated":33415168,"data_stored":33415168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53504512000,"internally_reserved":0,"allocated":48361472,"data_stored":48361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:36:26.468 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T14:36:26.468 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:36:26.468 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:36:26.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:26.614+0000 7f62ecb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:26.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:26.626+0000 7f62ecb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:26.983 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:36:26.983 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:36:27.001 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-11T14:36:25.391617+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23724595,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":434,"num_write_kb":23700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":408,"ondisk_log_size":408,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":110548,"kb_used_data":110548,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209080364,"statfs":{"total":214211493888,"available":214098292736,"internally_reserved":0,"allocated":113201152,"data_stored":113201152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":22592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.171813"},"pg_stats":[{"pgid":"3.f","version":"20'14","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.129863+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:36:23.129863+0000","last_peered":"2024-09-11T14:36:23.129863+0000","last_clean":"2024-09-11T14:36:23.129863+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:36:23.129863+0000","last_undegraded":"2024-09-11T14:36:23.129863+0000","last_fullsized":"2024-09-11T14:36:23.129863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"20'17","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.794031+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:36:22.794031+0000","last_peered":"2024-09-11T14:36:22.794031+0000","last_clean":"2024-09-11T14:36:22.794031+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:36:22.794031+0000","last_undegraded":"2024-09-11T14:36:22.794031+0000","last_fullsized":"2024-09-11T14:36:22.794031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'17","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.157322+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:36:23.157322+0000","last_peered":"2024-09-11T14:36:23.157322+0000","last_clean":"2024-09-11T14:36:23.157322+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:36:23.157322+0000","last_undegraded":"2024-09-11T14:36:23.157322+0000","last_fullsized":"2024-09-11T14:36:23.157322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"20'19","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.113307+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:36:23.113307+0000","last_peered":"2024-09-11T14:36:23.113307+0000","last_clean":"2024-09-11T14:36:23.113307+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:36:23.113307+0000","last_undegraded":"2024-09-11T14:36:23.113307+0000","last_fullsized":"2024-09-11T14:36:23.113307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'26","reported_seq":44,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T14:36:24.165949+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:36:24.165949+0000","last_peered":"2024-09-11T14:36:24.165949+0000","last_clean":"2024-09-11T14:36:24.165949+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:36:24.165949+0000","last_undegraded":"2024-09-11T14:36:24.165949+0000","last_fullsized":"2024-09-11T14:36:24.165949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"20'29","reported_seq":44,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.994766+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:36:22.994766+0000","last_peered":"2024-09-11T14:36:22.994766+0000","last_clean":"2024-09-11T14:36:22.994766+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:36:22.994766+0000","last_undegraded":"2024-09-11T14:36:22.994766+0000","last_fullsized":"2024-09-11T14:36:22.994766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"20'19","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.223612+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:36:23.223612+0000","last_peered":"2024-09-11T14:36:23.223612+0000","last_clean":"2024-09-11T14:36:23.223612+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:36:23.223612+0000","last_undegraded":"2024-09-11T14:36:23.223612+0000","last_fullsized":"2024-09-11T14:36:23.223612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"20'20","reported_seq":35,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.012137+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:36:23.012137+0000","last_peered":"2024-09-11T14:36:23.012137+0000","last_clean":"2024-09-11T14:36:23.012137+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:36:23.012137+0000","last_undegraded":"2024-09-11T14:36:23.012137+0000","last_fullsized":"2024-09-11T14:36:23.012137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":103,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.480973+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:36:23.480973+0000","last_peered":"2024-09-11T14:36:23.480973+0000","last_clean":"2024-09-11T14:36:23.480973+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:36:23.480973+0000","last_undegraded":"2024-09-11T14:36:23.480973+0000","last_fullsized":"2024-09-11T14:36:23.480973+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.465941+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:36:22.465941+0000","last_peered":"2024-09-11T14:36:22.465941+0000","last_clean":"2024-09-11T14:36:22.465941+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:36:22.465941+0000","last_undegraded":"2024-09-11T14:36:22.465941+0000","last_fullsized":"2024-09-11T14:36:22.465941+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'15","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.464853+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:36:22.464853+0000","last_peered":"2024-09-11T14:36:22.464853+0000","last_clean":"2024-09-11T14:36:22.464853+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:36:22.464853+0000","last_undegraded":"2024-09-11T14:36:22.464853+0000","last_fullsized":"2024-09-11T14:36:22.464853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.413256+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:36:22.413256+0000","last_peered":"2024-09-11T14:36:22.413256+0000","last_clean":"2024-09-11T14:36:22.413256+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:36:22.413256+0000","last_undegraded":"2024-09-11T14:36:22.413256+0000","last_fullsized":"2024-09-11T14:36:22.413256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"21'28","reported_seq":46,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T14:36:24.082402+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:36:24.082402+0000","last_peered":"2024-09-11T14:36:24.082402+0000","last_clean":"2024-09-11T14:36:24.082402+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:36:24.082402+0000","last_undegraded":"2024-09-11T14:36:24.082402+0000","last_fullsized":"2024-09-11T14:36:24.082402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.456761+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:36:22.456761+0000","last_peered":"2024-09-11T14:36:22.456761+0000","last_clean":"2024-09-11T14:36:22.456761+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:36:22.456761+0000","last_undegraded":"2024-09-11T14:36:22.456761+0000","last_fullsized":"2024-09-11T14:36:22.456761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"21'32","reported_seq":50,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.798972+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:36:23.798972+0000","last_peered":"2024-09-11T14:36:23.798972+0000","last_clean":"2024-09-11T14:36:23.798972+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:36:23.798972+0000","last_undegraded":"2024-09-11T14:36:23.798972+0000","last_fullsized":"2024-09-11T14:36:23.798972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.408784+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:36:22.408784+0000","last_peered":"2024-09-11T14:36:22.408784+0000","last_clean":"2024-09-11T14:36:22.408784+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:36:22.408784+0000","last_undegraded":"2024-09-11T14:36:22.408784+0000","last_fullsized":"2024-09-11T14:36:22.408784+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"20'28","reported_seq":43,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.175804+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:36:23.175804+0000","last_peered":"2024-09-11T14:36:23.175804+0000","last_clean":"2024-09-11T14:36:23.175804+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:36:23.175804+0000","last_undegraded":"2024-09-11T14:36:23.175804+0000","last_fullsized":"2024-09-11T14:36:23.175804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"20'27","reported_seq":42,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.970304+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:36:22.970304+0000","last_peered":"2024-09-11T14:36:22.970304+0000","last_clean":"2024-09-11T14:36:22.970304+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:36:22.970304+0000","last_undegraded":"2024-09-11T14:36:22.970304+0000","last_fullsized":"2024-09-11T14:36:22.970304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.544372+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:36:22.544372+0000","last_peered":"2024-09-11T14:36:22.544372+0000","last_clean":"2024-09-11T14:36:22.544372+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:36:22.544372+0000","last_undegraded":"2024-09-11T14:36:22.544372+0000","last_fullsized":"2024-09-11T14:36:22.544372+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"20'15","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.036137+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:36:23.036137+0000","last_peered":"2024-09-11T14:36:23.036137+0000","last_clean":"2024-09-11T14:36:23.036137+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:36:23.036137+0000","last_undegraded":"2024-09-11T14:36:23.036137+0000","last_fullsized":"2024-09-11T14:36:23.036137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T14:36:23.485812+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:23.485812+0000","last_peered":"2024-09-11T14:36:23.485812+0000","last_clean":"2024-09-11T14:36:23.485812+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:36:23.485812+0000","last_undegraded":"2024-09-11T14:36:23.485812+0000","last_fullsized":"2024-09-11T14:36:23.485812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"21'24","reported_seq":42,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T14:36:24.113372+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:36:24.113372+0000","last_peered":"2024-09-11T14:36:24.113372+0000","last_clean":"2024-09-11T14:36:24.113372+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:36:24.113372+0000","last_undegraded":"2024-09-11T14:36:24.113372+0000","last_fullsized":"2024-09-11T14:36:24.113372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.542578+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:22.542578+0000","last_peered":"2024-09-11T14:36:22.542578+0000","last_clean":"2024-09-11T14:36:22.542578+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:36:22.542578+0000","last_undegraded":"2024-09-11T14:36:22.542578+0000","last_fullsized":"2024-09-11T14:36:22.542578+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"20'23","reported_seq":38,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.659139+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:36:22.659139+0000","last_peered":"2024-09-11T14:36:22.659139+0000","last_clean":"2024-09-11T14:36:22.659139+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:36:22.659139+0000","last_undegraded":"2024-09-11T14:36:22.659139+0000","last_fullsized":"2024-09-11T14:36:22.659139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T14:36:22.462496+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:36:22.462496+0000","last_peered":"2024-09-11T14:36:22.462496+0000","last_clean":"2024-09-11T14:36:22.462496+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:36:22.462496+0000","last_undegraded":"2024-09-11T14:36:22.462496+0000","last_fullsized":"2024-09-11T14:36:22.462496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":22592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214065983488,"internally_reserved":0,"allocated":145510400,"data_stored":145510400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":353,"ondisk_log_size":353,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214065983488,"internally_reserved":0,"allocated":145510400,"data_stored":145510400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53504643072,"internally_reserved":0,"allocated":48230400,"data_stored":48230400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":37720,"kb_used_data":37720,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52260008,"statfs":{"total":53552873472,"available":53514248192,"internally_reserved":0,"allocated":38625280,"data_stored":38625280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705683,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24896,"kb_used_data":24896,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272832,"statfs":{"total":53552873472,"available":53527379968,"internally_reserved":0,"allocated":25493504,"data_stored":25493504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705683,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":23168,"kb_used_data":23168,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52274560,"statfs":{"total":53552873472,"available":53529149440,"internally_reserved":0,"allocated":23724032,"data_stored":23724032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705683,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24764,"kb_used_data":24764,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272964,"statfs":{"total":53552873472,"available":53527515136,"internally_reserved":0,"allocated":25358336,"data_stored":25358336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53504643072,"internally_reserved":0,"allocated":48230400,"data_stored":48230400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53523222528,"internally_reserved":0,"allocated":29650944,"data_stored":29650944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53518790656,"internally_reserved":0,"allocated":34082816,"data_stored":34082816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53519458304,"internally_reserved":0,"allocated":33415168,"data_stored":33415168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53504512000,"internally_reserved":0,"allocated":48361472,"data_stored":48361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53523222528,"internally_reserved":0,"allocated":29650944,"data_stored":29650944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53518790656,"internally_reserved":0,"allocated":34082816,"data_stored":34082816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53519458304,"internally_reserved":0,"allocated":33415168,"data_stored":33415168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53504512000,"internally_reserved":0,"allocated":48361472,"data_stored":48361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:36:27.445 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 8 16 697 681 5.31984 6 0.0708161 0.185542 2024-09-11T14:36:28.445 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 9 16 789 773 5.36757 5.75 0.102905 0.18428 2024-09-11T14:36:28.540 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:36:28.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:28.687+0000 7f9c8ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:28.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:28.694+0000 7f9c8ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:29.445 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 10 16 889 873 5.45576 6.25 0.0411409 0.181383 2024-09-11T14:36:30.445 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 11 16 988 972 5.52223 6.1875 0.169732 0.179417 2024-09-11T14:36:30.999 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:36:31.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:31.158+0000 7fc67ee5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:31.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:31.168+0000 7fc67ee5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:31.445 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 12 16 1081 1065 5.54638 5.8125 0.0992255 0.178632 2024-09-11T14:36:32.004 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:36:32.004 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:36:32.004 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:36:32.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:32.153+0000 7f9f43d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:32.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:32.163+0000 7f9f43d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:32.445 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 13 16 1188 1172 5.63411 6.6875 0.101148 0.175891 2024-09-11T14:36:32.486 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:36:32.486 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:36:32.511 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-09-11T14:36:31.221968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":53215795,"num_objects":807,"num_object_clones":0,"num_object_copies":2421,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":884,"num_write_kb":52500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":858,"ondisk_log_size":858,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":280664,"kb_used_data":280664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208910248,"statfs":{"total":214211493888,"available":213924093952,"internally_reserved":0,"allocated":287399936,"data_stored":287399936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":36700160,"num_objects":560,"num_object_clones":0,"num_object_copies":1680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.845702"},"pg_stats":[{"pgid":"3.f","version":"23'47","reported_seq":71,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:28.236947+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:36:28.236947+0000","last_peered":"2024-09-11T14:36:28.236947+0000","last_clean":"2024-09-11T14:36:28.236947+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:36:28.236947+0000","last_undegraded":"2024-09-11T14:36:28.236947+0000","last_fullsized":"2024-09-11T14:36:28.236947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'30","reported_seq":54,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:28.159466+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:36:28.159466+0000","last_peered":"2024-09-11T14:36:28.159466+0000","last_clean":"2024-09-11T14:36:28.159466+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:36:28.159466+0000","last_undegraded":"2024-09-11T14:36:28.159466+0000","last_fullsized":"2024-09-11T14:36:28.159466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'38","reported_seq":62,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:27.571619+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:36:27.571619+0000","last_peered":"2024-09-11T14:36:27.571619+0000","last_clean":"2024-09-11T14:36:27.571619+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:36:27.571619+0000","last_undegraded":"2024-09-11T14:36:27.571619+0000","last_fullsized":"2024-09-11T14:36:27.571619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'50","reported_seq":74,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:27.843914+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:36:27.843914+0000","last_peered":"2024-09-11T14:36:27.843914+0000","last_clean":"2024-09-11T14:36:27.843914+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:36:27.843914+0000","last_undegraded":"2024-09-11T14:36:27.843914+0000","last_fullsized":"2024-09-11T14:36:27.843914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'56","reported_seq":80,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:29.190646+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:36:29.190646+0000","last_peered":"2024-09-11T14:36:29.190646+0000","last_clean":"2024-09-11T14:36:29.190646+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:36:29.190646+0000","last_undegraded":"2024-09-11T14:36:29.190646+0000","last_fullsized":"2024-09-11T14:36:29.190646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'58","reported_seq":82,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:27.755226+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:36:27.755226+0000","last_peered":"2024-09-11T14:36:27.755226+0000","last_clean":"2024-09-11T14:36:27.755226+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:36:27.755226+0000","last_undegraded":"2024-09-11T14:36:27.755226+0000","last_fullsized":"2024-09-11T14:36:27.755226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'37","reported_seq":61,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:27.974471+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:36:27.974471+0000","last_peered":"2024-09-11T14:36:27.974471+0000","last_clean":"2024-09-11T14:36:27.974471+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:36:27.974471+0000","last_undegraded":"2024-09-11T14:36:27.974471+0000","last_fullsized":"2024-09-11T14:36:27.974471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'42","reported_seq":66,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:27.497607+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:36:27.497607+0000","last_peered":"2024-09-11T14:36:27.497607+0000","last_clean":"2024-09-11T14:36:27.497607+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:36:27.497607+0000","last_undegraded":"2024-09-11T14:36:27.497607+0000","last_fullsized":"2024-09-11T14:36:27.497607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.625560+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:36:25.625560+0000","last_peered":"2024-09-11T14:36:25.625560+0000","last_clean":"2024-09-11T14:36:25.625560+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:36:25.625560+0000","last_undegraded":"2024-09-11T14:36:25.625560+0000","last_fullsized":"2024-09-11T14:36:25.625560+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.463304+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:36:25.463304+0000","last_peered":"2024-09-11T14:36:25.463304+0000","last_clean":"2024-09-11T14:36:25.463304+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:36:25.463304+0000","last_undegraded":"2024-09-11T14:36:25.463304+0000","last_fullsized":"2024-09-11T14:36:25.463304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'43","reported_seq":67,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:28.119258+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:36:28.119258+0000","last_peered":"2024-09-11T14:36:28.119258+0000","last_clean":"2024-09-11T14:36:28.119258+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:36:28.119258+0000","last_undegraded":"2024-09-11T14:36:28.119258+0000","last_fullsized":"2024-09-11T14:36:28.119258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:26.917817+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:36:26.917817+0000","last_peered":"2024-09-11T14:36:26.917817+0000","last_clean":"2024-09-11T14:36:26.917817+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:36:26.917817+0000","last_undegraded":"2024-09-11T14:36:26.917817+0000","last_fullsized":"2024-09-11T14:36:26.917817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'73","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:29.160317+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:36:29.160317+0000","last_peered":"2024-09-11T14:36:29.160317+0000","last_clean":"2024-09-11T14:36:29.160317+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:36:29.160317+0000","last_undegraded":"2024-09-11T14:36:29.160317+0000","last_fullsized":"2024-09-11T14:36:29.160317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.452119+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:36:25.452119+0000","last_peered":"2024-09-11T14:36:25.452119+0000","last_clean":"2024-09-11T14:36:25.452119+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:36:25.452119+0000","last_undegraded":"2024-09-11T14:36:25.452119+0000","last_fullsized":"2024-09-11T14:36:25.452119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'62","reported_seq":86,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:29.222161+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:36:29.222161+0000","last_peered":"2024-09-11T14:36:29.222161+0000","last_clean":"2024-09-11T14:36:29.222161+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:36:29.222161+0000","last_undegraded":"2024-09-11T14:36:29.222161+0000","last_fullsized":"2024-09-11T14:36:29.222161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:26.906262+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:36:26.906262+0000","last_peered":"2024-09-11T14:36:26.906262+0000","last_clean":"2024-09-11T14:36:26.906262+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:36:26.906262+0000","last_undegraded":"2024-09-11T14:36:26.906262+0000","last_fullsized":"2024-09-11T14:36:26.906262+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'55","reported_seq":79,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:28.148528+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:36:28.148528+0000","last_peered":"2024-09-11T14:36:28.148528+0000","last_clean":"2024-09-11T14:36:28.148528+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:36:28.148528+0000","last_undegraded":"2024-09-11T14:36:28.148528+0000","last_fullsized":"2024-09-11T14:36:28.148528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'63","reported_seq":87,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:28.144117+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:36:28.144117+0000","last_peered":"2024-09-11T14:36:28.144117+0000","last_clean":"2024-09-11T14:36:28.144117+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:36:28.144117+0000","last_undegraded":"2024-09-11T14:36:28.144117+0000","last_fullsized":"2024-09-11T14:36:28.144117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.472487+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:36:25.472487+0000","last_peered":"2024-09-11T14:36:25.472487+0000","last_clean":"2024-09-11T14:36:25.472487+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:36:25.472487+0000","last_undegraded":"2024-09-11T14:36:25.472487+0000","last_fullsized":"2024-09-11T14:36:25.472487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'42","reported_seq":66,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:27.846257+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:36:27.846257+0000","last_peered":"2024-09-11T14:36:27.846257+0000","last_clean":"2024-09-11T14:36:27.846257+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:36:27.846257+0000","last_undegraded":"2024-09-11T14:36:27.846257+0000","last_fullsized":"2024-09-11T14:36:27.846257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.631530+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:25.631530+0000","last_peered":"2024-09-11T14:36:25.631530+0000","last_clean":"2024-09-11T14:36:25.631530+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:36:25.631530+0000","last_undegraded":"2024-09-11T14:36:25.631530+0000","last_fullsized":"2024-09-11T14:36:25.631530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'49","reported_seq":73,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:29.177192+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:36:29.177192+0000","last_peered":"2024-09-11T14:36:29.177192+0000","last_clean":"2024-09-11T14:36:29.177192+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:36:29.177192+0000","last_undegraded":"2024-09-11T14:36:29.177192+0000","last_fullsized":"2024-09-11T14:36:29.177192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.468522+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:25.468522+0000","last_peered":"2024-09-11T14:36:25.468522+0000","last_clean":"2024-09-11T14:36:25.468522+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:36:25.468522+0000","last_undegraded":"2024-09-11T14:36:25.468522+0000","last_fullsized":"2024-09-11T14:36:25.468522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'58","reported_seq":82,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:28.319051+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:36:28.319051+0000","last_peered":"2024-09-11T14:36:28.319051+0000","last_clean":"2024-09-11T14:36:28.319051+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:36:28.319051+0000","last_undegraded":"2024-09-11T14:36:28.319051+0000","last_fullsized":"2024-09-11T14:36:28.319051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.459083+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:36:25.459083+0000","last_peered":"2024-09-11T14:36:25.459083+0000","last_clean":"2024-09-11T14:36:25.459083+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:36:25.459083+0000","last_undegraded":"2024-09-11T14:36:25.459083+0000","last_fullsized":"2024-09-11T14:36:25.459083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":52625408,"num_objects":803,"num_object_clones":0,"num_object_copies":2409,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":51392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213886676992,"internally_reserved":0,"allocated":324816896,"data_stored":324816896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":803,"ondisk_log_size":803,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213886808064,"internally_reserved":0,"allocated":324685824,"data_stored":324685824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53450076160,"internally_reserved":0,"allocated":102797312,"data_stored":102797312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":88600,"kb_used_data":88600,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52209128,"statfs":{"total":53552873472,"available":53462147072,"internally_reserved":0,"allocated":90726400,"data_stored":90726400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705688,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":64060,"kb_used_data":64060,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52233668,"statfs":{"total":53552873472,"available":53487276032,"internally_reserved":0,"allocated":65597440,"data_stored":65597440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705688,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61540,"kb_used_data":61540,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236188,"statfs":{"total":53552873472,"available":53489856512,"internally_reserved":0,"allocated":63016960,"data_stored":63016960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705688,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":66464,"kb_used_data":66464,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52231264,"statfs":{"total":53552873472,"available":53484814336,"internally_reserved":0,"allocated":68059136,"data_stored":68059136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53450076160,"internally_reserved":0,"allocated":102797312,"data_stored":102797312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53481439232,"internally_reserved":0,"allocated":71434240,"data_stored":71434240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53475803136,"internally_reserved":0,"allocated":77070336,"data_stored":77070336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53479489536,"internally_reserved":0,"allocated":73383936,"data_stored":73383936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53450076160,"internally_reserved":0,"allocated":102797312,"data_stored":102797312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53481308160,"internally_reserved":0,"allocated":71565312,"data_stored":71565312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53475803136,"internally_reserved":0,"allocated":77070336,"data_stored":77070336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53479489536,"internally_reserved":0,"allocated":73383936,"data_stored":73383936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53450076160,"internally_reserved":0,"allocated":102797312,"data_stored":102797312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:36:33.445 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 14 16 1285 1269 5.66467 6.0625 0.0824393 0.174385 2024-09-11T14:36:33.731 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:36:33.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:33.850+0000 7ffbb42d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:33.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:33.857+0000 7ffbb42d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:34.445 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 15 16 1365 1349 5.62033 5 0.0408036 0.175691 2024-09-11T14:36:35.445 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 16 16 1462 1446 5.64793 6.0625 0.0684741 0.17526 2024-09-11T14:36:36.117 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:36:36.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:36.269+0000 7f8059ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:36.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:36.276+0000 7f8059ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:36.445 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 17 16 1564 1548 5.69066 6.375 0.125911 0.174623 2024-09-11T14:36:37.446 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 18 16 1667 1651 5.73212 6.4375 0.0730087 0.173526 2024-09-11T14:36:37.512 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:36:37.512 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:36:37.513 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:36:37.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:37.673+0000 7fd0f2abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:37.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:37.683+0000 7fd0f2abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:38.026 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:36:38.027 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:36:38.049 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-09-11T14:36:37.223233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":84935219,"num_objects":1291,"num_object_clones":0,"num_object_copies":3873,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1368,"num_write_kb":83476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1342,"ondisk_log_size":1342,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":471400,"kb_used_data":471400,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208719512,"statfs":{"total":214211493888,"available":213728780288,"internally_reserved":0,"allocated":482713600,"data_stored":482713600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":61210624,"num_objects":934,"num_object_clones":0,"num_object_copies":2802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":934,"num_write_kb":59776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.831615"},"pg_stats":[{"pgid":"3.f","version":"23'83","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:32.826262+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:36:32.826262+0000","last_peered":"2024-09-11T14:36:32.826262+0000","last_clean":"2024-09-11T14:36:32.826262+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:36:32.826262+0000","last_undegraded":"2024-09-11T14:36:32.826262+0000","last_fullsized":"2024-09-11T14:36:32.826262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'63","reported_seq":87,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:33.073057+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:36:33.073057+0000","last_peered":"2024-09-11T14:36:33.073057+0000","last_clean":"2024-09-11T14:36:33.073057+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:36:33.073057+0000","last_undegraded":"2024-09-11T14:36:33.073057+0000","last_fullsized":"2024-09-11T14:36:33.073057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'65","reported_seq":89,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:32.965334+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:36:32.965334+0000","last_peered":"2024-09-11T14:36:32.965334+0000","last_clean":"2024-09-11T14:36:32.965334+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:36:32.965334+0000","last_undegraded":"2024-09-11T14:36:32.965334+0000","last_fullsized":"2024-09-11T14:36:32.965334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'77","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:33.296986+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:36:33.296986+0000","last_peered":"2024-09-11T14:36:33.296986+0000","last_clean":"2024-09-11T14:36:33.296986+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:36:33.296986+0000","last_undegraded":"2024-09-11T14:36:33.296986+0000","last_fullsized":"2024-09-11T14:36:33.296986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'84","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:34.130368+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:36:34.130368+0000","last_peered":"2024-09-11T14:36:34.130368+0000","last_clean":"2024-09-11T14:36:34.130368+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:36:34.130368+0000","last_undegraded":"2024-09-11T14:36:34.130368+0000","last_fullsized":"2024-09-11T14:36:34.130368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'89","reported_seq":113,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:33.036313+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:36:33.036313+0000","last_peered":"2024-09-11T14:36:33.036313+0000","last_clean":"2024-09-11T14:36:33.036313+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:36:33.036313+0000","last_undegraded":"2024-09-11T14:36:33.036313+0000","last_fullsized":"2024-09-11T14:36:33.036313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'76","reported_seq":100,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:33.023086+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:36:33.023086+0000","last_peered":"2024-09-11T14:36:33.023086+0000","last_clean":"2024-09-11T14:36:33.023086+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:36:33.023086+0000","last_undegraded":"2024-09-11T14:36:33.023086+0000","last_fullsized":"2024-09-11T14:36:33.023086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'74","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:32.915200+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:36:32.915200+0000","last_peered":"2024-09-11T14:36:32.915200+0000","last_clean":"2024-09-11T14:36:32.915200+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:36:32.915200+0000","last_undegraded":"2024-09-11T14:36:32.915200+0000","last_fullsized":"2024-09-11T14:36:32.915200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.625560+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:36:25.625560+0000","last_peered":"2024-09-11T14:36:25.625560+0000","last_clean":"2024-09-11T14:36:25.625560+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:36:25.625560+0000","last_undegraded":"2024-09-11T14:36:25.625560+0000","last_fullsized":"2024-09-11T14:36:25.625560+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.463304+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:36:25.463304+0000","last_peered":"2024-09-11T14:36:25.463304+0000","last_clean":"2024-09-11T14:36:25.463304+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:36:25.463304+0000","last_undegraded":"2024-09-11T14:36:25.463304+0000","last_fullsized":"2024-09-11T14:36:25.463304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'80","reported_seq":104,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:33.167866+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:36:33.167866+0000","last_peered":"2024-09-11T14:36:33.167866+0000","last_clean":"2024-09-11T14:36:33.167866+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:36:33.167866+0000","last_undegraded":"2024-09-11T14:36:33.167866+0000","last_fullsized":"2024-09-11T14:36:33.167866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:26.917817+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:36:26.917817+0000","last_peered":"2024-09-11T14:36:26.917817+0000","last_clean":"2024-09-11T14:36:26.917817+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:36:26.917817+0000","last_undegraded":"2024-09-11T14:36:26.917817+0000","last_fullsized":"2024-09-11T14:36:26.917817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'95","reported_seq":119,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:33.250876+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:36:33.250876+0000","last_peered":"2024-09-11T14:36:33.250876+0000","last_clean":"2024-09-11T14:36:33.250876+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:36:33.250876+0000","last_undegraded":"2024-09-11T14:36:33.250876+0000","last_fullsized":"2024-09-11T14:36:33.250876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.452119+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:36:25.452119+0000","last_peered":"2024-09-11T14:36:25.452119+0000","last_clean":"2024-09-11T14:36:25.452119+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:36:25.452119+0000","last_undegraded":"2024-09-11T14:36:25.452119+0000","last_fullsized":"2024-09-11T14:36:25.452119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'90","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:34.160473+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:36:34.160473+0000","last_peered":"2024-09-11T14:36:34.160473+0000","last_clean":"2024-09-11T14:36:34.160473+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:36:34.160473+0000","last_undegraded":"2024-09-11T14:36:34.160473+0000","last_fullsized":"2024-09-11T14:36:34.160473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:26.906262+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:36:26.906262+0000","last_peered":"2024-09-11T14:36:26.906262+0000","last_clean":"2024-09-11T14:36:26.906262+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:36:26.906262+0000","last_undegraded":"2024-09-11T14:36:26.906262+0000","last_fullsized":"2024-09-11T14:36:26.906262+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'88","reported_seq":112,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:32.747174+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:36:32.747174+0000","last_peered":"2024-09-11T14:36:32.747174+0000","last_clean":"2024-09-11T14:36:32.747174+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:36:32.747174+0000","last_undegraded":"2024-09-11T14:36:32.747174+0000","last_fullsized":"2024-09-11T14:36:32.747174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'84","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:33.222107+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:36:33.222107+0000","last_peered":"2024-09-11T14:36:33.222107+0000","last_clean":"2024-09-11T14:36:33.222107+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:36:33.222107+0000","last_undegraded":"2024-09-11T14:36:33.222107+0000","last_fullsized":"2024-09-11T14:36:33.222107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.472487+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:36:25.472487+0000","last_peered":"2024-09-11T14:36:25.472487+0000","last_clean":"2024-09-11T14:36:25.472487+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:36:25.472487+0000","last_undegraded":"2024-09-11T14:36:25.472487+0000","last_fullsized":"2024-09-11T14:36:25.472487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'70","reported_seq":94,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:33.110836+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:36:33.110836+0000","last_peered":"2024-09-11T14:36:33.110836+0000","last_clean":"2024-09-11T14:36:33.110836+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:36:33.110836+0000","last_undegraded":"2024-09-11T14:36:33.110836+0000","last_fullsized":"2024-09-11T14:36:33.110836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.631530+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:25.631530+0000","last_peered":"2024-09-11T14:36:25.631530+0000","last_clean":"2024-09-11T14:36:25.631530+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:36:25.631530+0000","last_undegraded":"2024-09-11T14:36:25.631530+0000","last_fullsized":"2024-09-11T14:36:25.631530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'86","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:33.735221+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:36:33.735221+0000","last_peered":"2024-09-11T14:36:33.735221+0000","last_clean":"2024-09-11T14:36:33.735221+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:36:33.735221+0000","last_undegraded":"2024-09-11T14:36:33.735221+0000","last_fullsized":"2024-09-11T14:36:33.735221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.468522+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:25.468522+0000","last_peered":"2024-09-11T14:36:25.468522+0000","last_clean":"2024-09-11T14:36:25.468522+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:36:25.468522+0000","last_undegraded":"2024-09-11T14:36:25.468522+0000","last_fullsized":"2024-09-11T14:36:25.468522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'83","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:33.027285+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:36:33.027285+0000","last_peered":"2024-09-11T14:36:33.027285+0000","last_clean":"2024-09-11T14:36:33.027285+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:36:33.027285+0000","last_undegraded":"2024-09-11T14:36:33.027285+0000","last_fullsized":"2024-09-11T14:36:33.027285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.459083+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:36:25.459083+0000","last_peered":"2024-09-11T14:36:25.459083+0000","last_clean":"2024-09-11T14:36:25.459083+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:36:25.459083+0000","last_undegraded":"2024-09-11T14:36:25.459083+0000","last_fullsized":"2024-09-11T14:36:25.459083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":84344832,"num_objects":1287,"num_object_clones":0,"num_object_copies":3861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1287,"num_write_kb":82368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213693087744,"internally_reserved":0,"allocated":518406144,"data_stored":518406144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1287,"ondisk_log_size":1287,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213693480960,"internally_reserved":0,"allocated":518012928,"data_stored":518012928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53396045824,"internally_reserved":0,"allocated":156827648,"data_stored":156827648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":144284,"kb_used_data":144284,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52153444,"statfs":{"total":53552873472,"available":53405126656,"internally_reserved":0,"allocated":147746816,"data_stored":147746816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705693,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":105236,"kb_used_data":105236,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52192492,"statfs":{"total":53552873472,"available":53445111808,"internally_reserved":0,"allocated":107761664,"data_stored":107761664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":107772,"kb_used_data":107772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52189956,"statfs":{"total":53552873472,"available":53442514944,"internally_reserved":0,"allocated":110358528,"data_stored":110358528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705693,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":114108,"kb_used_data":114108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52183620,"statfs":{"total":53552873472,"available":53436026880,"internally_reserved":0,"allocated":116846592,"data_stored":116846592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53396045824,"internally_reserved":0,"allocated":156827648,"data_stored":156827648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53434200064,"internally_reserved":0,"allocated":118673408,"data_stored":118673408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53425364992,"internally_reserved":0,"allocated":127508480,"data_stored":127508480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53437870080,"internally_reserved":0,"allocated":115003392,"data_stored":115003392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53396045824,"internally_reserved":0,"allocated":156827648,"data_stored":156827648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53434068992,"internally_reserved":0,"allocated":118804480,"data_stored":118804480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53425233920,"internally_reserved":0,"allocated":127639552,"data_stored":127639552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53437739008,"internally_reserved":0,"allocated":115134464,"data_stored":115134464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53396045824,"internally_reserved":0,"allocated":156827648,"data_stored":156827648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:36:38.446 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 19 16 1779 1763 5.79882 7 0.139554 0.171696 2024-09-11T14:36:38.659 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:36:38.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:38.793+0000 7f1781afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:38.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:38.802+0000 7f1781afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:39.446 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:36:39.445777+0000 min lat: 0.0263873 max lat: 1.56321 avg lat: 0.170965 2024-09-11T14:36:39.446 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:36:39.446 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 20 16 1879 1863 5.82135 6.25 0.0851951 0.170965 2024-09-11T14:36:40.446 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 21 15 1984 1969 5.85959 6.625 0.164712 0.16996 2024-09-11T14:36:41.180 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:36:41.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:41.337+0000 7fad4af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:41.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:41.345+0000 7fad4af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:41.446 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 22 16 2087 2071 5.88299 6.375 0.225609 0.169309 2024-09-11T14:36:42.446 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 23 16 2196 2180 5.92338 6.8125 0.221698 0.168224 2024-09-11T14:36:43.051 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:36:43.051 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:36:43.052 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:36:43.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:43.187+0000 7f154eafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:43.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:43.200+0000 7f154eafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:43.446 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 24 16 2303 2287 5.95519 6.6875 0.117931 0.167454 2024-09-11T14:36:43.532 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:36:43.532 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:36:43.550 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-11T14:36:43.224572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":118293043,"num_objects":1800,"num_object_clones":0,"num_object_copies":5400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1877,"num_write_kb":116052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1851,"ondisk_log_size":1851,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":658012,"kb_used_data":658012,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208532900,"statfs":{"total":214211493888,"available":213537689600,"internally_reserved":0,"allocated":673804288,"data_stored":673804288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":65077248,"num_objects":993,"num_object_clones":0,"num_object_copies":2979,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":993,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002604"},"pg_stats":[{"pgid":"3.f","version":"23'124","reported_seq":148,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:38.073012+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:36:38.073012+0000","last_peered":"2024-09-11T14:36:38.073012+0000","last_clean":"2024-09-11T14:36:38.073012+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:36:38.073012+0000","last_undegraded":"2024-09-11T14:36:38.073012+0000","last_fullsized":"2024-09-11T14:36:38.073012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'84","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:38.181686+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:36:38.181686+0000","last_peered":"2024-09-11T14:36:38.181686+0000","last_clean":"2024-09-11T14:36:38.181686+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:36:38.181686+0000","last_undegraded":"2024-09-11T14:36:38.181686+0000","last_fullsized":"2024-09-11T14:36:38.181686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'90","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:38.274842+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:36:38.274842+0000","last_peered":"2024-09-11T14:36:38.274842+0000","last_clean":"2024-09-11T14:36:38.274842+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:36:38.274842+0000","last_undegraded":"2024-09-11T14:36:38.274842+0000","last_fullsized":"2024-09-11T14:36:38.274842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'113","reported_seq":137,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:38.224732+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:36:38.224732+0000","last_peered":"2024-09-11T14:36:38.224732+0000","last_clean":"2024-09-11T14:36:38.224732+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:36:38.224732+0000","last_undegraded":"2024-09-11T14:36:38.224732+0000","last_fullsized":"2024-09-11T14:36:38.224732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'130","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:39.073017+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:36:39.073017+0000","last_peered":"2024-09-11T14:36:39.073017+0000","last_clean":"2024-09-11T14:36:39.073017+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:36:39.073017+0000","last_undegraded":"2024-09-11T14:36:39.073017+0000","last_fullsized":"2024-09-11T14:36:39.073017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'123","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:38.137464+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:36:38.137464+0000","last_peered":"2024-09-11T14:36:38.137464+0000","last_clean":"2024-09-11T14:36:38.137464+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:36:38.137464+0000","last_undegraded":"2024-09-11T14:36:38.137464+0000","last_fullsized":"2024-09-11T14:36:38.137464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'112","reported_seq":136,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:38.050205+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:36:38.050205+0000","last_peered":"2024-09-11T14:36:38.050205+0000","last_clean":"2024-09-11T14:36:38.050205+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:36:38.050205+0000","last_undegraded":"2024-09-11T14:36:38.050205+0000","last_fullsized":"2024-09-11T14:36:38.050205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'102","reported_seq":126,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:38.135612+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:36:38.135612+0000","last_peered":"2024-09-11T14:36:38.135612+0000","last_clean":"2024-09-11T14:36:38.135612+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:36:38.135612+0000","last_undegraded":"2024-09-11T14:36:38.135612+0000","last_fullsized":"2024-09-11T14:36:38.135612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":6528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.625560+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:36:25.625560+0000","last_peered":"2024-09-11T14:36:25.625560+0000","last_clean":"2024-09-11T14:36:25.625560+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:36:25.625560+0000","last_undegraded":"2024-09-11T14:36:25.625560+0000","last_fullsized":"2024-09-11T14:36:25.625560+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.463304+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:36:25.463304+0000","last_peered":"2024-09-11T14:36:25.463304+0000","last_clean":"2024-09-11T14:36:25.463304+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:36:25.463304+0000","last_undegraded":"2024-09-11T14:36:25.463304+0000","last_fullsized":"2024-09-11T14:36:25.463304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'112","reported_seq":136,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:38.086804+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:36:38.086804+0000","last_peered":"2024-09-11T14:36:38.086804+0000","last_clean":"2024-09-11T14:36:38.086804+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:36:38.086804+0000","last_undegraded":"2024-09-11T14:36:38.086804+0000","last_fullsized":"2024-09-11T14:36:38.086804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:26.917817+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:36:26.917817+0000","last_peered":"2024-09-11T14:36:26.917817+0000","last_clean":"2024-09-11T14:36:26.917817+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:36:26.917817+0000","last_undegraded":"2024-09-11T14:36:26.917817+0000","last_fullsized":"2024-09-11T14:36:26.917817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'131","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:39.259529+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:36:39.259529+0000","last_peered":"2024-09-11T14:36:39.259529+0000","last_clean":"2024-09-11T14:36:39.259529+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:36:39.259529+0000","last_undegraded":"2024-09-11T14:36:39.259529+0000","last_fullsized":"2024-09-11T14:36:39.259529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.452119+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:36:25.452119+0000","last_peered":"2024-09-11T14:36:25.452119+0000","last_clean":"2024-09-11T14:36:25.452119+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:36:25.452119+0000","last_undegraded":"2024-09-11T14:36:25.452119+0000","last_fullsized":"2024-09-11T14:36:25.452119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'116","reported_seq":140,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:38.974616+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:36:38.974616+0000","last_peered":"2024-09-11T14:36:38.974616+0000","last_clean":"2024-09-11T14:36:38.974616+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:36:38.974616+0000","last_undegraded":"2024-09-11T14:36:38.974616+0000","last_fullsized":"2024-09-11T14:36:38.974616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602176,"num_objects":116,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":7424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:26.906262+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:36:26.906262+0000","last_peered":"2024-09-11T14:36:26.906262+0000","last_clean":"2024-09-11T14:36:26.906262+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:36:26.906262+0000","last_undegraded":"2024-09-11T14:36:26.906262+0000","last_fullsized":"2024-09-11T14:36:26.906262+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'109","reported_seq":133,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:38.084371+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:36:38.084371+0000","last_peered":"2024-09-11T14:36:38.084371+0000","last_clean":"2024-09-11T14:36:38.084371+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:36:38.084371+0000","last_undegraded":"2024-09-11T14:36:38.084371+0000","last_fullsized":"2024-09-11T14:36:38.084371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":6976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'119","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:38.028136+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:36:38.028136+0000","last_peered":"2024-09-11T14:36:38.028136+0000","last_clean":"2024-09-11T14:36:38.028136+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:36:38.028136+0000","last_undegraded":"2024-09-11T14:36:38.028136+0000","last_fullsized":"2024-09-11T14:36:38.028136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.472487+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:36:25.472487+0000","last_peered":"2024-09-11T14:36:25.472487+0000","last_clean":"2024-09-11T14:36:25.472487+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:36:25.472487+0000","last_undegraded":"2024-09-11T14:36:25.472487+0000","last_fullsized":"2024-09-11T14:36:25.472487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'103","reported_seq":127,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:37.616044+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:36:37.616044+0000","last_peered":"2024-09-11T14:36:37.616044+0000","last_clean":"2024-09-11T14:36:37.616044+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:36:37.616044+0000","last_undegraded":"2024-09-11T14:36:37.616044+0000","last_fullsized":"2024-09-11T14:36:37.616044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750208,"num_objects":103,"num_object_clones":0,"num_object_copies":309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":6592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.631530+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:25.631530+0000","last_peered":"2024-09-11T14:36:25.631530+0000","last_clean":"2024-09-11T14:36:25.631530+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:36:25.631530+0000","last_undegraded":"2024-09-11T14:36:25.631530+0000","last_fullsized":"2024-09-11T14:36:25.631530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'117","reported_seq":141,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:39.278937+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:36:39.278937+0000","last_peered":"2024-09-11T14:36:39.278937+0000","last_clean":"2024-09-11T14:36:39.278937+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:36:39.278937+0000","last_undegraded":"2024-09-11T14:36:39.278937+0000","last_fullsized":"2024-09-11T14:36:39.278937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.468522+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:25.468522+0000","last_peered":"2024-09-11T14:36:25.468522+0000","last_clean":"2024-09-11T14:36:25.468522+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:36:25.468522+0000","last_undegraded":"2024-09-11T14:36:25.468522+0000","last_fullsized":"2024-09-11T14:36:25.468522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'111","reported_seq":135,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:37.648447+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:36:37.648447+0000","last_peered":"2024-09-11T14:36:37.648447+0000","last_clean":"2024-09-11T14:36:37.648447+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:36:37.648447+0000","last_undegraded":"2024-09-11T14:36:37.648447+0000","last_fullsized":"2024-09-11T14:36:37.648447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.459083+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:36:25.459083+0000","last_peered":"2024-09-11T14:36:25.459083+0000","last_clean":"2024-09-11T14:36:25.459083+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:36:25.459083+0000","last_undegraded":"2024-09-11T14:36:25.459083+0000","last_fullsized":"2024-09-11T14:36:25.459083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":117702656,"num_objects":1796,"num_object_clones":0,"num_object_copies":5388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1796,"num_write_kb":114944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213495525376,"internally_reserved":0,"allocated":715968512,"data_stored":715968512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1796,"ondisk_log_size":1796,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213495656448,"internally_reserved":0,"allocated":715837440,"data_stored":715837440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53338722304,"internally_reserved":0,"allocated":214151168,"data_stored":214151168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":197972,"kb_used_data":197972,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52099756,"statfs":{"total":53552873472,"available":53350150144,"internally_reserved":0,"allocated":202723328,"data_stored":202723328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705698,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":147608,"kb_used_data":147608,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52150120,"statfs":{"total":53552873472,"available":53401722880,"internally_reserved":0,"allocated":151150592,"data_stored":151150592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":151500,"kb_used_data":151500,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52146228,"statfs":{"total":53552873472,"available":53397737472,"internally_reserved":0,"allocated":155136000,"data_stored":155136000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705698,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":160932,"kb_used_data":160932,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52136796,"statfs":{"total":53552873472,"available":53388079104,"internally_reserved":0,"allocated":164794368,"data_stored":164794368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53338722304,"internally_reserved":0,"allocated":214151168,"data_stored":214151168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53387972608,"internally_reserved":0,"allocated":164900864,"data_stored":164900864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53377646592,"internally_reserved":0,"allocated":175226880,"data_stored":175226880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53391314944,"internally_reserved":0,"allocated":161558528,"data_stored":161558528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53338722304,"internally_reserved":0,"allocated":214151168,"data_stored":214151168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53387972608,"internally_reserved":0,"allocated":164900864,"data_stored":164900864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53377646592,"internally_reserved":0,"allocated":175226880,"data_stored":175226880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53391314944,"internally_reserved":0,"allocated":161558528,"data_stored":161558528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53338591232,"internally_reserved":0,"allocated":214282240,"data_stored":214282240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:36:43.816 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:36:43.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:43.959+0000 7f28b809c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:43.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:43.967+0000 7f28b809c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:44.446 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 25 16 2400 2384 5.95946 6.0625 0.250682 0.167109 2024-09-11T14:36:45.446 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 26 16 2509 2493 5.99225 6.8125 0.225705 0.166362 2024-09-11T14:36:46.268 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:36:46.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:46.408+0000 7f775dcc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:46.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:46.416+0000 7f775dcc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:46.446 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 27 16 2608 2592 5.99945 6.1875 0.179458 0.166171 2024-09-11T14:36:47.446 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 28 16 2706 2690 6.00392 6.125 0.071221 0.165896 2024-09-11T14:36:48.446 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 29 16 2818 2802 6.03825 7 0.218234 0.165194 2024-09-11T14:36:48.552 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:36:48.553 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:36:48.553 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:36:48.553 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:36:48.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:48.689+0000 7f9324d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:48.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:48.703+0000 7f9324d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:48.802 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:36:48.802 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:36:48.802 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:36:48.802 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:36:48.802 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:36:48.802 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:36:48.802 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:36:48.802 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:36:48.802 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:36:48.802 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:36:48.802 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:36:48.802 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:36:48.805 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:36:48.806 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:36:48.806 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:36:48.807 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:36:48.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:48.960+0000 7f4bad711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:48.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:48.968+0000 7f4bad711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:49.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:49.024+0000 7f3936391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:49.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:49.042+0000 7f3936391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:49.098 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:36:49.098 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:36:49.098 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:36:49.098 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:36:49.098 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:36:49.098 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:36:49.099 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:36:49.099 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:36:49.099 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:36:49.099 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:36:49.099 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:36:49.099 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:36:49.101 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:36:49.101 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:36:49.101 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:36:49.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:49.261+0000 7fc787591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:49.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:49.276+0000 7fc787591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:49.305 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:36:49.306 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:36:49.306 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:36:49.306 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:36:49.306 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:36:49.306 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:36:49.306 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:36:49.306 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:36:49.306 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:36:49.306 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:36:49.306 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:36:49.306 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:36:49.312 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:36:49.312 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:36:49.312 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:36:49.447 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 30 16 2915 2899 6.03903 6.0625 0.122455 0.164924 2024-09-11T14:36:49.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:49.455+0000 7f9cd2591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:49.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:49.469+0000 7f9cd2591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:49.520 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:36:49.520 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:36:49.520 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:36:49.520 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:36:49.520 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:36:49.520 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:36:49.520 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:36:49.521 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:36:49.521 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:36:49.521 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:36:49.521 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:36:49.521 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:36:49.523 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:36:49.523 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:36:50.447 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 31 16 3004 2988 6.02365 5.5625 0.172874 0.165322 2024-09-11T14:36:51.344 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:36:51.447 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 32 16 3107 3091 6.03656 6.4375 0.192164 0.165092 2024-09-11T14:36:51.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:51.489+0000 7f593e511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:51.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:51.500+0000 7f593e511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:52.447 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 33 16 3208 3192 6.04491 6.3125 0.060092 0.164791 2024-09-11T14:36:53.447 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 34 16 3316 3300 6.06563 6.75 0.0979402 0.164423 2024-09-11T14:36:53.779 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:36:53.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:53.914+0000 7fbe4a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:53.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:53.920+0000 7fbe4a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:54.447 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 35 16 3397 3381 6.03695 5.0625 0.132004 0.164941 2024-09-11T14:36:54.524 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:36:54.524 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:36:54.524 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:36:54.524 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:36:54.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:54.671+0000 7fb65c293640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:54.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:54.683+0000 7fb65c293640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:54.843 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:36:54.843 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:36:54.843 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:36:54.843 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:36:54.843 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:36:54.843 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:36:54.843 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:36:54.843 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:36:54.843 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:36:54.843 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:36:54.844 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:36:54.844 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:36:54.846 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:36:54.846 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:36:54.846 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:36:55.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:54.997+0000 7f812ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:55.009+0000 7f812ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:55.031 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:36:55.032 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:36:55.032 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:36:55.032 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:36:55.032 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:36:55.032 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:36:55.032 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:36:55.032 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:36:55.032 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:36:55.032 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:36:55.032 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:36:55.032 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:36:55.037 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:36:55.038 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:36:55.038 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:36:55.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:55.207+0000 7fa73e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:55.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:55.221+0000 7fa73e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:36:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:36:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:36:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:36:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:36:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:36:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:36:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:36:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:36:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:36:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:36:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:36:55.319 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:36:55.320 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:36:55.320 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:36:55.447 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 36 16 3494 3478 6.03765 6.0625 0.0723315 0.164967 2024-09-11T14:36:55.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:55.462+0000 7f0947ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:55.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:55.475+0000 7f0947ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:55.549 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:36:55.551 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:36:55.552 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:36:55.552 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:36:55.552 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:36:55.552 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:36:55.552 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:36:55.552 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:36:55.552 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:36:55.552 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:36:55.552 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:36:55.552 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:36:55.553 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:36:55.554 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:36:56.215 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:36:56.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:56.373+0000 7f36e2751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:56.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:56.381+0000 7f36e2751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:56.448 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 37 16 3602 3586 6.05688 6.75 0.128431 0.164757 2024-09-11T14:36:57.447 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 38 16 3710 3694 6.0751 6.75 0.0883885 0.164211 2024-09-11T14:36:58.448 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 39 16 3807 3791 6.07477 6.0625 0.0745734 0.163933 2024-09-11T14:36:58.915 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:36:59.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:59.064+0000 7ff0ea191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:59.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:36:59.070+0000 7ff0ea191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:59.448 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:36:59.447623+0000 min lat: 0.0263873 max lat: 1.56321 avg lat: 0.164212 2024-09-11T14:36:59.448 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:36:59.448 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 40 16 3903 3887 6.07288 6 0.180084 0.164212 2024-09-11T14:37:00.448 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 41 16 4004 3988 6.07871 6.3125 0.0747963 0.164063 2024-09-11T14:37:00.555 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:37:00.555 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:37:00.555 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:37:00.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:00.683+0000 7fef3a911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:00.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:00.695+0000 7fef3a911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:00.974 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:37:00.975 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:37:00.991 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-09-11T14:36:59.227637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":242090547,"num_objects":3689,"num_object_clones":0,"num_object_copies":11067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3766,"num_write_kb":236948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3740,"ondisk_log_size":3740,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1391112,"kb_used_data":1391112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207799800,"statfs":{"total":214211493888,"available":212786995200,"internally_reserved":0,"allocated":1424498688,"data_stored":1424498688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":89784320,"num_objects":1370,"num_object_clones":0,"num_object_copies":4110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1370,"num_write_kb":87680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002272"},"pg_stats":[{"pgid":"3.f","version":"23'253","reported_seq":277,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:58.182025+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:36:58.182025+0000","last_peered":"2024-09-11T14:36:58.182025+0000","last_clean":"2024-09-11T14:36:58.182025+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:36:58.182025+0000","last_undegraded":"2024-09-11T14:36:58.182025+0000","last_fullsized":"2024-09-11T14:36:58.182025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16580608,"num_objects":253,"num_object_clones":0,"num_object_copies":759,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":16192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'216","reported_seq":240,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:58.098178+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:36:58.098178+0000","last_peered":"2024-09-11T14:36:58.098178+0000","last_clean":"2024-09-11T14:36:58.098178+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:36:58.098178+0000","last_undegraded":"2024-09-11T14:36:58.098178+0000","last_fullsized":"2024-09-11T14:36:58.098178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14155776,"num_objects":216,"num_object_clones":0,"num_object_copies":648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":13824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'216","reported_seq":240,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:58.184169+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:36:58.184169+0000","last_peered":"2024-09-11T14:36:58.184169+0000","last_clean":"2024-09-11T14:36:58.184169+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:36:58.184169+0000","last_undegraded":"2024-09-11T14:36:58.184169+0000","last_fullsized":"2024-09-11T14:36:58.184169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14155776,"num_objects":216,"num_object_clones":0,"num_object_copies":648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":13824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'241","reported_seq":265,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:57.648563+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:36:57.648563+0000","last_peered":"2024-09-11T14:36:57.648563+0000","last_clean":"2024-09-11T14:36:57.648563+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:36:57.648563+0000","last_undegraded":"2024-09-11T14:36:57.648563+0000","last_fullsized":"2024-09-11T14:36:57.648563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15794176,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":15424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'210","reported_seq":234,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:54.164876+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:36:54.164876+0000","last_peered":"2024-09-11T14:36:54.164876+0000","last_clean":"2024-09-11T14:36:54.164876+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:36:54.164876+0000","last_undegraded":"2024-09-11T14:36:54.164876+0000","last_fullsized":"2024-09-11T14:36:54.164876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13762560,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":13440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'236","reported_seq":260,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:58.137668+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:36:58.137668+0000","last_peered":"2024-09-11T14:36:58.137668+0000","last_clean":"2024-09-11T14:36:58.137668+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:36:58.137668+0000","last_undegraded":"2024-09-11T14:36:58.137668+0000","last_fullsized":"2024-09-11T14:36:58.137668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":15104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'253","reported_seq":277,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:58.115056+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:36:58.115056+0000","last_peered":"2024-09-11T14:36:58.115056+0000","last_clean":"2024-09-11T14:36:58.115056+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:36:58.115056+0000","last_undegraded":"2024-09-11T14:36:58.115056+0000","last_fullsized":"2024-09-11T14:36:58.115056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16580608,"num_objects":253,"num_object_clones":0,"num_object_copies":759,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":16192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'210","reported_seq":234,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:57.954488+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:36:57.954488+0000","last_peered":"2024-09-11T14:36:57.954488+0000","last_clean":"2024-09-11T14:36:57.954488+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:36:57.954488+0000","last_undegraded":"2024-09-11T14:36:57.954488+0000","last_fullsized":"2024-09-11T14:36:57.954488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13762560,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":13440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.625560+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:36:25.625560+0000","last_peered":"2024-09-11T14:36:25.625560+0000","last_clean":"2024-09-11T14:36:25.625560+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:36:25.625560+0000","last_undegraded":"2024-09-11T14:36:25.625560+0000","last_fullsized":"2024-09-11T14:36:25.625560+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.463304+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:36:25.463304+0000","last_peered":"2024-09-11T14:36:25.463304+0000","last_clean":"2024-09-11T14:36:25.463304+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:36:25.463304+0000","last_undegraded":"2024-09-11T14:36:25.463304+0000","last_fullsized":"2024-09-11T14:36:25.463304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'238","reported_seq":262,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:57.662830+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:36:57.662830+0000","last_peered":"2024-09-11T14:36:57.662830+0000","last_clean":"2024-09-11T14:36:57.662830+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:36:57.662830+0000","last_undegraded":"2024-09-11T14:36:57.662830+0000","last_fullsized":"2024-09-11T14:36:57.662830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15597568,"num_objects":238,"num_object_clones":0,"num_object_copies":714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":15232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:26.917817+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:36:26.917817+0000","last_peered":"2024-09-11T14:36:26.917817+0000","last_clean":"2024-09-11T14:36:26.917817+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:36:26.917817+0000","last_undegraded":"2024-09-11T14:36:26.917817+0000","last_fullsized":"2024-09-11T14:36:26.917817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'261","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:54.214731+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:36:54.214731+0000","last_peered":"2024-09-11T14:36:54.214731+0000","last_clean":"2024-09-11T14:36:54.214731+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:36:54.214731+0000","last_undegraded":"2024-09-11T14:36:54.214731+0000","last_fullsized":"2024-09-11T14:36:54.214731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104896,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":16704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.452119+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:36:25.452119+0000","last_peered":"2024-09-11T14:36:25.452119+0000","last_clean":"2024-09-11T14:36:25.452119+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:36:25.452119+0000","last_undegraded":"2024-09-11T14:36:25.452119+0000","last_fullsized":"2024-09-11T14:36:25.452119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'211","reported_seq":235,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:53.791435+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:36:53.791435+0000","last_peered":"2024-09-11T14:36:53.791435+0000","last_clean":"2024-09-11T14:36:53.791435+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:36:53.791435+0000","last_undegraded":"2024-09-11T14:36:53.791435+0000","last_fullsized":"2024-09-11T14:36:53.791435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13828096,"num_objects":211,"num_object_clones":0,"num_object_copies":633,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":13504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:26.906262+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:36:26.906262+0000","last_peered":"2024-09-11T14:36:26.906262+0000","last_clean":"2024-09-11T14:36:26.906262+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:36:26.906262+0000","last_undegraded":"2024-09-11T14:36:26.906262+0000","last_fullsized":"2024-09-11T14:36:26.906262+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'218","reported_seq":242,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:57.851713+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:36:57.851713+0000","last_peered":"2024-09-11T14:36:57.851713+0000","last_clean":"2024-09-11T14:36:57.851713+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:36:57.851713+0000","last_undegraded":"2024-09-11T14:36:57.851713+0000","last_fullsized":"2024-09-11T14:36:57.851713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14286848,"num_objects":218,"num_object_clones":0,"num_object_copies":654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":13952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'237","reported_seq":261,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:58.107038+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:36:58.107038+0000","last_peered":"2024-09-11T14:36:58.107038+0000","last_clean":"2024-09-11T14:36:58.107038+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:36:58.107038+0000","last_undegraded":"2024-09-11T14:36:58.107038+0000","last_fullsized":"2024-09-11T14:36:58.107038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15532032,"num_objects":237,"num_object_clones":0,"num_object_copies":711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":15168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.472487+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:36:25.472487+0000","last_peered":"2024-09-11T14:36:25.472487+0000","last_clean":"2024-09-11T14:36:25.472487+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:36:25.472487+0000","last_undegraded":"2024-09-11T14:36:25.472487+0000","last_fullsized":"2024-09-11T14:36:25.472487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'223","reported_seq":247,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:57.737511+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:36:57.737511+0000","last_peered":"2024-09-11T14:36:57.737511+0000","last_clean":"2024-09-11T14:36:57.737511+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:36:57.737511+0000","last_undegraded":"2024-09-11T14:36:57.737511+0000","last_fullsized":"2024-09-11T14:36:57.737511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14614528,"num_objects":223,"num_object_clones":0,"num_object_copies":669,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":14272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.631530+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:25.631530+0000","last_peered":"2024-09-11T14:36:25.631530+0000","last_clean":"2024-09-11T14:36:25.631530+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:36:25.631530+0000","last_undegraded":"2024-09-11T14:36:25.631530+0000","last_fullsized":"2024-09-11T14:36:25.631530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'214","reported_seq":238,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:54.222636+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:36:54.222636+0000","last_peered":"2024-09-11T14:36:54.222636+0000","last_clean":"2024-09-11T14:36:54.222636+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:36:54.222636+0000","last_undegraded":"2024-09-11T14:36:54.222636+0000","last_fullsized":"2024-09-11T14:36:54.222636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.468522+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:25.468522+0000","last_peered":"2024-09-11T14:36:25.468522+0000","last_clean":"2024-09-11T14:36:25.468522+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:36:25.468522+0000","last_undegraded":"2024-09-11T14:36:25.468522+0000","last_fullsized":"2024-09-11T14:36:25.468522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'248","reported_seq":272,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:58.322654+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:36:58.322654+0000","last_peered":"2024-09-11T14:36:58.322654+0000","last_clean":"2024-09-11T14:36:58.322654+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:36:58.322654+0000","last_undegraded":"2024-09-11T14:36:58.322654+0000","last_fullsized":"2024-09-11T14:36:58.322654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16252928,"num_objects":248,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":15872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.459083+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:36:25.459083+0000","last_peered":"2024-09-11T14:36:25.459083+0000","last_clean":"2024-09-11T14:36:25.459083+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:36:25.459083+0000","last_undegraded":"2024-09-11T14:36:25.459083+0000","last_fullsized":"2024-09-11T14:36:25.459083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":241500160,"num_objects":3685,"num_object_clones":0,"num_object_copies":11055,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3685,"num_write_kb":235840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212751147008,"internally_reserved":0,"allocated":1460346880,"data_stored":1460346880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3685,"ondisk_log_size":3685,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212751278080,"internally_reserved":0,"allocated":1460215808,"data_stored":1460215808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53162848256,"internally_reserved":0,"allocated":390025216,"data_stored":390025216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673009,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":371204,"kb_used_data":371204,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51926524,"statfs":{"total":53552873472,"available":53172760576,"internally_reserved":0,"allocated":380112896,"data_stored":380112896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705718,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":322672,"kb_used_data":322672,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51975056,"statfs":{"total":53552873472,"available":53222457344,"internally_reserved":0,"allocated":330416128,"data_stored":330416128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705718,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":335260,"kb_used_data":335260,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51962468,"statfs":{"total":53552873472,"available":53209567232,"internally_reserved":0,"allocated":343306240,"data_stored":343306240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705718,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":361976,"kb_used_data":361976,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51935752,"statfs":{"total":53552873472,"available":53182210048,"internally_reserved":0,"allocated":370663424,"data_stored":370663424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53162848256,"internally_reserved":0,"allocated":390025216,"data_stored":390025216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53201575936,"internally_reserved":0,"allocated":351297536,"data_stored":351297536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53172150272,"internally_reserved":0,"allocated":380723200,"data_stored":380723200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53214703616,"internally_reserved":0,"allocated":338169856,"data_stored":338169856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53162848256,"internally_reserved":0,"allocated":390025216,"data_stored":390025216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53201575936,"internally_reserved":0,"allocated":351297536,"data_stored":351297536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53172150272,"internally_reserved":0,"allocated":380723200,"data_stored":380723200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53214703616,"internally_reserved":0,"allocated":338169856,"data_stored":338169856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53162717184,"internally_reserved":0,"allocated":390156288,"data_stored":390156288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:37:01.272 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:37:01.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:01.409+0000 7fd6b1f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:01.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:01.418+0000 7fd6b1f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:01.448 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 42 16 4104 4088 6.08278 6.25 0.275043 0.163956 2024-09-11T14:37:02.448 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 43 16 4198 4182 6.07793 5.875 0.156457 0.164128 2024-09-11T14:37:03.448 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 44 16 4298 4282 6.08183 6.25 0.263081 0.164105 2024-09-11T14:37:03.625 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:37:03.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:03.760+0000 7f62a2457640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:03.767+0000 7f62a2457640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:04.448 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 45 16 4399 4383 6.08694 6.3125 0.231396 0.163922 2024-09-11T14:37:05.448 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 46 16 4504 4488 6.09727 6.5625 0.132825 0.163718 2024-09-11T14:37:05.993 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:37:05.994 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:37:05.994 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:37:05.994 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:37:06.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:06.131+0000 7fc44f6fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:06.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:06.142+0000 7fc44f6fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:06.168 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:37:06.168 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:37:06.168 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:37:06.168 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:37:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:37:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:37:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:37:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:37:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:37:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:37:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:37:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:37:06.172 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:37:06.172 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:37:06.172 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:37:06.280 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:37:06.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:06.311+0000 7fe0dccfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:06.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:06.329+0000 7fe0dccfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:06.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:06.442+0000 7fd796111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:06.448 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 47 15 4602 4587 6.09917 6.1875 0.251301 0.163712 2024-09-11T14:37:06.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:06.451+0000 7fd796111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:06.482 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:37:06.482 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:37:06.482 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:37:06.482 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:37:06.482 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:37:06.482 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:37:06.483 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:37:06.483 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:37:06.483 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:37:06.483 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:37:06.483 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:37:06.483 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:37:06.487 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:37:06.487 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:37:06.488 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:37:06.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:06.690+0000 7f7c01ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:06.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:06.706+0000 7f7c01ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:37:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:37:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:37:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:37:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:37:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:37:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:37:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:37:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:37:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:37:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:37:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:37:06.734 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:37:06.735 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:37:06.735 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:37:06.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:06.876+0000 7f3cc1f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:06.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:06.894+0000 7f3cc1f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:06.921 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:37:06.921 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:37:06.921 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:37:06.921 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:37:06.921 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:37:06.921 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:37:06.921 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:37:06.921 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:37:06.921 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:37:06.921 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:37:06.921 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:37:06.922 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:37:06.925 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:37:06.926 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:37:07.448 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 48 16 4700 4684 6.0984 6.0625 0.131264 0.163674 2024-09-11T14:37:08.448 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 49 16 4802 4786 6.10403 6.375 0.257931 0.163454 2024-09-11T14:37:08.829 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:37:08.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:08.966+0000 7f29e42d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:08.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:08.972+0000 7f29e42d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:09.449 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 50 16 4901 4885 6.10569 6.1875 0.105668 0.163331 2024-09-11T14:37:10.449 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 51 16 5009 4993 6.11831 6.75 0.243506 0.163158 2024-09-11T14:37:11.379 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:37:11.449 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 52 16 5115 5099 6.12804 6.625 0.200365 0.162983 2024-09-11T14:37:11.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:11.524+0000 7f936e751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:11.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:11.530+0000 7f936e751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:11.927 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:37:11.927 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:37:11.928 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:37:12.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:12.083+0000 7f4568391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:12.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:12.094+0000 7f4568391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:12.407 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:37:12.407 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:37:12.421 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-09-11T14:37:11.230449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":316080691,"num_objects":4818,"num_object_clones":0,"num_object_copies":14454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4895,"num_write_kb":309204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4869,"ondisk_log_size":4869,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1832196,"kb_used_data":1832196,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207358716,"statfs":{"total":214211493888,"available":212335325184,"internally_reserved":0,"allocated":1876168704,"data_stored":1876168704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":73990144,"num_objects":1129,"num_object_clones":0,"num_object_copies":3387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002811"},"pg_stats":[{"pgid":"3.f","version":"23'320","reported_seq":344,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:08.007014+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:37:08.007014+0000","last_peered":"2024-09-11T14:37:08.007014+0000","last_clean":"2024-09-11T14:37:08.007014+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:37:08.007014+0000","last_undegraded":"2024-09-11T14:37:08.007014+0000","last_fullsized":"2024-09-11T14:37:08.007014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":320,"num_object_clones":0,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'268","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:07.961662+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:37:07.961662+0000","last_peered":"2024-09-11T14:37:07.961662+0000","last_clean":"2024-09-11T14:37:07.961662+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:37:07.961662+0000","last_undegraded":"2024-09-11T14:37:07.961662+0000","last_fullsized":"2024-09-11T14:37:07.961662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":268,"num_write_kb":17152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'277","reported_seq":301,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:08.138828+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:37:08.138828+0000","last_peered":"2024-09-11T14:37:08.138828+0000","last_clean":"2024-09-11T14:37:08.138828+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:37:08.138828+0000","last_undegraded":"2024-09-11T14:37:08.138828+0000","last_fullsized":"2024-09-11T14:37:08.138828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18153472,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":17728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'307","reported_seq":331,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:07.797361+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:37:07.797361+0000","last_peered":"2024-09-11T14:37:07.797361+0000","last_clean":"2024-09-11T14:37:07.797361+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:37:07.797361+0000","last_undegraded":"2024-09-11T14:37:07.797361+0000","last_fullsized":"2024-09-11T14:37:07.797361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20119552,"num_objects":307,"num_object_clones":0,"num_object_copies":921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":19648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'306","reported_seq":330,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:08.843845+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:37:08.843845+0000","last_peered":"2024-09-11T14:37:08.843845+0000","last_clean":"2024-09-11T14:37:08.843845+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:37:08.843845+0000","last_undegraded":"2024-09-11T14:37:08.843845+0000","last_fullsized":"2024-09-11T14:37:08.843845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20054016,"num_objects":306,"num_object_clones":0,"num_object_copies":918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":19584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'298","reported_seq":322,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:08.190803+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:37:08.190803+0000","last_peered":"2024-09-11T14:37:08.190803+0000","last_clean":"2024-09-11T14:37:08.190803+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:37:08.190803+0000","last_undegraded":"2024-09-11T14:37:08.190803+0000","last_fullsized":"2024-09-11T14:37:08.190803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19529728,"num_objects":298,"num_object_clones":0,"num_object_copies":894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":19072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'325","reported_seq":349,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:08.288831+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:37:08.288831+0000","last_peered":"2024-09-11T14:37:08.288831+0000","last_clean":"2024-09-11T14:37:08.288831+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:37:08.288831+0000","last_undegraded":"2024-09-11T14:37:08.288831+0000","last_fullsized":"2024-09-11T14:37:08.288831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21299200,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":325,"num_write_kb":20800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'265","reported_seq":289,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:07.910574+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:37:07.910574+0000","last_peered":"2024-09-11T14:37:07.910574+0000","last_clean":"2024-09-11T14:37:07.910574+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:37:07.910574+0000","last_undegraded":"2024-09-11T14:37:07.910574+0000","last_fullsized":"2024-09-11T14:37:07.910574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17367040,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":265,"num_write_kb":16960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.625560+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:36:25.625560+0000","last_peered":"2024-09-11T14:36:25.625560+0000","last_clean":"2024-09-11T14:36:25.625560+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:36:25.625560+0000","last_undegraded":"2024-09-11T14:36:25.625560+0000","last_fullsized":"2024-09-11T14:36:25.625560+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.463304+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:36:25.463304+0000","last_peered":"2024-09-11T14:36:25.463304+0000","last_clean":"2024-09-11T14:36:25.463304+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:36:25.463304+0000","last_undegraded":"2024-09-11T14:36:25.463304+0000","last_fullsized":"2024-09-11T14:36:25.463304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'299","reported_seq":323,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:08.128911+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:37:08.128911+0000","last_peered":"2024-09-11T14:37:08.128911+0000","last_clean":"2024-09-11T14:37:08.128911+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:37:08.128911+0000","last_undegraded":"2024-09-11T14:37:08.128911+0000","last_fullsized":"2024-09-11T14:37:08.128911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":19136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:26.917817+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:36:26.917817+0000","last_peered":"2024-09-11T14:36:26.917817+0000","last_clean":"2024-09-11T14:36:26.917817+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:36:26.917817+0000","last_undegraded":"2024-09-11T14:36:26.917817+0000","last_fullsized":"2024-09-11T14:36:26.917817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'365","reported_seq":389,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:08.998548+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:37:08.998548+0000","last_peered":"2024-09-11T14:37:08.998548+0000","last_clean":"2024-09-11T14:37:08.998548+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:37:08.998548+0000","last_undegraded":"2024-09-11T14:37:08.998548+0000","last_fullsized":"2024-09-11T14:37:08.998548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":23360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.452119+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:36:25.452119+0000","last_peered":"2024-09-11T14:36:25.452119+0000","last_clean":"2024-09-11T14:36:25.452119+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:36:25.452119+0000","last_undegraded":"2024-09-11T14:36:25.452119+0000","last_fullsized":"2024-09-11T14:36:25.452119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'315","reported_seq":339,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:09.177899+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:37:09.177899+0000","last_peered":"2024-09-11T14:37:09.177899+0000","last_clean":"2024-09-11T14:37:09.177899+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:37:09.177899+0000","last_undegraded":"2024-09-11T14:37:09.177899+0000","last_fullsized":"2024-09-11T14:37:09.177899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20643840,"num_objects":315,"num_object_clones":0,"num_object_copies":945,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":20160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:26.906262+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:36:26.906262+0000","last_peered":"2024-09-11T14:36:26.906262+0000","last_clean":"2024-09-11T14:36:26.906262+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:36:26.906262+0000","last_undegraded":"2024-09-11T14:36:26.906262+0000","last_fullsized":"2024-09-11T14:36:26.906262+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'270","reported_seq":294,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:07.639550+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:37:07.639550+0000","last_peered":"2024-09-11T14:37:07.639550+0000","last_clean":"2024-09-11T14:37:07.639550+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:37:07.639550+0000","last_undegraded":"2024-09-11T14:37:07.639550+0000","last_fullsized":"2024-09-11T14:37:07.639550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'296","reported_seq":320,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:08.308184+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:37:08.308184+0000","last_peered":"2024-09-11T14:37:08.308184+0000","last_clean":"2024-09-11T14:37:08.308184+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:37:08.308184+0000","last_undegraded":"2024-09-11T14:37:08.308184+0000","last_fullsized":"2024-09-11T14:37:08.308184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19398656,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":18944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.472487+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:36:25.472487+0000","last_peered":"2024-09-11T14:36:25.472487+0000","last_clean":"2024-09-11T14:36:25.472487+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:36:25.472487+0000","last_undegraded":"2024-09-11T14:36:25.472487+0000","last_fullsized":"2024-09-11T14:36:25.472487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'286","reported_seq":310,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:08.144298+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:37:08.144298+0000","last_peered":"2024-09-11T14:37:08.144298+0000","last_clean":"2024-09-11T14:37:08.144298+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:37:08.144298+0000","last_undegraded":"2024-09-11T14:37:08.144298+0000","last_fullsized":"2024-09-11T14:37:08.144298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18743296,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":286,"num_write_kb":18304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.631530+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:25.631530+0000","last_peered":"2024-09-11T14:36:25.631530+0000","last_clean":"2024-09-11T14:36:25.631530+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:36:25.631530+0000","last_undegraded":"2024-09-11T14:36:25.631530+0000","last_fullsized":"2024-09-11T14:36:25.631530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'303","reported_seq":327,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:09.274982+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:37:09.274982+0000","last_peered":"2024-09-11T14:37:09.274982+0000","last_clean":"2024-09-11T14:37:09.274982+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:37:09.274982+0000","last_undegraded":"2024-09-11T14:37:09.274982+0000","last_fullsized":"2024-09-11T14:37:09.274982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":19392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.468522+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:25.468522+0000","last_peered":"2024-09-11T14:36:25.468522+0000","last_clean":"2024-09-11T14:36:25.468522+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:36:25.468522+0000","last_undegraded":"2024-09-11T14:36:25.468522+0000","last_fullsized":"2024-09-11T14:36:25.468522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'314","reported_seq":338,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:08.308808+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:37:08.308808+0000","last_peered":"2024-09-11T14:37:08.308808+0000","last_clean":"2024-09-11T14:37:08.308808+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:37:08.308808+0000","last_undegraded":"2024-09-11T14:37:08.308808+0000","last_fullsized":"2024-09-11T14:37:08.308808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20578304,"num_objects":314,"num_object_clones":0,"num_object_copies":942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":20096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.459083+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:36:25.459083+0000","last_peered":"2024-09-11T14:36:25.459083+0000","last_clean":"2024-09-11T14:36:25.459083+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:36:25.459083+0000","last_undegraded":"2024-09-11T14:36:25.459083+0000","last_fullsized":"2024-09-11T14:36:25.459083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":315490304,"num_objects":4814,"num_object_clones":0,"num_object_copies":14442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4814,"num_write_kb":308096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212296171520,"internally_reserved":0,"allocated":1915322368,"data_stored":1915322368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4814,"ondisk_log_size":4814,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212296171520,"internally_reserved":0,"allocated":1915322368,"data_stored":1915322368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52989566976,"internally_reserved":0,"allocated":563306496,"data_stored":563306496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":538692,"kb_used_data":538692,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51759036,"statfs":{"total":53552873472,"available":53001252864,"internally_reserved":0,"allocated":551620608,"data_stored":551620608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705728,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":411196,"kb_used_data":411196,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51886532,"statfs":{"total":53552873472,"available":53131808768,"internally_reserved":0,"allocated":421064704,"data_stored":421064704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705728,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":424216,"kb_used_data":424216,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51873512,"statfs":{"total":53552873472,"available":53118476288,"internally_reserved":0,"allocated":434397184,"data_stored":434397184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705728,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":458092,"kb_used_data":458092,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51839636,"statfs":{"total":53552873472,"available":53083787264,"internally_reserved":0,"allocated":469086208,"data_stored":469086208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52989566976,"internally_reserved":0,"allocated":563306496,"data_stored":563306496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53109809152,"internally_reserved":0,"allocated":443064320,"data_stored":443064320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53073252352,"internally_reserved":0,"allocated":479621120,"data_stored":479621120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53123543040,"internally_reserved":0,"allocated":429330432,"data_stored":429330432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52989566976,"internally_reserved":0,"allocated":563306496,"data_stored":563306496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53109809152,"internally_reserved":0,"allocated":443064320,"data_stored":443064320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53073252352,"internally_reserved":0,"allocated":479621120,"data_stored":479621120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53123543040,"internally_reserved":0,"allocated":429330432,"data_stored":429330432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52989566976,"internally_reserved":0,"allocated":563306496,"data_stored":563306496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:37:12.449 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 53 16 5213 5197 6.12797 6.125 0.123495 0.16293 2024-09-11T14:37:13.449 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 54 16 5295 5279 6.10939 5.125 0.082771 0.163177 2024-09-11T14:37:13.966 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:37:14.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:14.133+0000 7fe240791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:14.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:14.143+0000 7fe240791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:14.449 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 55 16 5392 5376 6.10853 6.0625 0.063046 0.163241 2024-09-11T14:37:15.449 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 56 16 5497 5481 6.11662 6.5625 0.123247 0.163196 2024-09-11T14:37:16.449 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 57 16 5601 5585 6.12334 6.5 0.0586041 0.162967 2024-09-11T14:37:16.568 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:37:16.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:16.700+0000 7fcf4c511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:16.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:16.710+0000 7fcf4c511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:17.422 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:37:17.423 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:37:17.423 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:37:17.449 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 58 16 5700 5684 6.12443 6.1875 0.0913189 0.162955 2024-09-11T14:37:17.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:17.575+0000 7f2c81b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:17.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:17.588+0000 7f2c81b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:17.955 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:37:17.956 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:37:17.972 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-09-11T14:37:17.231617+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":348455475,"num_objects":5312,"num_object_clones":0,"num_object_copies":15936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5389,"num_write_kb":340820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5363,"ondisk_log_size":5363,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2028208,"kb_used_data":2028208,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207162704,"statfs":{"total":214211493888,"available":212134608896,"internally_reserved":0,"allocated":2076884992,"data_stored":2076884992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":64487424,"num_objects":984,"num_object_clones":0,"num_object_copies":2952,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":984,"num_write_kb":62976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002523"},"pg_stats":[{"pgid":"3.f","version":"23'351","reported_seq":375,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:13.155248+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:37:13.155248+0000","last_peered":"2024-09-11T14:37:13.155248+0000","last_clean":"2024-09-11T14:37:13.155248+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:37:13.155248+0000","last_undegraded":"2024-09-11T14:37:13.155248+0000","last_fullsized":"2024-09-11T14:37:13.155248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23003136,"num_objects":351,"num_object_clones":0,"num_object_copies":1053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":351,"num_write_kb":22464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'291","reported_seq":315,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:12.877810+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:37:12.877810+0000","last_peered":"2024-09-11T14:37:12.877810+0000","last_clean":"2024-09-11T14:37:12.877810+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:37:12.877810+0000","last_undegraded":"2024-09-11T14:37:12.877810+0000","last_fullsized":"2024-09-11T14:37:12.877810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19070976,"num_objects":291,"num_object_clones":0,"num_object_copies":873,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":18624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'302","reported_seq":326,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:13.267808+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:37:13.267808+0000","last_peered":"2024-09-11T14:37:13.267808+0000","last_clean":"2024-09-11T14:37:13.267808+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:37:13.267808+0000","last_undegraded":"2024-09-11T14:37:13.267808+0000","last_fullsized":"2024-09-11T14:37:13.267808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19791872,"num_objects":302,"num_object_clones":0,"num_object_copies":906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":19328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'342","reported_seq":366,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:12.716249+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:37:12.716249+0000","last_peered":"2024-09-11T14:37:12.716249+0000","last_clean":"2024-09-11T14:37:12.716249+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:37:12.716249+0000","last_undegraded":"2024-09-11T14:37:12.716249+0000","last_fullsized":"2024-09-11T14:37:12.716249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22413312,"num_objects":342,"num_object_clones":0,"num_object_copies":1026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":342,"num_write_kb":21888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'346","reported_seq":370,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:13.984005+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:37:13.984005+0000","last_peered":"2024-09-11T14:37:13.984005+0000","last_clean":"2024-09-11T14:37:13.984005+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:37:13.984005+0000","last_undegraded":"2024-09-11T14:37:13.984005+0000","last_fullsized":"2024-09-11T14:37:13.984005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22675456,"num_objects":346,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":22144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'326","reported_seq":350,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:13.310301+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:37:13.310301+0000","last_peered":"2024-09-11T14:37:13.310301+0000","last_clean":"2024-09-11T14:37:13.310301+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:37:13.310301+0000","last_undegraded":"2024-09-11T14:37:13.310301+0000","last_fullsized":"2024-09-11T14:37:13.310301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21364736,"num_objects":326,"num_object_clones":0,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'355","reported_seq":379,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:12.919224+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:37:12.919224+0000","last_peered":"2024-09-11T14:37:12.919224+0000","last_clean":"2024-09-11T14:37:12.919224+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:37:12.919224+0000","last_undegraded":"2024-09-11T14:37:12.919224+0000","last_fullsized":"2024-09-11T14:37:12.919224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23265280,"num_objects":355,"num_object_clones":0,"num_object_copies":1065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":22720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'297","reported_seq":321,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:12.776703+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:37:12.776703+0000","last_peered":"2024-09-11T14:37:12.776703+0000","last_clean":"2024-09-11T14:37:12.776703+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:37:12.776703+0000","last_undegraded":"2024-09-11T14:37:12.776703+0000","last_fullsized":"2024-09-11T14:37:12.776703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":19008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.625560+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:36:25.625560+0000","last_peered":"2024-09-11T14:36:25.625560+0000","last_clean":"2024-09-11T14:36:25.625560+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:36:25.625560+0000","last_undegraded":"2024-09-11T14:36:25.625560+0000","last_fullsized":"2024-09-11T14:36:25.625560+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.463304+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:36:25.463304+0000","last_peered":"2024-09-11T14:36:25.463304+0000","last_clean":"2024-09-11T14:36:25.463304+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:36:25.463304+0000","last_undegraded":"2024-09-11T14:36:25.463304+0000","last_fullsized":"2024-09-11T14:36:25.463304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'327","reported_seq":351,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:13.055048+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:37:13.055048+0000","last_peered":"2024-09-11T14:37:13.055048+0000","last_clean":"2024-09-11T14:37:13.055048+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:37:13.055048+0000","last_undegraded":"2024-09-11T14:37:13.055048+0000","last_fullsized":"2024-09-11T14:37:13.055048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21430272,"num_objects":327,"num_object_clones":0,"num_object_copies":981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":20928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:26.917817+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:36:26.917817+0000","last_peered":"2024-09-11T14:36:26.917817+0000","last_clean":"2024-09-11T14:36:26.917817+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:36:26.917817+0000","last_undegraded":"2024-09-11T14:36:26.917817+0000","last_fullsized":"2024-09-11T14:36:26.917817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'398","reported_seq":422,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:13.991954+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:37:13.991954+0000","last_peered":"2024-09-11T14:37:13.991954+0000","last_clean":"2024-09-11T14:37:13.991954+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:37:13.991954+0000","last_undegraded":"2024-09-11T14:37:13.991954+0000","last_fullsized":"2024-09-11T14:37:13.991954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26083328,"num_objects":398,"num_object_clones":0,"num_object_copies":1194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":398,"num_write_kb":25472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.452119+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:36:25.452119+0000","last_peered":"2024-09-11T14:36:25.452119+0000","last_clean":"2024-09-11T14:36:25.452119+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:36:25.452119+0000","last_undegraded":"2024-09-11T14:36:25.452119+0000","last_fullsized":"2024-09-11T14:36:25.452119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'354","reported_seq":378,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:13.756013+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:37:13.756013+0000","last_peered":"2024-09-11T14:37:13.756013+0000","last_clean":"2024-09-11T14:37:13.756013+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:37:13.756013+0000","last_undegraded":"2024-09-11T14:37:13.756013+0000","last_fullsized":"2024-09-11T14:37:13.756013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23199744,"num_objects":354,"num_object_clones":0,"num_object_copies":1062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":22656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:26.906262+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:36:26.906262+0000","last_peered":"2024-09-11T14:36:26.906262+0000","last_clean":"2024-09-11T14:36:26.906262+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:36:26.906262+0000","last_undegraded":"2024-09-11T14:36:26.906262+0000","last_fullsized":"2024-09-11T14:36:26.906262+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'295","reported_seq":319,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:12.982514+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:37:12.982514+0000","last_peered":"2024-09-11T14:37:12.982514+0000","last_clean":"2024-09-11T14:37:12.982514+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:37:12.982514+0000","last_undegraded":"2024-09-11T14:37:12.982514+0000","last_fullsized":"2024-09-11T14:37:12.982514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333120,"num_objects":295,"num_object_clones":0,"num_object_copies":885,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":18880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'336","reported_seq":360,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:13.198787+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:37:13.198787+0000","last_peered":"2024-09-11T14:37:13.198787+0000","last_clean":"2024-09-11T14:37:13.198787+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:37:13.198787+0000","last_undegraded":"2024-09-11T14:37:13.198787+0000","last_fullsized":"2024-09-11T14:37:13.198787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":21504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.472487+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:36:25.472487+0000","last_peered":"2024-09-11T14:36:25.472487+0000","last_clean":"2024-09-11T14:36:25.472487+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:36:25.472487+0000","last_undegraded":"2024-09-11T14:36:25.472487+0000","last_fullsized":"2024-09-11T14:36:25.472487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'312","reported_seq":336,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:13.303528+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:37:13.303528+0000","last_peered":"2024-09-11T14:37:13.303528+0000","last_clean":"2024-09-11T14:37:13.303528+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:37:13.303528+0000","last_undegraded":"2024-09-11T14:37:13.303528+0000","last_fullsized":"2024-09-11T14:37:13.303528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20447232,"num_objects":312,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":19968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.631530+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:25.631530+0000","last_peered":"2024-09-11T14:36:25.631530+0000","last_clean":"2024-09-11T14:36:25.631530+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:36:25.631530+0000","last_undegraded":"2024-09-11T14:36:25.631530+0000","last_fullsized":"2024-09-11T14:36:25.631530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'328","reported_seq":352,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:13.814805+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:37:13.814805+0000","last_peered":"2024-09-11T14:37:13.814805+0000","last_clean":"2024-09-11T14:37:13.814805+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:37:13.814805+0000","last_undegraded":"2024-09-11T14:37:13.814805+0000","last_fullsized":"2024-09-11T14:37:13.814805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21495808,"num_objects":328,"num_object_clones":0,"num_object_copies":984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":20992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.468522+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:25.468522+0000","last_peered":"2024-09-11T14:36:25.468522+0000","last_clean":"2024-09-11T14:36:25.468522+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:36:25.468522+0000","last_undegraded":"2024-09-11T14:36:25.468522+0000","last_fullsized":"2024-09-11T14:36:25.468522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'348","reported_seq":372,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:13.008554+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:37:13.008554+0000","last_peered":"2024-09-11T14:37:13.008554+0000","last_clean":"2024-09-11T14:37:13.008554+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:37:13.008554+0000","last_undegraded":"2024-09-11T14:37:13.008554+0000","last_fullsized":"2024-09-11T14:37:13.008554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22806528,"num_objects":348,"num_object_clones":0,"num_object_copies":1044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":348,"num_write_kb":22272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.459083+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:36:25.459083+0000","last_peered":"2024-09-11T14:36:25.459083+0000","last_clean":"2024-09-11T14:36:25.459083+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:36:25.459083+0000","last_undegraded":"2024-09-11T14:36:25.459083+0000","last_fullsized":"2024-09-11T14:36:25.459083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":347865088,"num_objects":5308,"num_object_clones":0,"num_object_copies":15924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5308,"num_write_kb":339712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212100177920,"internally_reserved":0,"allocated":2111315968,"data_stored":2111315968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5308,"ondisk_log_size":5308,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212100440064,"internally_reserved":0,"allocated":2111053824,"data_stored":2111053824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52932481024,"internally_reserved":0,"allocated":620392448,"data_stored":620392448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":594864,"kb_used_data":594864,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51702864,"statfs":{"total":53552873472,"available":52943732736,"internally_reserved":0,"allocated":609140736,"data_stored":609140736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705733,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":456832,"kb_used_data":456832,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51840896,"statfs":{"total":53552873472,"available":53085077504,"internally_reserved":0,"allocated":467795968,"data_stored":467795968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705733,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":468304,"kb_used_data":468304,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51829424,"statfs":{"total":53552873472,"available":53073330176,"internally_reserved":0,"allocated":479543296,"data_stored":479543296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705733,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":508208,"kb_used_data":508208,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51789520,"statfs":{"total":53552873472,"available":53032468480,"internally_reserved":0,"allocated":520404992,"data_stored":520404992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52932481024,"internally_reserved":0,"allocated":620392448,"data_stored":620392448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53066743808,"internally_reserved":0,"allocated":486129664,"data_stored":486129664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53024026624,"internally_reserved":0,"allocated":528846848,"data_stored":528846848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53077188608,"internally_reserved":0,"allocated":475684864,"data_stored":475684864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52932481024,"internally_reserved":0,"allocated":620392448,"data_stored":620392448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53066743808,"internally_reserved":0,"allocated":486129664,"data_stored":486129664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53023895552,"internally_reserved":0,"allocated":528977920,"data_stored":528977920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53077057536,"internally_reserved":0,"allocated":475815936,"data_stored":475815936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52932481024,"internally_reserved":0,"allocated":620392448,"data_stored":620392448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:37:18.449 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 59 16 5795 5779 6.12126 5.9375 0.13029 0.163031 2024-09-11T14:37:19.021 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:37:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:19.162+0000 7fe8cb2a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:19.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:19.171+0000 7fe8cb2a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:19.449 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:37:19.449511+0000 min lat: 0.0263873 max lat: 1.56321 avg lat: 0.163017 2024-09-11T14:37:19.450 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:37:19.450 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 60 16 5895 5879 6.12339 6.25 0.181242 0.163017 2024-09-11T14:37:20.450 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 61 16 5985 5969 6.11521 5.625 0.133036 0.163266 2024-09-11T14:37:21.450 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 62 16 6072 6056 6.10427 5.4375 0.0955933 0.163375 2024-09-11T14:37:21.608 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:37:21.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:21.761+0000 7f88c8d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:21.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:21.768+0000 7f88c8d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:22.450 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 63 16 6159 6143 6.09368 5.4375 0.179791 0.163835 2024-09-11T14:37:22.974 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:37:22.975 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T14:37:23.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:23.130+0000 7f4475591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:23.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:23.144+0000 7f4475591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:23.450 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 64 16 6249 6233 6.08635 5.625 0.232365 0.164026 2024-09-11T14:37:23.840 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T14:37:23.863 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T14:37:24.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:24.005+0000 7f62c0e93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:24.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:24.017+0000 7f62c0e93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:24.256 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:37:24.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:24.403+0000 7fcb46391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:24.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:24.413+0000 7fcb46391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:24.450 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 65 16 6341 6325 6.08117 5.75 0.103775 0.164155 2024-09-11T14:37:24.841 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T14:37:24.859 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T14:37:25.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:24.992+0000 7fd21ff11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:25.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:25.007+0000 7fd21ff11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:25.450 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 66 16 6424 6408 6.06762 5.1875 0.114189 0.164487 2024-09-11T14:37:25.853 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T14:37:25.879 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T14:37:26.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:26.045+0000 7ff3924a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:26.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:26.060+0000 7ff3924a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:26.450 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 67 16 6511 6495 6.05821 5.4375 0.193245 0.164786 2024-09-11T14:37:26.636 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:37:26.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:26.778+0000 7fa7b8b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:26.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:26.785+0000 7fa7b8b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:26.855 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T14:37:26.878 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T14:37:26.878 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:37:27.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:27.022+0000 7febbbf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:27.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:27.033+0000 7febbbf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:27.333 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:37:27.333 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:37:27.349 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-09-11T14:37:27.233788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":411107891,"num_objects":6268,"num_object_clones":0,"num_object_copies":18804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6345,"num_write_kb":402004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6319,"ondisk_log_size":6319,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2398944,"kb_used_data":2398944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206791968,"statfs":{"total":214211493888,"available":211754975232,"internally_reserved":0,"allocated":2456518656,"data_stored":2456518656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":29622272,"num_objects":452,"num_object_clones":0,"num_object_copies":1356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":452,"num_write_kb":28928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000848"},"pg_stats":[{"pgid":"3.f","version":"23'412","reported_seq":436,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:23.219252+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:37:23.219252+0000","last_peered":"2024-09-11T14:37:23.219252+0000","last_clean":"2024-09-11T14:37:23.219252+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:37:23.219252+0000","last_undegraded":"2024-09-11T14:37:23.219252+0000","last_fullsized":"2024-09-11T14:37:23.219252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'345","reported_seq":369,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:23.064323+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:37:23.064323+0000","last_peered":"2024-09-11T14:37:23.064323+0000","last_clean":"2024-09-11T14:37:23.064323+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:37:23.064323+0000","last_undegraded":"2024-09-11T14:37:23.064323+0000","last_fullsized":"2024-09-11T14:37:23.064323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22609920,"num_objects":345,"num_object_clones":0,"num_object_copies":1035,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":22080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'376","reported_seq":400,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:22.834043+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:37:22.834043+0000","last_peered":"2024-09-11T14:37:22.834043+0000","last_clean":"2024-09-11T14:37:22.834043+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:37:22.834043+0000","last_undegraded":"2024-09-11T14:37:22.834043+0000","last_fullsized":"2024-09-11T14:37:22.834043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24641536,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'401","reported_seq":425,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:23.207004+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:37:23.207004+0000","last_peered":"2024-09-11T14:37:23.207004+0000","last_clean":"2024-09-11T14:37:23.207004+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:37:23.207004+0000","last_undegraded":"2024-09-11T14:37:23.207004+0000","last_fullsized":"2024-09-11T14:37:23.207004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26279936,"num_objects":401,"num_object_clones":0,"num_object_copies":1203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":401,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"24'414","reported_seq":441,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T14:37:24.045623+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:37:24.045623+0000","last_peered":"2024-09-11T14:37:24.045623+0000","last_clean":"2024-09-11T14:37:24.045623+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:37:24.045623+0000","last_undegraded":"2024-09-11T14:37:24.045623+0000","last_fullsized":"2024-09-11T14:37:24.045623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27131904,"num_objects":414,"num_object_clones":0,"num_object_copies":1242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":414,"num_write_kb":26496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'393","reported_seq":417,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:23.294363+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:37:23.294363+0000","last_peered":"2024-09-11T14:37:23.294363+0000","last_clean":"2024-09-11T14:37:23.294363+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:37:23.294363+0000","last_undegraded":"2024-09-11T14:37:23.294363+0000","last_fullsized":"2024-09-11T14:37:23.294363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":25152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'412","reported_seq":436,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:23.248109+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:37:23.248109+0000","last_peered":"2024-09-11T14:37:23.248109+0000","last_clean":"2024-09-11T14:37:23.248109+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:37:23.248109+0000","last_undegraded":"2024-09-11T14:37:23.248109+0000","last_fullsized":"2024-09-11T14:37:23.248109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'351","reported_seq":375,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:22.513084+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:37:22.513084+0000","last_peered":"2024-09-11T14:37:22.513084+0000","last_clean":"2024-09-11T14:37:22.513084+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:37:22.513084+0000","last_undegraded":"2024-09-11T14:37:22.513084+0000","last_fullsized":"2024-09-11T14:37:22.513084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23003136,"num_objects":351,"num_object_clones":0,"num_object_copies":1053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":351,"num_write_kb":22464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":112,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T14:37:24.019519+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:37:24.019519+0000","last_peered":"2024-09-11T14:37:24.019519+0000","last_clean":"2024-09-11T14:37:24.019519+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:37:24.019519+0000","last_undegraded":"2024-09-11T14:37:24.019519+0000","last_fullsized":"2024-09-11T14:37:24.019519+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.463304+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:36:25.463304+0000","last_peered":"2024-09-11T14:36:25.463304+0000","last_clean":"2024-09-11T14:36:25.463304+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:36:25.463304+0000","last_undegraded":"2024-09-11T14:36:25.463304+0000","last_fullsized":"2024-09-11T14:36:25.463304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'384","reported_seq":408,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:23.001989+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:37:23.001989+0000","last_peered":"2024-09-11T14:37:23.001989+0000","last_clean":"2024-09-11T14:37:23.001989+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:37:23.001989+0000","last_undegraded":"2024-09-11T14:37:23.001989+0000","last_fullsized":"2024-09-11T14:37:23.001989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":384,"num_object_clones":0,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:26.917817+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:36:26.917817+0000","last_peered":"2024-09-11T14:36:26.917817+0000","last_clean":"2024-09-11T14:36:26.917817+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:36:26.917817+0000","last_undegraded":"2024-09-11T14:36:26.917817+0000","last_fullsized":"2024-09-11T14:36:26.917817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"24'457","reported_seq":484,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T14:37:24.148713+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:37:24.148713+0000","last_peered":"2024-09-11T14:37:24.148713+0000","last_clean":"2024-09-11T14:37:24.148713+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:37:24.148713+0000","last_undegraded":"2024-09-11T14:37:24.148713+0000","last_fullsized":"2024-09-11T14:37:24.148713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29949952,"num_objects":457,"num_object_clones":0,"num_object_copies":1371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.452119+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:36:25.452119+0000","last_peered":"2024-09-11T14:36:25.452119+0000","last_clean":"2024-09-11T14:36:25.452119+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:36:25.452119+0000","last_undegraded":"2024-09-11T14:36:25.452119+0000","last_fullsized":"2024-09-11T14:36:25.452119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"24'408","reported_seq":435,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T14:37:24.028194+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:37:24.028194+0000","last_peered":"2024-09-11T14:37:24.028194+0000","last_clean":"2024-09-11T14:37:24.028194+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:37:24.028194+0000","last_undegraded":"2024-09-11T14:37:24.028194+0000","last_fullsized":"2024-09-11T14:37:24.028194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26738688,"num_objects":408,"num_object_clones":0,"num_object_copies":1224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:26.906262+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:36:26.906262+0000","last_peered":"2024-09-11T14:36:26.906262+0000","last_clean":"2024-09-11T14:36:26.906262+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:36:26.906262+0000","last_undegraded":"2024-09-11T14:36:26.906262+0000","last_fullsized":"2024-09-11T14:36:26.906262+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'361","reported_seq":385,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:23.001355+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:37:23.001355+0000","last_peered":"2024-09-11T14:37:23.001355+0000","last_clean":"2024-09-11T14:37:23.001355+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:37:23.001355+0000","last_undegraded":"2024-09-11T14:37:23.001355+0000","last_fullsized":"2024-09-11T14:37:23.001355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23658496,"num_objects":361,"num_object_clones":0,"num_object_copies":1083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":23104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'388","reported_seq":412,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:23.191663+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:37:23.191663+0000","last_peered":"2024-09-11T14:37:23.191663+0000","last_clean":"2024-09-11T14:37:23.191663+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:37:23.191663+0000","last_undegraded":"2024-09-11T14:37:23.191663+0000","last_fullsized":"2024-09-11T14:37:23.191663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25427968,"num_objects":388,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":24832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.472487+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:36:25.472487+0000","last_peered":"2024-09-11T14:36:25.472487+0000","last_clean":"2024-09-11T14:36:25.472487+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:36:25.472487+0000","last_undegraded":"2024-09-11T14:36:25.472487+0000","last_fullsized":"2024-09-11T14:36:25.472487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'359","reported_seq":383,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:22.862650+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:37:22.862650+0000","last_peered":"2024-09-11T14:37:22.862650+0000","last_clean":"2024-09-11T14:37:22.862650+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:37:22.862650+0000","last_undegraded":"2024-09-11T14:37:22.862650+0000","last_fullsized":"2024-09-11T14:37:22.862650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23527424,"num_objects":359,"num_object_clones":0,"num_object_copies":1077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":359,"num_write_kb":22976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T14:37:24.025698+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:37:24.025698+0000","last_peered":"2024-09-11T14:37:24.025698+0000","last_clean":"2024-09-11T14:37:24.025698+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:37:24.025698+0000","last_undegraded":"2024-09-11T14:37:24.025698+0000","last_fullsized":"2024-09-11T14:37:24.025698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"24'398","reported_seq":425,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T14:37:24.103554+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:37:24.103554+0000","last_peered":"2024-09-11T14:37:24.103554+0000","last_clean":"2024-09-11T14:37:24.103554+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:37:24.103554+0000","last_undegraded":"2024-09-11T14:37:24.103554+0000","last_fullsized":"2024-09-11T14:37:24.103554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26083328,"num_objects":398,"num_object_clones":0,"num_object_copies":1194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":398,"num_write_kb":25472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.468522+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:25.468522+0000","last_peered":"2024-09-11T14:36:25.468522+0000","last_clean":"2024-09-11T14:36:25.468522+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:36:25.468522+0000","last_undegraded":"2024-09-11T14:36:25.468522+0000","last_fullsized":"2024-09-11T14:36:25.468522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'405","reported_seq":429,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:22.731988+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:37:22.731988+0000","last_peered":"2024-09-11T14:37:22.731988+0000","last_clean":"2024-09-11T14:37:22.731988+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:37:22.731988+0000","last_undegraded":"2024-09-11T14:37:22.731988+0000","last_fullsized":"2024-09-11T14:37:22.731988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26542080,"num_objects":405,"num_object_clones":0,"num_object_copies":1215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":25920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.459083+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:36:25.459083+0000","last_peered":"2024-09-11T14:36:25.459083+0000","last_clean":"2024-09-11T14:36:25.459083+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:36:25.459083+0000","last_undegraded":"2024-09-11T14:36:25.459083+0000","last_fullsized":"2024-09-11T14:36:25.459083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":410517504,"num_objects":6264,"num_object_clones":0,"num_object_copies":18792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6264,"num_write_kb":400896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211722743808,"internally_reserved":0,"allocated":2488750080,"data_stored":2488750080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6264,"ondisk_log_size":6264,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211723005952,"internally_reserved":0,"allocated":2488487936,"data_stored":2488487936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52823212032,"internally_reserved":0,"allocated":729661440,"data_stored":729661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":703044,"kb_used_data":703044,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51594684,"statfs":{"total":53552873472,"available":52832956416,"internally_reserved":0,"allocated":719917056,"data_stored":719917056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":539660,"kb_used_data":539660,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51758068,"statfs":{"total":53552873472,"available":53000261632,"internally_reserved":0,"allocated":552611840,"data_stored":552611840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":555252,"kb_used_data":555252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51742476,"statfs":{"total":53552873472,"available":52984295424,"internally_reserved":0,"allocated":568578048,"data_stored":568578048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":600988,"kb_used_data":600988,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51696740,"statfs":{"total":53552873472,"available":52937461760,"internally_reserved":0,"allocated":615411712,"data_stored":615411712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52823212032,"internally_reserved":0,"allocated":729661440,"data_stored":729661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52977410048,"internally_reserved":0,"allocated":575463424,"data_stored":575463424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52929638400,"internally_reserved":0,"allocated":623235072,"data_stored":623235072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52992745472,"internally_reserved":0,"allocated":560128000,"data_stored":560128000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52823212032,"internally_reserved":0,"allocated":729661440,"data_stored":729661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":52977147904,"internally_reserved":0,"allocated":575725568,"data_stored":575725568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":52929638400,"internally_reserved":0,"allocated":623235072,"data_stored":623235072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":52992745472,"internally_reserved":0,"allocated":560128000,"data_stored":560128000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52823212032,"internally_reserved":0,"allocated":729661440,"data_stored":729661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:37:27.351 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:37:27.450 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 68 16 6590 6574 6.04172 4.9375 0.286587 0.165215 2024-09-11T14:37:27.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:27.492+0000 7f514bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:27.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:27.501+0000 7f514bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:27.864 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:37:27.864 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:37:27.883 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-09-11T14:37:27.233788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":411107891,"num_objects":6268,"num_object_clones":0,"num_object_copies":18804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6345,"num_write_kb":402004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6319,"ondisk_log_size":6319,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2398944,"kb_used_data":2398944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206791968,"statfs":{"total":214211493888,"available":211754975232,"internally_reserved":0,"allocated":2456518656,"data_stored":2456518656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":29622272,"num_objects":452,"num_object_clones":0,"num_object_copies":1356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":452,"num_write_kb":28928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000848"},"pg_stats":[{"pgid":"3.f","version":"23'412","reported_seq":436,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:23.219252+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:37:23.219252+0000","last_peered":"2024-09-11T14:37:23.219252+0000","last_clean":"2024-09-11T14:37:23.219252+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:37:23.219252+0000","last_undegraded":"2024-09-11T14:37:23.219252+0000","last_fullsized":"2024-09-11T14:37:23.219252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'345","reported_seq":369,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:23.064323+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:37:23.064323+0000","last_peered":"2024-09-11T14:37:23.064323+0000","last_clean":"2024-09-11T14:37:23.064323+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:37:23.064323+0000","last_undegraded":"2024-09-11T14:37:23.064323+0000","last_fullsized":"2024-09-11T14:37:23.064323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22609920,"num_objects":345,"num_object_clones":0,"num_object_copies":1035,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":22080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'376","reported_seq":400,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:22.834043+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:37:22.834043+0000","last_peered":"2024-09-11T14:37:22.834043+0000","last_clean":"2024-09-11T14:37:22.834043+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:37:22.834043+0000","last_undegraded":"2024-09-11T14:37:22.834043+0000","last_fullsized":"2024-09-11T14:37:22.834043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24641536,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'401","reported_seq":425,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:23.207004+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:37:23.207004+0000","last_peered":"2024-09-11T14:37:23.207004+0000","last_clean":"2024-09-11T14:37:23.207004+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:37:23.207004+0000","last_undegraded":"2024-09-11T14:37:23.207004+0000","last_fullsized":"2024-09-11T14:37:23.207004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26279936,"num_objects":401,"num_object_clones":0,"num_object_copies":1203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":401,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"24'414","reported_seq":441,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T14:37:24.045623+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:37:24.045623+0000","last_peered":"2024-09-11T14:37:24.045623+0000","last_clean":"2024-09-11T14:37:24.045623+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:37:24.045623+0000","last_undegraded":"2024-09-11T14:37:24.045623+0000","last_fullsized":"2024-09-11T14:37:24.045623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27131904,"num_objects":414,"num_object_clones":0,"num_object_copies":1242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":414,"num_write_kb":26496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'393","reported_seq":417,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:23.294363+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:37:23.294363+0000","last_peered":"2024-09-11T14:37:23.294363+0000","last_clean":"2024-09-11T14:37:23.294363+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:37:23.294363+0000","last_undegraded":"2024-09-11T14:37:23.294363+0000","last_fullsized":"2024-09-11T14:37:23.294363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":25152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'412","reported_seq":436,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:23.248109+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:37:23.248109+0000","last_peered":"2024-09-11T14:37:23.248109+0000","last_clean":"2024-09-11T14:37:23.248109+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:37:23.248109+0000","last_undegraded":"2024-09-11T14:37:23.248109+0000","last_fullsized":"2024-09-11T14:37:23.248109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'351","reported_seq":375,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:22.513084+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:37:22.513084+0000","last_peered":"2024-09-11T14:37:22.513084+0000","last_clean":"2024-09-11T14:37:22.513084+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:37:22.513084+0000","last_undegraded":"2024-09-11T14:37:22.513084+0000","last_fullsized":"2024-09-11T14:37:22.513084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23003136,"num_objects":351,"num_object_clones":0,"num_object_copies":1053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":351,"num_write_kb":22464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":112,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T14:37:24.019519+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:37:24.019519+0000","last_peered":"2024-09-11T14:37:24.019519+0000","last_clean":"2024-09-11T14:37:24.019519+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:37:24.019519+0000","last_undegraded":"2024-09-11T14:37:24.019519+0000","last_fullsized":"2024-09-11T14:37:24.019519+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.463304+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:36:25.463304+0000","last_peered":"2024-09-11T14:36:25.463304+0000","last_clean":"2024-09-11T14:36:25.463304+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:36:25.463304+0000","last_undegraded":"2024-09-11T14:36:25.463304+0000","last_fullsized":"2024-09-11T14:36:25.463304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'384","reported_seq":408,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:23.001989+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:37:23.001989+0000","last_peered":"2024-09-11T14:37:23.001989+0000","last_clean":"2024-09-11T14:37:23.001989+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:37:23.001989+0000","last_undegraded":"2024-09-11T14:37:23.001989+0000","last_fullsized":"2024-09-11T14:37:23.001989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":384,"num_object_clones":0,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:26.917817+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:36:26.917817+0000","last_peered":"2024-09-11T14:36:26.917817+0000","last_clean":"2024-09-11T14:36:26.917817+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:36:26.917817+0000","last_undegraded":"2024-09-11T14:36:26.917817+0000","last_fullsized":"2024-09-11T14:36:26.917817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"24'457","reported_seq":484,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T14:37:24.148713+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:37:24.148713+0000","last_peered":"2024-09-11T14:37:24.148713+0000","last_clean":"2024-09-11T14:37:24.148713+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:37:24.148713+0000","last_undegraded":"2024-09-11T14:37:24.148713+0000","last_fullsized":"2024-09-11T14:37:24.148713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29949952,"num_objects":457,"num_object_clones":0,"num_object_copies":1371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.452119+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:36:25.452119+0000","last_peered":"2024-09-11T14:36:25.452119+0000","last_clean":"2024-09-11T14:36:25.452119+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:36:25.452119+0000","last_undegraded":"2024-09-11T14:36:25.452119+0000","last_fullsized":"2024-09-11T14:36:25.452119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"24'408","reported_seq":435,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T14:37:24.028194+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:37:24.028194+0000","last_peered":"2024-09-11T14:37:24.028194+0000","last_clean":"2024-09-11T14:37:24.028194+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:37:24.028194+0000","last_undegraded":"2024-09-11T14:37:24.028194+0000","last_fullsized":"2024-09-11T14:37:24.028194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26738688,"num_objects":408,"num_object_clones":0,"num_object_copies":1224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:26.906262+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:36:26.906262+0000","last_peered":"2024-09-11T14:36:26.906262+0000","last_clean":"2024-09-11T14:36:26.906262+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:36:26.906262+0000","last_undegraded":"2024-09-11T14:36:26.906262+0000","last_fullsized":"2024-09-11T14:36:26.906262+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'361","reported_seq":385,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:23.001355+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:37:23.001355+0000","last_peered":"2024-09-11T14:37:23.001355+0000","last_clean":"2024-09-11T14:37:23.001355+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:37:23.001355+0000","last_undegraded":"2024-09-11T14:37:23.001355+0000","last_fullsized":"2024-09-11T14:37:23.001355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23658496,"num_objects":361,"num_object_clones":0,"num_object_copies":1083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":23104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'388","reported_seq":412,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:23.191663+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:37:23.191663+0000","last_peered":"2024-09-11T14:37:23.191663+0000","last_clean":"2024-09-11T14:37:23.191663+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:37:23.191663+0000","last_undegraded":"2024-09-11T14:37:23.191663+0000","last_fullsized":"2024-09-11T14:37:23.191663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25427968,"num_objects":388,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":24832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.472487+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:36:25.472487+0000","last_peered":"2024-09-11T14:36:25.472487+0000","last_clean":"2024-09-11T14:36:25.472487+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:36:25.472487+0000","last_undegraded":"2024-09-11T14:36:25.472487+0000","last_fullsized":"2024-09-11T14:36:25.472487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'359","reported_seq":383,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:22.862650+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:37:22.862650+0000","last_peered":"2024-09-11T14:37:22.862650+0000","last_clean":"2024-09-11T14:37:22.862650+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:37:22.862650+0000","last_undegraded":"2024-09-11T14:37:22.862650+0000","last_fullsized":"2024-09-11T14:37:22.862650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23527424,"num_objects":359,"num_object_clones":0,"num_object_copies":1077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":359,"num_write_kb":22976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T14:37:24.025698+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:37:24.025698+0000","last_peered":"2024-09-11T14:37:24.025698+0000","last_clean":"2024-09-11T14:37:24.025698+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:37:24.025698+0000","last_undegraded":"2024-09-11T14:37:24.025698+0000","last_fullsized":"2024-09-11T14:37:24.025698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"24'398","reported_seq":425,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T14:37:24.103554+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:37:24.103554+0000","last_peered":"2024-09-11T14:37:24.103554+0000","last_clean":"2024-09-11T14:37:24.103554+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:37:24.103554+0000","last_undegraded":"2024-09-11T14:37:24.103554+0000","last_fullsized":"2024-09-11T14:37:24.103554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26083328,"num_objects":398,"num_object_clones":0,"num_object_copies":1194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":398,"num_write_kb":25472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.468522+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:36:25.468522+0000","last_peered":"2024-09-11T14:36:25.468522+0000","last_clean":"2024-09-11T14:36:25.468522+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:36:25.468522+0000","last_undegraded":"2024-09-11T14:36:25.468522+0000","last_fullsized":"2024-09-11T14:36:25.468522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'405","reported_seq":429,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:37:22.731988+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:37:22.731988+0000","last_peered":"2024-09-11T14:37:22.731988+0000","last_clean":"2024-09-11T14:37:22.731988+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:37:22.731988+0000","last_undegraded":"2024-09-11T14:37:22.731988+0000","last_fullsized":"2024-09-11T14:37:22.731988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26542080,"num_objects":405,"num_object_clones":0,"num_object_copies":1215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":25920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-11T14:36:25.459083+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:36:25.459083+0000","last_peered":"2024-09-11T14:36:25.459083+0000","last_clean":"2024-09-11T14:36:25.459083+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:36:25.459083+0000","last_undegraded":"2024-09-11T14:36:25.459083+0000","last_fullsized":"2024-09-11T14:36:25.459083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":410517504,"num_objects":6264,"num_object_clones":0,"num_object_copies":18792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6264,"num_write_kb":400896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211722743808,"internally_reserved":0,"allocated":2488750080,"data_stored":2488750080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6264,"ondisk_log_size":6264,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211723005952,"internally_reserved":0,"allocated":2488487936,"data_stored":2488487936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52823212032,"internally_reserved":0,"allocated":729661440,"data_stored":729661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":703044,"kb_used_data":703044,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51594684,"statfs":{"total":53552873472,"available":52832956416,"internally_reserved":0,"allocated":719917056,"data_stored":719917056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":539660,"kb_used_data":539660,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51758068,"statfs":{"total":53552873472,"available":53000261632,"internally_reserved":0,"allocated":552611840,"data_stored":552611840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":555252,"kb_used_data":555252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51742476,"statfs":{"total":53552873472,"available":52984295424,"internally_reserved":0,"allocated":568578048,"data_stored":568578048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":600988,"kb_used_data":600988,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51696740,"statfs":{"total":53552873472,"available":52937461760,"internally_reserved":0,"allocated":615411712,"data_stored":615411712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52823212032,"internally_reserved":0,"allocated":729661440,"data_stored":729661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52977410048,"internally_reserved":0,"allocated":575463424,"data_stored":575463424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52929638400,"internally_reserved":0,"allocated":623235072,"data_stored":623235072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52992745472,"internally_reserved":0,"allocated":560128000,"data_stored":560128000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52823212032,"internally_reserved":0,"allocated":729661440,"data_stored":729661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":52977147904,"internally_reserved":0,"allocated":575725568,"data_stored":575725568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":52929638400,"internally_reserved":0,"allocated":623235072,"data_stored":623235072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":52992745472,"internally_reserved":0,"allocated":560128000,"data_stored":560128000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52823212032,"internally_reserved":0,"allocated":729661440,"data_stored":729661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:37:27.884 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T14:37:27.884 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:37:27.885 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:37:27.885 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:37:28.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:28.049+0000 7fd991d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:28.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:28.061+0000 7fd991d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:28.085 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:37:28.085 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:37:28.085 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:37:28.085 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:37:28.086 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:37:28.086 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:37:28.086 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:37:28.086 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:37:28.086 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:37:28.086 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:37:28.086 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:37:28.086 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:37:28.089 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:37:28.090 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:37:28.090 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:37:28.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:28.251+0000 7f539d711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:28.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:28.268+0000 7f539d711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:28.395 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:37:28.395 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:37:28.395 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:37:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:37:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:37:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:37:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:37:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:37:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:37:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:37:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:37:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:37:28.400 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:37:28.401 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:37:28.401 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:37:28.450 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 69 16 6678 6662 6.03386 5.5 0.181919 0.165444 2024-09-11T14:37:28.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:28.550+0000 7f6934951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:28.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:28.563+0000 7f6934951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:37:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:37:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:37:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:37:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:37:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:37:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:37:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:37:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:37:28.626 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:37:28.626 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:37:28.626 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:37:28.629 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:37:28.629 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:37:28.629 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:37:28.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:28.779+0000 7fca92f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:28.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:28.793+0000 7fca92f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:28.962 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:37:28.962 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:37:28.962 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:37:28.963 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:37:28.963 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:37:28.963 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:37:28.963 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:37:28.963 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:37:28.963 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:37:28.963 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:37:28.963 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:37:28.963 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:37:28.965 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:37:28.966 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:37:29.218 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:37:29.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:29.355+0000 7fce2ae46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:29.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:29.361+0000 7fce2ae46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:29.451 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 70 16 6767 6751 6.02712 5.5625 0.0567615 0.165579 2024-09-11T14:37:30.451 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 71 16 6856 6840 6.02057 5.5625 0.0700015 0.165808 2024-09-11T14:37:31.451 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 72 16 6953 6937 6.02114 6.0625 0.100362 0.165787 2024-09-11T14:37:31.624 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:37:31.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:31.769+0000 7fcb15591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:31.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:31.778+0000 7fcb15591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:32.451 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 73 16 7042 7026 6.01485 5.5625 0.31354 0.165956 2024-09-11T14:37:33.451 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 74 16 7125 7109 6.00367 5.1875 0.0800229 0.166218 2024-09-11T14:37:33.967 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:37:33.967 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:37:33.968 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:37:34.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:34.119+0000 7fb0f66bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:34.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:34.131+0000 7fb0f66bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:34.233 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:37:34.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:34.401+0000 7fb95ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:34.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:34.411+0000 7fb95ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:34.445 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:37:34.446 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:37:34.451 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 75 16 7209 7193 5.99361 5.25 0.416665 0.166598 2024-09-11T14:37:34.465 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-09-11T14:37:33.235042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":439157299,"num_objects":6696,"num_object_clones":0,"num_object_copies":20088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6773,"num_write_kb":429396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6747,"ondisk_log_size":6747,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2564228,"kb_used_data":2564228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206626684,"statfs":{"total":214211493888,"available":211585724416,"internally_reserved":0,"allocated":2625769472,"data_stored":2625769472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":28049408,"num_objects":428,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001658"},"pg_stats":[{"pgid":"3.f","version":"27'443","reported_seq":479,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.984212+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:37:27.984212+0000","last_peered":"2024-09-11T14:37:27.984212+0000","last_clean":"2024-09-11T14:37:27.984212+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:37:27.984212+0000","last_undegraded":"2024-09-11T14:37:27.984212+0000","last_fullsized":"2024-09-11T14:37:27.984212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29032448,"num_objects":443,"num_object_clones":0,"num_object_copies":1329,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":28352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"27'373","reported_seq":409,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.900228+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:37:27.900228+0000","last_peered":"2024-09-11T14:37:27.900228+0000","last_clean":"2024-09-11T14:37:27.900228+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:37:27.900228+0000","last_undegraded":"2024-09-11T14:37:27.900228+0000","last_fullsized":"2024-09-11T14:37:27.900228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24444928,"num_objects":373,"num_object_clones":0,"num_object_copies":1119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":373,"num_write_kb":23872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'402","reported_seq":438,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:28.247144+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:37:28.247144+0000","last_peered":"2024-09-11T14:37:28.247144+0000","last_clean":"2024-09-11T14:37:28.247144+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:37:28.247144+0000","last_undegraded":"2024-09-11T14:37:28.247144+0000","last_fullsized":"2024-09-11T14:37:28.247144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26345472,"num_objects":402,"num_object_clones":0,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":25728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'422","reported_seq":458,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.851809+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:37:27.851809+0000","last_peered":"2024-09-11T14:37:27.851809+0000","last_clean":"2024-09-11T14:37:27.851809+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:37:27.851809+0000","last_undegraded":"2024-09-11T14:37:27.851809+0000","last_fullsized":"2024-09-11T14:37:27.851809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27656192,"num_objects":422,"num_object_clones":0,"num_object_copies":1266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":422,"num_write_kb":27008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"27'434","reported_seq":470,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:29.212021+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:37:29.212021+0000","last_peered":"2024-09-11T14:37:29.212021+0000","last_clean":"2024-09-11T14:37:29.212021+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:37:29.212021+0000","last_undegraded":"2024-09-11T14:37:29.212021+0000","last_fullsized":"2024-09-11T14:37:29.212021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28442624,"num_objects":434,"num_object_clones":0,"num_object_copies":1302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":434,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'421","reported_seq":457,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.889872+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:37:27.889872+0000","last_peered":"2024-09-11T14:37:27.889872+0000","last_clean":"2024-09-11T14:37:27.889872+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:37:27.889872+0000","last_undegraded":"2024-09-11T14:37:27.889872+0000","last_fullsized":"2024-09-11T14:37:27.889872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"27'440","reported_seq":476,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:28.200302+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:37:28.200302+0000","last_peered":"2024-09-11T14:37:28.200302+0000","last_clean":"2024-09-11T14:37:28.200302+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:37:28.200302+0000","last_undegraded":"2024-09-11T14:37:28.200302+0000","last_fullsized":"2024-09-11T14:37:28.200302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28835840,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":28160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'371","reported_seq":407,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.913246+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:37:27.913246+0000","last_peered":"2024-09-11T14:37:27.913246+0000","last_clean":"2024-09-11T14:37:27.913246+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:37:27.913246+0000","last_undegraded":"2024-09-11T14:37:27.913246+0000","last_fullsized":"2024-09-11T14:37:27.913246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24313856,"num_objects":371,"num_object_clones":0,"num_object_copies":1113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":23744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":121,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.012123+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:37:27.012123+0000","last_peered":"2024-09-11T14:37:27.012123+0000","last_clean":"2024-09-11T14:37:27.012123+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:37:27.012123+0000","last_undegraded":"2024-09-11T14:37:27.012123+0000","last_fullsized":"2024-09-11T14:37:27.012123+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.925408+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:37:26.925408+0000","last_peered":"2024-09-11T14:37:26.925408+0000","last_clean":"2024-09-11T14:37:26.925408+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:37:26.925408+0000","last_undegraded":"2024-09-11T14:37:26.925408+0000","last_fullsized":"2024-09-11T14:37:26.925408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"27'419","reported_seq":455,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:28.095393+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:37:28.095393+0000","last_peered":"2024-09-11T14:37:28.095393+0000","last_clean":"2024-09-11T14:37:28.095393+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:37:28.095393+0000","last_undegraded":"2024-09-11T14:37:28.095393+0000","last_fullsized":"2024-09-11T14:37:28.095393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27459584,"num_objects":419,"num_object_clones":0,"num_object_copies":1257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":26816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.128052+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:37:27.128052+0000","last_peered":"2024-09-11T14:37:27.128052+0000","last_clean":"2024-09-11T14:37:27.128052+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:37:27.128052+0000","last_undegraded":"2024-09-11T14:37:27.128052+0000","last_fullsized":"2024-09-11T14:37:27.128052+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'496","reported_seq":532,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:29.094013+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:37:29.094013+0000","last_peered":"2024-09-11T14:37:29.094013+0000","last_clean":"2024-09-11T14:37:29.094013+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:37:29.094013+0000","last_undegraded":"2024-09-11T14:37:29.094013+0000","last_fullsized":"2024-09-11T14:37:29.094013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32505856,"num_objects":496,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.913649+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:37:26.913649+0000","last_peered":"2024-09-11T14:37:26.913649+0000","last_clean":"2024-09-11T14:37:26.913649+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:37:26.913649+0000","last_undegraded":"2024-09-11T14:37:26.913649+0000","last_fullsized":"2024-09-11T14:37:26.913649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'432","reported_seq":468,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:28.964504+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:37:28.964504+0000","last_peered":"2024-09-11T14:37:28.964504+0000","last_clean":"2024-09-11T14:37:28.964504+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:37:28.964504+0000","last_undegraded":"2024-09-11T14:37:28.964504+0000","last_fullsized":"2024-09-11T14:37:28.964504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.123729+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:37:27.123729+0000","last_peered":"2024-09-11T14:37:27.123729+0000","last_clean":"2024-09-11T14:37:27.123729+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:37:27.123729+0000","last_undegraded":"2024-09-11T14:37:27.123729+0000","last_fullsized":"2024-09-11T14:37:27.123729+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'388","reported_seq":424,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.781157+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:37:27.781157+0000","last_peered":"2024-09-11T14:37:27.781157+0000","last_clean":"2024-09-11T14:37:27.781157+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:37:27.781157+0000","last_undegraded":"2024-09-11T14:37:27.781157+0000","last_fullsized":"2024-09-11T14:37:27.781157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25427968,"num_objects":388,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":24832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"27'404","reported_seq":440,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.996301+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:37:27.996301+0000","last_peered":"2024-09-11T14:37:27.996301+0000","last_clean":"2024-09-11T14:37:27.996301+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:37:27.996301+0000","last_undegraded":"2024-09-11T14:37:27.996301+0000","last_fullsized":"2024-09-11T14:37:27.996301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26476544,"num_objects":404,"num_object_clones":0,"num_object_copies":1212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":404,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.916515+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:37:26.916515+0000","last_peered":"2024-09-11T14:37:26.916515+0000","last_clean":"2024-09-11T14:37:26.916515+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:37:26.916515+0000","last_undegraded":"2024-09-11T14:37:26.916515+0000","last_fullsized":"2024-09-11T14:37:26.916515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"27'389","reported_seq":425,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:28.064182+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:37:28.064182+0000","last_peered":"2024-09-11T14:37:28.064182+0000","last_clean":"2024-09-11T14:37:28.064182+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:37:28.064182+0000","last_undegraded":"2024-09-11T14:37:28.064182+0000","last_fullsized":"2024-09-11T14:37:28.064182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":24896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.014782+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:37:27.014782+0000","last_peered":"2024-09-11T14:37:27.014782+0000","last_clean":"2024-09-11T14:37:27.014782+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:37:27.014782+0000","last_undegraded":"2024-09-11T14:37:27.014782+0000","last_fullsized":"2024-09-11T14:37:27.014782+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'424","reported_seq":460,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:28.952088+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:37:28.952088+0000","last_peered":"2024-09-11T14:37:28.952088+0000","last_clean":"2024-09-11T14:37:28.952088+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:37:28.952088+0000","last_undegraded":"2024-09-11T14:37:28.952088+0000","last_fullsized":"2024-09-11T14:37:28.952088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27787264,"num_objects":424,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":27136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.914681+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:37:26.914681+0000","last_peered":"2024-09-11T14:37:26.914681+0000","last_clean":"2024-09-11T14:37:26.914681+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:37:26.914681+0000","last_undegraded":"2024-09-11T14:37:26.914681+0000","last_fullsized":"2024-09-11T14:37:26.914681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'434","reported_seq":470,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:28.205566+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:37:28.205566+0000","last_peered":"2024-09-11T14:37:28.205566+0000","last_clean":"2024-09-11T14:37:28.205566+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:37:28.205566+0000","last_undegraded":"2024-09-11T14:37:28.205566+0000","last_fullsized":"2024-09-11T14:37:28.205566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28442624,"num_objects":434,"num_object_clones":0,"num_object_copies":1302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":434,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.918942+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:37:26.918942+0000","last_peered":"2024-09-11T14:37:26.918942+0000","last_clean":"2024-09-11T14:37:26.918942+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:37:26.918942+0000","last_undegraded":"2024-09-11T14:37:26.918942+0000","last_fullsized":"2024-09-11T14:37:26.918942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":438566912,"num_objects":6692,"num_object_clones":0,"num_object_copies":20076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6692,"num_write_kb":428288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211552698368,"internally_reserved":0,"allocated":2658795520,"data_stored":2658795520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6692,"ondisk_log_size":6692,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211552829440,"internally_reserved":0,"allocated":2658664448,"data_stored":2658664448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52774744064,"internally_reserved":0,"allocated":778129408,"data_stored":778129408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673044,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":750028,"kb_used_data":750028,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51547700,"statfs":{"total":53552873472,"available":52784844800,"internally_reserved":0,"allocated":768028672,"data_stored":768028672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":575708,"kb_used_data":575708,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51722020,"statfs":{"total":53552873472,"available":52963348480,"internally_reserved":0,"allocated":589524992,"data_stored":589524992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":596344,"kb_used_data":596344,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51701384,"statfs":{"total":53552873472,"available":52942217216,"internally_reserved":0,"allocated":610656256,"data_stored":610656256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":642148,"kb_used_data":642148,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51655580,"statfs":{"total":53552873472,"available":52895313920,"internally_reserved":0,"allocated":657559552,"data_stored":657559552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52774744064,"internally_reserved":0,"allocated":778129408,"data_stored":778129408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52935098368,"internally_reserved":0,"allocated":617775104,"data_stored":617775104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52885991424,"internally_reserved":0,"allocated":666882048,"data_stored":666882048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52957126656,"internally_reserved":0,"allocated":595746816,"data_stored":595746816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52774612992,"internally_reserved":0,"allocated":778260480,"data_stored":778260480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":52934967296,"internally_reserved":0,"allocated":617906176,"data_stored":617906176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":52885991424,"internally_reserved":0,"allocated":666882048,"data_stored":666882048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":52957126656,"internally_reserved":0,"allocated":595746816,"data_stored":595746816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52774612992,"internally_reserved":0,"allocated":778260480,"data_stored":778260480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:37:35.451 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 76 16 7284 7268 5.97642 4.6875 0.133422 0.167034 2024-09-11T14:37:36.451 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 77 16 7370 7354 5.9686 5.375 0.110832 0.167167 2024-09-11T14:37:36.695 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:37:36.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:36.835+0000 7f1357b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:36.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:36.842+0000 7f1357b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:37.451 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 78 16 7454 7438 5.95938 5.25 0.0843031 0.16757 2024-09-11T14:37:38.451 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 79 16 7542 7526 5.95356 5.5 0.0500512 0.16766 2024-09-11T14:37:39.290 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:37:39.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:39.427+0000 7f7bafa93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:39.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:39.437+0000 7f7bafa93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:39.451 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:37:39.451411+0000 min lat: 0.0263873 max lat: 1.56321 avg lat: 0.167787 2024-09-11T14:37:39.451 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:37:39.451 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 80 16 7639 7623 5.95492 6.0625 0.184943 0.167787 2024-09-11T14:37:39.467 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:37:39.467 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:37:39.467 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:37:39.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:39.616+0000 7f8a98f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:39.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:39.632+0000 7f8a98f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:39.952 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:37:39.952 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:37:39.969 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-11T14:37:39.236280+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":489357875,"num_objects":7462,"num_object_clones":0,"num_object_copies":22386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7539,"num_write_kb":478420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7513,"ondisk_log_size":7513,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2852528,"kb_used_data":2852528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206338384,"statfs":{"total":214211493888,"available":211290505216,"internally_reserved":0,"allocated":2920988672,"data_stored":2920988672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":78249984,"num_objects":1194,"num_object_clones":0,"num_object_copies":3582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":76416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002492"},"pg_stats":[{"pgid":"3.f","version":"27'505","reported_seq":541,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:38.251950+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:37:38.251950+0000","last_peered":"2024-09-11T14:37:38.251950+0000","last_clean":"2024-09-11T14:37:38.251950+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:37:38.251950+0000","last_undegraded":"2024-09-11T14:37:38.251950+0000","last_fullsized":"2024-09-11T14:37:38.251950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33095680,"num_objects":505,"num_object_clones":0,"num_object_copies":1515,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":505,"num_write_kb":32320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"27'434","reported_seq":470,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:38.002766+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:37:38.002766+0000","last_peered":"2024-09-11T14:37:38.002766+0000","last_clean":"2024-09-11T14:37:38.002766+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:37:38.002766+0000","last_undegraded":"2024-09-11T14:37:38.002766+0000","last_fullsized":"2024-09-11T14:37:38.002766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28442624,"num_objects":434,"num_object_clones":0,"num_object_copies":1302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":434,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'443","reported_seq":479,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:38.169867+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:37:38.169867+0000","last_peered":"2024-09-11T14:37:38.169867+0000","last_clean":"2024-09-11T14:37:38.169867+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:37:38.169867+0000","last_undegraded":"2024-09-11T14:37:38.169867+0000","last_fullsized":"2024-09-11T14:37:38.169867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29032448,"num_objects":443,"num_object_clones":0,"num_object_copies":1329,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":28352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'477","reported_seq":513,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:38.106880+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:37:38.106880+0000","last_peered":"2024-09-11T14:37:38.106880+0000","last_clean":"2024-09-11T14:37:38.106880+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:37:38.106880+0000","last_undegraded":"2024-09-11T14:37:38.106880+0000","last_fullsized":"2024-09-11T14:37:38.106880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31260672,"num_objects":477,"num_object_clones":0,"num_object_copies":1431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":477,"num_write_kb":30528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"27'461","reported_seq":497,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:34.148123+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:37:34.148123+0000","last_peered":"2024-09-11T14:37:34.148123+0000","last_clean":"2024-09-11T14:37:34.148123+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:37:34.148123+0000","last_undegraded":"2024-09-11T14:37:34.148123+0000","last_fullsized":"2024-09-11T14:37:34.148123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30212096,"num_objects":461,"num_object_clones":0,"num_object_copies":1383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":29504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'478","reported_seq":514,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:37.424184+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:37:37.424184+0000","last_peered":"2024-09-11T14:37:37.424184+0000","last_clean":"2024-09-11T14:37:37.424184+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:37:37.424184+0000","last_undegraded":"2024-09-11T14:37:37.424184+0000","last_fullsized":"2024-09-11T14:37:37.424184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31326208,"num_objects":478,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":478,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"27'496","reported_seq":532,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:37.826147+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:37:37.826147+0000","last_peered":"2024-09-11T14:37:37.826147+0000","last_clean":"2024-09-11T14:37:37.826147+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:37:37.826147+0000","last_undegraded":"2024-09-11T14:37:37.826147+0000","last_fullsized":"2024-09-11T14:37:37.826147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32505856,"num_objects":496,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'432","reported_seq":468,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:38.238456+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:37:38.238456+0000","last_peered":"2024-09-11T14:37:38.238456+0000","last_clean":"2024-09-11T14:37:38.238456+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:37:38.238456+0000","last_undegraded":"2024-09-11T14:37:38.238456+0000","last_fullsized":"2024-09-11T14:37:38.238456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":121,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.012123+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:37:27.012123+0000","last_peered":"2024-09-11T14:37:27.012123+0000","last_clean":"2024-09-11T14:37:27.012123+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:37:27.012123+0000","last_undegraded":"2024-09-11T14:37:27.012123+0000","last_fullsized":"2024-09-11T14:37:27.012123+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.925408+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:37:26.925408+0000","last_peered":"2024-09-11T14:37:26.925408+0000","last_clean":"2024-09-11T14:37:26.925408+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:37:26.925408+0000","last_undegraded":"2024-09-11T14:37:26.925408+0000","last_fullsized":"2024-09-11T14:37:26.925408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"27'477","reported_seq":513,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:38.251920+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:37:38.251920+0000","last_peered":"2024-09-11T14:37:38.251920+0000","last_clean":"2024-09-11T14:37:38.251920+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:37:38.251920+0000","last_undegraded":"2024-09-11T14:37:38.251920+0000","last_fullsized":"2024-09-11T14:37:38.251920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31260672,"num_objects":477,"num_object_clones":0,"num_object_copies":1431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":477,"num_write_kb":30528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.128052+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:37:27.128052+0000","last_peered":"2024-09-11T14:37:27.128052+0000","last_clean":"2024-09-11T14:37:27.128052+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:37:27.128052+0000","last_undegraded":"2024-09-11T14:37:27.128052+0000","last_fullsized":"2024-09-11T14:37:27.128052+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'517","reported_seq":553,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:33.334138+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:37:33.334138+0000","last_peered":"2024-09-11T14:37:33.334138+0000","last_clean":"2024-09-11T14:37:33.334138+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:37:33.334138+0000","last_undegraded":"2024-09-11T14:37:33.334138+0000","last_fullsized":"2024-09-11T14:37:33.334138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.913649+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:37:26.913649+0000","last_peered":"2024-09-11T14:37:26.913649+0000","last_clean":"2024-09-11T14:37:26.913649+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:37:26.913649+0000","last_undegraded":"2024-09-11T14:37:26.913649+0000","last_fullsized":"2024-09-11T14:37:26.913649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'462","reported_seq":498,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:34.264661+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:37:34.264661+0000","last_peered":"2024-09-11T14:37:34.264661+0000","last_clean":"2024-09-11T14:37:34.264661+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:37:34.264661+0000","last_undegraded":"2024-09-11T14:37:34.264661+0000","last_fullsized":"2024-09-11T14:37:34.264661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.123729+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:37:27.123729+0000","last_peered":"2024-09-11T14:37:27.123729+0000","last_clean":"2024-09-11T14:37:27.123729+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:37:27.123729+0000","last_undegraded":"2024-09-11T14:37:27.123729+0000","last_fullsized":"2024-09-11T14:37:27.123729+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'431","reported_seq":467,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:38.085228+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:37:38.085228+0000","last_peered":"2024-09-11T14:37:38.085228+0000","last_clean":"2024-09-11T14:37:38.085228+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:37:38.085228+0000","last_undegraded":"2024-09-11T14:37:38.085228+0000","last_fullsized":"2024-09-11T14:37:38.085228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28246016,"num_objects":431,"num_object_clones":0,"num_object_copies":1293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":27584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"27'461","reported_seq":497,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:38.019479+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:37:38.019479+0000","last_peered":"2024-09-11T14:37:38.019479+0000","last_clean":"2024-09-11T14:37:38.019479+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:37:38.019479+0000","last_undegraded":"2024-09-11T14:37:38.019479+0000","last_fullsized":"2024-09-11T14:37:38.019479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30212096,"num_objects":461,"num_object_clones":0,"num_object_copies":1383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":29504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.916515+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:37:26.916515+0000","last_peered":"2024-09-11T14:37:26.916515+0000","last_clean":"2024-09-11T14:37:26.916515+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:37:26.916515+0000","last_undegraded":"2024-09-11T14:37:26.916515+0000","last_fullsized":"2024-09-11T14:37:26.916515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"27'436","reported_seq":472,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:38.071783+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:37:38.071783+0000","last_peered":"2024-09-11T14:37:38.071783+0000","last_clean":"2024-09-11T14:37:38.071783+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:37:38.071783+0000","last_undegraded":"2024-09-11T14:37:38.071783+0000","last_fullsized":"2024-09-11T14:37:38.071783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28573696,"num_objects":436,"num_object_clones":0,"num_object_copies":1308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":436,"num_write_kb":27904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.014782+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:37:27.014782+0000","last_peered":"2024-09-11T14:37:27.014782+0000","last_clean":"2024-09-11T14:37:27.014782+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:37:27.014782+0000","last_undegraded":"2024-09-11T14:37:27.014782+0000","last_fullsized":"2024-09-11T14:37:27.014782+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'457","reported_seq":493,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:33.776154+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:37:33.776154+0000","last_peered":"2024-09-11T14:37:33.776154+0000","last_clean":"2024-09-11T14:37:33.776154+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:37:33.776154+0000","last_undegraded":"2024-09-11T14:37:33.776154+0000","last_fullsized":"2024-09-11T14:37:33.776154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29949952,"num_objects":457,"num_object_clones":0,"num_object_copies":1371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.914681+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:37:26.914681+0000","last_peered":"2024-09-11T14:37:26.914681+0000","last_clean":"2024-09-11T14:37:26.914681+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:37:26.914681+0000","last_undegraded":"2024-09-11T14:37:26.914681+0000","last_fullsized":"2024-09-11T14:37:26.914681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'491","reported_seq":527,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:38.199504+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:37:38.199504+0000","last_peered":"2024-09-11T14:37:38.199504+0000","last_clean":"2024-09-11T14:37:38.199504+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:37:38.199504+0000","last_undegraded":"2024-09-11T14:37:38.199504+0000","last_fullsized":"2024-09-11T14:37:38.199504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32178176,"num_objects":491,"num_object_clones":0,"num_object_copies":1473,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":491,"num_write_kb":31424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.918942+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:37:26.918942+0000","last_peered":"2024-09-11T14:37:26.918942+0000","last_clean":"2024-09-11T14:37:26.918942+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:37:26.918942+0000","last_undegraded":"2024-09-11T14:37:26.918942+0000","last_fullsized":"2024-09-11T14:37:26.918942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":488767488,"num_objects":7458,"num_object_clones":0,"num_object_copies":22374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7458,"num_write_kb":477312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211259502592,"internally_reserved":0,"allocated":2951991296,"data_stored":2951991296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7458,"ondisk_log_size":7458,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211259633664,"internally_reserved":0,"allocated":2951860224,"data_stored":2951860224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52724973568,"internally_reserved":0,"allocated":827899904,"data_stored":827899904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":800156,"kb_used_data":800156,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51497572,"statfs":{"total":53552873472,"available":52733513728,"internally_reserved":0,"allocated":819359744,"data_stored":819359744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705758,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":652552,"kb_used_data":652552,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51645176,"statfs":{"total":53552873472,"available":52884660224,"internally_reserved":0,"allocated":668213248,"data_stored":668213248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705758,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":670732,"kb_used_data":670732,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51626996,"statfs":{"total":53552873472,"available":52866043904,"internally_reserved":0,"allocated":686829568,"data_stored":686829568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705758,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":729088,"kb_used_data":729088,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51568640,"statfs":{"total":53552873472,"available":52806287360,"internally_reserved":0,"allocated":746586112,"data_stored":746586112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52724973568,"internally_reserved":0,"allocated":827899904,"data_stored":827899904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52859867136,"internally_reserved":0,"allocated":693006336,"data_stored":693006336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52797759488,"internally_reserved":0,"allocated":755113984,"data_stored":755113984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52877295616,"internally_reserved":0,"allocated":675577856,"data_stored":675577856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52724711424,"internally_reserved":0,"allocated":828162048,"data_stored":828162048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":52859867136,"internally_reserved":0,"allocated":693006336,"data_stored":693006336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":52797759488,"internally_reserved":0,"allocated":755113984,"data_stored":755113984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":52877295616,"internally_reserved":0,"allocated":675577856,"data_stored":675577856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52724580352,"internally_reserved":0,"allocated":828293120,"data_stored":828293120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:37:40.452 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 81 16 7720 7704 5.94389 5.0625 0.0844711 0.167914 2024-09-11T14:37:41.452 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 82 16 7805 7789 5.93619 5.3125 0.127309 0.168226 2024-09-11T14:37:41.766 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:37:41.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:41.920+0000 7f21a62fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:41.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:41.927+0000 7f21a62fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:42.452 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 83 16 7887 7871 5.92641 5.125 0.0632963 0.168459 2024-09-11T14:37:43.452 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 84 16 7967 7951 5.91537 5 0.130399 0.168856 2024-09-11T14:37:44.357 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:37:44.452 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 85 16 8048 8032 5.90533 5.0625 0.150101 0.169109 2024-09-11T14:37:44.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:44.493+0000 7f20f7f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:44.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:44.501+0000 7f20f7f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:44.971 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:37:44.972 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:37:44.972 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:37:44.972 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:37:45.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:45.117+0000 7f9047d48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:45.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:45.128+0000 7f9047d48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:45.151 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:37:45.151 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:37:45.151 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:37:45.151 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:37:45.151 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:37:45.152 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:37:45.152 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:37:45.152 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:37:45.152 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:37:45.152 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:37:45.152 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:37:45.152 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:37:45.154 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:37:45.154 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:37:45.154 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:37:45.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:45.279+0000 7f8f45cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:45.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:45.291+0000 7f8f45cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:45.336 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:37:45.336 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:37:45.336 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:37:45.336 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:37:45.336 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:37:45.336 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:37:45.336 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:37:45.336 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:37:45.336 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:37:45.336 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:37:45.337 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:37:45.337 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:37:45.339 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:37:45.339 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:37:45.340 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:37:45.452 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 86 16 8117 8101 5.88681 4.3125 0.0863472 0.169567 2024-09-11T14:37:45.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:45.464+0000 7f40add51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:45.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:45.477+0000 7f40add51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:45.628 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:37:45.629 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:37:45.629 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:37:45.629 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:37:45.629 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:37:45.629 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:37:45.629 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:37:45.629 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:37:45.629 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:37:45.629 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:37:45.629 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:37:45.629 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:37:45.633 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:37:45.637 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:37:45.637 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:37:45.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:45.792+0000 7fa5ef351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:45.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:45.804+0000 7fa5ef351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:45.950 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:37:45.951 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:37:45.951 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:37:45.951 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:37:45.951 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:37:45.951 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:37:45.951 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:37:45.951 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:37:45.951 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:37:45.951 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:37:45.951 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:37:45.951 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:37:45.955 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:37:45.956 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:37:46.453 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 87 16 8202 8186 5.8802 5.3125 0.269137 0.169831 2024-09-11T14:37:47.048 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:37:47.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:47.199+0000 7f77e2ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:47.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:47.207+0000 7f77e2ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:47.452 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 88 16 8284 8268 5.87161 5.125 0.105068 0.170079 2024-09-11T14:37:48.453 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 89 16 8366 8350 5.86322 5.125 0.134839 0.170292 2024-09-11T14:37:49.452 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 90 16 8450 8434 5.8564 5.25 0.183319 0.170532 2024-09-11T14:37:49.502 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:37:49.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:49.607+0000 7faab98a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:49.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:49.613+0000 7faab98a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:50.453 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total time run: 90.1867 2024-09-11T14:37:50.453 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total writes made: 8450 2024-09-11T14:37:50.453 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Write size: 65536 2024-09-11T14:37:50.453 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object size: 65536 2024-09-11T14:37:50.453 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Bandwidth (MB/sec): 5.85591 2024-09-11T14:37:50.453 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Bandwidth: 0.616604 2024-09-11T14:37:50.453 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max bandwidth (MB/sec): 7 2024-09-11T14:37:50.454 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min bandwidth (MB/sec): 4.3125 2024-09-11T14:37:50.454 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average IOPS: 93 2024-09-11T14:37:50.454 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev IOPS: 9.86566 2024-09-11T14:37:50.454 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max IOPS: 112 2024-09-11T14:37:50.454 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min IOPS: 69 2024-09-11T14:37:50.454 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average Latency(s): 0.170573 2024-09-11T14:37:50.454 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Latency(s): 0.107757 2024-09-11T14:37:50.454 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max latency(s): 1.56321 2024-09-11T14:37:50.454 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min latency(s): 0.0263873 2024-09-11T14:37:50.489 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Cleaning up (deleting benchmark objects) 2024-09-11T14:37:50.957 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:37:50.957 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:37:50.957 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:37:50.957 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:37:51.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:51.116+0000 7f802b0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:51.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:51.129+0000 7f802b0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:51.156 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:37:51.156 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:37:51.156 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:37:51.156 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:37:51.156 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:37:51.156 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:37:51.156 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:37:51.157 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:37:51.157 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:37:51.157 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:37:51.157 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:37:51.157 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:37:51.159 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:37:51.159 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:37:51.160 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:37:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:51.310+0000 7f6f8ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:51.337+0000 7f6f8ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:51.431 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:37:51.431 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:37:51.431 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:37:51.431 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:37:51.431 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:37:51.431 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:37:51.431 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:37:51.431 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:37:51.431 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:37:51.432 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:37:51.432 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:37:51.432 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:37:51.436 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:37:51.437 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:37:51.437 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:37:51.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:51.573+0000 7fd45cafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:51.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:51.587+0000 7fd45cafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:51.640 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:37:51.640 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:37:51.640 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:37:51.640 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:37:51.640 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:37:51.640 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:37:51.640 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:37:51.640 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:37:51.640 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:37:51.640 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:37:51.641 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:37:51.641 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:37:51.646 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:37:51.646 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:37:51.647 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:37:51.713 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:37:51.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:51.819+0000 7f35692d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:51.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:51.841+0000 7f35692d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:51.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:51.896+0000 7fca8f49c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:51.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:51.906+0000 7fca8f49c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:37:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:37:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:37:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:37:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:37:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:37:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:37:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:37:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:37:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:37:51.983 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:37:51.983 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:37:51.986 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:37:51.987 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:37:54.361 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:37:54.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:54.506+0000 7f8157f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:54.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:54.515+0000 7f8157f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:56.894 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:37:56.988 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:37:56.988 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:37:56.989 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:37:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:57.037+0000 7f18c4f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:57.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:57.046+0000 7f18c4f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:57.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:57.146+0000 7f48f10d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:57.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:57.161+0000 7f48f10d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:57.458 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:37:57.458 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:37:57.473 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-09-11T14:37:57.240363+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":530711115,"num_objects":8094,"num_object_clones":0,"num_object_copies":24282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":8893,"num_write_kb":541909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8867,"ondisk_log_size":8867,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3185124,"kb_used_data":3185124,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206005788,"statfs":{"total":214211493888,"available":210949926912,"internally_reserved":0,"allocated":3261566976,"data_stored":3261566976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7471128,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":837,"num_write_kb":30401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002857"},"pg_stats":[{"pgid":"3.f","version":"27'580","reported_seq":616,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:53.236459+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:37:53.236459+0000","last_peered":"2024-09-11T14:37:53.236459+0000","last_clean":"2024-09-11T14:37:53.236459+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:37:53.236459+0000","last_undegraded":"2024-09-11T14:37:53.236459+0000","last_fullsized":"2024-09-11T14:37:53.236459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36175872,"num_objects":552,"num_object_clones":0,"num_object_copies":1656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":580,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"27'490","reported_seq":526,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:52.967286+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:37:52.967286+0000","last_peered":"2024-09-11T14:37:52.967286+0000","last_clean":"2024-09-11T14:37:52.967286+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:37:52.967286+0000","last_undegraded":"2024-09-11T14:37:52.967286+0000","last_fullsized":"2024-09-11T14:37:52.967286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29884416,"num_objects":456,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":30272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'512","reported_seq":549,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:53.153231+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:37:53.153231+0000","last_peered":"2024-09-11T14:37:53.153231+0000","last_clean":"2024-09-11T14:37:53.153231+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:37:53.153231+0000","last_undegraded":"2024-09-11T14:37:53.153231+0000","last_fullsized":"2024-09-11T14:37:53.153231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391768,"num_objects":480,"num_object_clones":0,"num_object_copies":1440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":512,"num_write_kb":31681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'554","reported_seq":590,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:53.229564+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:37:53.229564+0000","last_peered":"2024-09-11T14:37:53.229564+0000","last_clean":"2024-09-11T14:37:53.229564+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:37:53.229564+0000","last_undegraded":"2024-09-11T14:37:53.229564+0000","last_fullsized":"2024-09-11T14:37:53.229564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33816576,"num_objects":516,"num_object_clones":0,"num_object_copies":1548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":554,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"27'567","reported_seq":603,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:54.277907+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:37:54.277907+0000","last_peered":"2024-09-11T14:37:54.277907+0000","last_clean":"2024-09-11T14:37:54.277907+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:37:54.277907+0000","last_undegraded":"2024-09-11T14:37:54.277907+0000","last_fullsized":"2024-09-11T14:37:54.277907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33226752,"num_objects":507,"num_object_clones":0,"num_object_copies":1521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":567,"num_write_kb":34368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'562","reported_seq":598,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:53.120902+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:37:53.120902+0000","last_peered":"2024-09-11T14:37:53.120902+0000","last_clean":"2024-09-11T14:37:53.120902+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:37:53.120902+0000","last_undegraded":"2024-09-11T14:37:53.120902+0000","last_fullsized":"2024-09-11T14:37:53.120902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33030144,"num_objects":504,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"27'567","reported_seq":603,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:53.322311+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:37:53.322311+0000","last_peered":"2024-09-11T14:37:53.322311+0000","last_clean":"2024-09-11T14:37:53.322311+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:37:53.322311+0000","last_undegraded":"2024-09-11T14:37:53.322311+0000","last_fullsized":"2024-09-11T14:37:53.322311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":567,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'516","reported_seq":552,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:53.123750+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:37:53.123750+0000","last_peered":"2024-09-11T14:37:53.123750+0000","last_clean":"2024-09-11T14:37:53.123750+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:37:53.123750+0000","last_undegraded":"2024-09-11T14:37:53.123750+0000","last_fullsized":"2024-09-11T14:37:53.123750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31195136,"num_objects":476,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":516,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":121,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.012123+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:37:27.012123+0000","last_peered":"2024-09-11T14:37:27.012123+0000","last_clean":"2024-09-11T14:37:27.012123+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:37:27.012123+0000","last_undegraded":"2024-09-11T14:37:27.012123+0000","last_fullsized":"2024-09-11T14:37:27.012123+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.925408+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:37:26.925408+0000","last_peered":"2024-09-11T14:37:26.925408+0000","last_clean":"2024-09-11T14:37:26.925408+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:37:26.925408+0000","last_undegraded":"2024-09-11T14:37:26.925408+0000","last_fullsized":"2024-09-11T14:37:26.925408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"27'554","reported_seq":590,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:52.668391+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:37:52.668391+0000","last_peered":"2024-09-11T14:37:52.668391+0000","last_clean":"2024-09-11T14:37:52.668391+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:37:52.668391+0000","last_undegraded":"2024-09-11T14:37:52.668391+0000","last_fullsized":"2024-09-11T14:37:52.668391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34340864,"num_objects":524,"num_object_clones":0,"num_object_copies":1572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":554,"num_write_kb":34496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.128052+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:37:27.128052+0000","last_peered":"2024-09-11T14:37:27.128052+0000","last_clean":"2024-09-11T14:37:27.128052+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:37:27.128052+0000","last_undegraded":"2024-09-11T14:37:27.128052+0000","last_fullsized":"2024-09-11T14:37:27.128052+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'628","reported_seq":664,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:53.987002+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:37:53.987002+0000","last_peered":"2024-09-11T14:37:53.987002+0000","last_clean":"2024-09-11T14:37:53.987002+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:37:53.987002+0000","last_undegraded":"2024-09-11T14:37:53.987002+0000","last_fullsized":"2024-09-11T14:37:53.987002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37355520,"num_objects":570,"num_object_clones":0,"num_object_copies":1710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":38336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.913649+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:37:26.913649+0000","last_peered":"2024-09-11T14:37:26.913649+0000","last_clean":"2024-09-11T14:37:26.913649+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:37:26.913649+0000","last_undegraded":"2024-09-11T14:37:26.913649+0000","last_fullsized":"2024-09-11T14:37:26.913649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'568","reported_seq":604,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:54.154017+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:37:54.154017+0000","last_peered":"2024-09-11T14:37:54.154017+0000","last_clean":"2024-09-11T14:37:54.154017+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:37:54.154017+0000","last_undegraded":"2024-09-11T14:37:54.154017+0000","last_fullsized":"2024-09-11T14:37:54.154017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32768000,"num_objects":500,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":34176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.123729+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:37:27.123729+0000","last_peered":"2024-09-11T14:37:27.123729+0000","last_clean":"2024-09-11T14:37:27.123729+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:37:27.123729+0000","last_undegraded":"2024-09-11T14:37:27.123729+0000","last_fullsized":"2024-09-11T14:37:27.123729+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'515","reported_seq":551,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:53.186391+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:37:53.186391+0000","last_peered":"2024-09-11T14:37:53.186391+0000","last_clean":"2024-09-11T14:37:53.186391+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:37:53.186391+0000","last_undegraded":"2024-09-11T14:37:53.186391+0000","last_fullsized":"2024-09-11T14:37:53.186391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30212096,"num_objects":461,"num_object_clones":0,"num_object_copies":1383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"27'543","reported_seq":579,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:53.107791+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:37:53.107791+0000","last_peered":"2024-09-11T14:37:53.107791+0000","last_clean":"2024-09-11T14:37:53.107791+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:37:53.107791+0000","last_undegraded":"2024-09-11T14:37:53.107791+0000","last_fullsized":"2024-09-11T14:37:53.107791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32047104,"num_objects":489,"num_object_clones":0,"num_object_copies":1467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.916515+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:37:26.916515+0000","last_peered":"2024-09-11T14:37:26.916515+0000","last_clean":"2024-09-11T14:37:26.916515+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:37:26.916515+0000","last_undegraded":"2024-09-11T14:37:26.916515+0000","last_fullsized":"2024-09-11T14:37:26.916515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"27'527","reported_seq":563,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:53.133141+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:37:53.133141+0000","last_peered":"2024-09-11T14:37:53.133141+0000","last_clean":"2024-09-11T14:37:53.133141+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:37:53.133141+0000","last_undegraded":"2024-09-11T14:37:53.133141+0000","last_fullsized":"2024-09-11T14:37:53.133141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32571392,"num_objects":497,"num_object_clones":0,"num_object_copies":1491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":527,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.014782+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:37:27.014782+0000","last_peered":"2024-09-11T14:37:27.014782+0000","last_clean":"2024-09-11T14:37:27.014782+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:37:27.014782+0000","last_undegraded":"2024-09-11T14:37:27.014782+0000","last_fullsized":"2024-09-11T14:37:27.014782+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'553","reported_seq":589,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:54.170795+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:37:54.170795+0000","last_peered":"2024-09-11T14:37:54.170795+0000","last_clean":"2024-09-11T14:37:54.170795+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:37:54.170795+0000","last_undegraded":"2024-09-11T14:37:54.170795+0000","last_fullsized":"2024-09-11T14:37:54.170795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32702464,"num_objects":499,"num_object_clones":0,"num_object_copies":1497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.914681+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:37:26.914681+0000","last_peered":"2024-09-11T14:37:26.914681+0000","last_clean":"2024-09-11T14:37:26.914681+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:37:26.914681+0000","last_undegraded":"2024-09-11T14:37:26.914681+0000","last_fullsized":"2024-09-11T14:37:26.914681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'576","reported_seq":612,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:52.880404+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:37:52.880404+0000","last_peered":"2024-09-11T14:37:52.880404+0000","last_clean":"2024-09-11T14:37:52.880404+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:37:52.880404+0000","last_undegraded":"2024-09-11T14:37:52.880404+0000","last_fullsized":"2024-09-11T14:37:52.880404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34734080,"num_objects":530,"num_object_clones":0,"num_object_copies":1590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.918942+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:37:26.918942+0000","last_peered":"2024-09-11T14:37:26.918942+0000","last_clean":"2024-09-11T14:37:26.918942+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:37:26.918942+0000","last_undegraded":"2024-09-11T14:37:26.918942+0000","last_fullsized":"2024-09-11T14:37:26.918942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":530120728,"num_objects":8090,"num_object_clones":0,"num_object_copies":24270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8812,"num_write_kb":540801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210989469696,"internally_reserved":0,"allocated":3222024192,"data_stored":3222024192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8812,"ondisk_log_size":8812,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210988945408,"internally_reserved":0,"allocated":3222548480,"data_stored":3222548480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52624523264,"internally_reserved":0,"allocated":928350208,"data_stored":928350208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673069,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":917548,"kb_used_data":917548,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51380180,"statfs":{"total":53552873472,"available":52613304320,"internally_reserved":0,"allocated":939569152,"data_stored":939569152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":721252,"kb_used_data":721252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51576476,"statfs":{"total":53552873472,"available":52814311424,"internally_reserved":0,"allocated":738562048,"data_stored":738562048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":741976,"kb_used_data":741976,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51555752,"statfs":{"total":53552873472,"available":52793090048,"internally_reserved":0,"allocated":759783424,"data_stored":759783424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":804348,"kb_used_data":804348,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51493380,"statfs":{"total":53552873472,"available":52729221120,"internally_reserved":0,"allocated":823652352,"data_stored":823652352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52624523264,"internally_reserved":0,"allocated":928350208,"data_stored":928350208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52800167936,"internally_reserved":0,"allocated":752705536,"data_stored":752705536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52739842048,"internally_reserved":0,"allocated":813031424,"data_stored":813031424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52824412160,"internally_reserved":0,"allocated":728461312,"data_stored":728461312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52624523264,"internally_reserved":0,"allocated":928350208,"data_stored":928350208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":52800299008,"internally_reserved":0,"allocated":752574464,"data_stored":752574464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":52740104192,"internally_reserved":0,"allocated":812769280,"data_stored":812769280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":52824543232,"internally_reserved":0,"allocated":728330240,"data_stored":728330240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52624523264,"internally_reserved":0,"allocated":928350208,"data_stored":928350208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:37:59.544 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:37:59.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:59.691+0000 7f909d791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:59.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:37:59.698+0000 7f909d791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:02.225 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:38:02.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:02.364+0000 7f13e1391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:02.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:02.371+0000 7f13e1391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:02.475 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:38:02.475 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:38:02.476 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:38:02.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:02.610+0000 7f6534791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:02.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:02.621+0000 7f6534791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:02.941 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:38:02.942 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:38:02.961 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-09-11T14:38:01.241262+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":496042571,"num_objects":7565,"num_object_clones":0,"num_object_copies":22695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":9422,"num_write_kb":541909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9396,"ondisk_log_size":9396,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2975852,"kb_used_data":2975852,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206215060,"statfs":{"total":214211493888,"available":211164221440,"internally_reserved":0,"allocated":3047272448,"data_stored":3047272448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-47251432,"num_objects":-720,"num_object_clones":0,"num_object_copies":-2160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1060,"num_write_kb":10817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002875"},"pg_stats":[{"pgid":"3.f","version":"27'623","reported_seq":659,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:58.234792+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:37:58.234792+0000","last_peered":"2024-09-11T14:37:58.234792+0000","last_clean":"2024-09-11T14:37:58.234792+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:37:58.234792+0000","last_undegraded":"2024-09-11T14:37:58.234792+0000","last_fullsized":"2024-09-11T14:37:58.234792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33357824,"num_objects":509,"num_object_clones":0,"num_object_copies":1527,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":623,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"27'508","reported_seq":544,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:58.046187+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:37:58.046187+0000","last_peered":"2024-09-11T14:37:58.046187+0000","last_clean":"2024-09-11T14:37:58.046187+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:37:58.046187+0000","last_undegraded":"2024-09-11T14:37:58.046187+0000","last_fullsized":"2024-09-11T14:37:58.046187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28704768,"num_objects":438,"num_object_clones":0,"num_object_copies":1314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":30272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'537","reported_seq":574,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:57.646879+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:37:57.646879+0000","last_peered":"2024-09-11T14:37:57.646879+0000","last_clean":"2024-09-11T14:37:57.646879+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:37:57.646879+0000","last_undegraded":"2024-09-11T14:37:57.646879+0000","last_fullsized":"2024-09-11T14:37:57.646879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753368,"num_objects":455,"num_object_clones":0,"num_object_copies":1365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":537,"num_write_kb":31681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'592","reported_seq":628,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:58.141200+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:37:58.141200+0000","last_peered":"2024-09-11T14:37:58.141200+0000","last_clean":"2024-09-11T14:37:58.141200+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:37:58.141200+0000","last_undegraded":"2024-09-11T14:37:58.141200+0000","last_fullsized":"2024-09-11T14:37:58.141200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31326208,"num_objects":478,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"27'601","reported_seq":637,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:59.262484+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:37:59.262484+0000","last_peered":"2024-09-11T14:37:59.262484+0000","last_clean":"2024-09-11T14:37:59.262484+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:37:59.262484+0000","last_undegraded":"2024-09-11T14:37:59.262484+0000","last_fullsized":"2024-09-11T14:37:59.262484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30998528,"num_objects":473,"num_object_clones":0,"num_object_copies":1419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":601,"num_write_kb":34368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'596","reported_seq":632,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:57.905944+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:37:57.905944+0000","last_peered":"2024-09-11T14:37:57.905944+0000","last_clean":"2024-09-11T14:37:57.905944+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:37:57.905944+0000","last_undegraded":"2024-09-11T14:37:57.905944+0000","last_fullsized":"2024-09-11T14:37:57.905944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30801920,"num_objects":470,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":596,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"27'591","reported_seq":627,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:58.193462+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:37:58.193462+0000","last_peered":"2024-09-11T14:37:58.193462+0000","last_clean":"2024-09-11T14:37:58.193462+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:37:58.193462+0000","last_undegraded":"2024-09-11T14:37:58.193462+0000","last_fullsized":"2024-09-11T14:37:58.193462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33095680,"num_objects":505,"num_object_clones":0,"num_object_copies":1515,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":591,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'539","reported_seq":575,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:57.222841+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:37:57.222841+0000","last_peered":"2024-09-11T14:37:57.222841+0000","last_clean":"2024-09-11T14:37:57.222841+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:37:57.222841+0000","last_undegraded":"2024-09-11T14:37:57.222841+0000","last_fullsized":"2024-09-11T14:37:57.222841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29687808,"num_objects":453,"num_object_clones":0,"num_object_copies":1359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":121,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.012123+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:37:27.012123+0000","last_peered":"2024-09-11T14:37:27.012123+0000","last_clean":"2024-09-11T14:37:27.012123+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:37:27.012123+0000","last_undegraded":"2024-09-11T14:37:27.012123+0000","last_fullsized":"2024-09-11T14:37:27.012123+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.925408+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:37:26.925408+0000","last_peered":"2024-09-11T14:37:26.925408+0000","last_clean":"2024-09-11T14:37:26.925408+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:37:26.925408+0000","last_undegraded":"2024-09-11T14:37:26.925408+0000","last_fullsized":"2024-09-11T14:37:26.925408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"27'591","reported_seq":627,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:58.169201+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:37:58.169201+0000","last_peered":"2024-09-11T14:37:58.169201+0000","last_clean":"2024-09-11T14:37:58.169201+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:37:58.169201+0000","last_undegraded":"2024-09-11T14:37:58.169201+0000","last_fullsized":"2024-09-11T14:37:58.169201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31916032,"num_objects":487,"num_object_clones":0,"num_object_copies":1461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":591,"num_write_kb":34496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.128052+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:37:27.128052+0000","last_peered":"2024-09-11T14:37:27.128052+0000","last_clean":"2024-09-11T14:37:27.128052+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:37:27.128052+0000","last_undegraded":"2024-09-11T14:37:27.128052+0000","last_fullsized":"2024-09-11T14:37:27.128052+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'678","reported_seq":714,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:58.986842+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:37:58.986842+0000","last_peered":"2024-09-11T14:37:58.986842+0000","last_clean":"2024-09-11T14:37:58.986842+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:37:58.986842+0000","last_undegraded":"2024-09-11T14:37:58.986842+0000","last_fullsized":"2024-09-11T14:37:58.986842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34078720,"num_objects":520,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":678,"num_write_kb":38336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.913649+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:37:26.913649+0000","last_peered":"2024-09-11T14:37:26.913649+0000","last_clean":"2024-09-11T14:37:26.913649+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:37:26.913649+0000","last_undegraded":"2024-09-11T14:37:26.913649+0000","last_fullsized":"2024-09-11T14:37:26.913649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'601","reported_seq":637,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:58.926630+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:37:58.926630+0000","last_peered":"2024-09-11T14:37:58.926630+0000","last_clean":"2024-09-11T14:37:58.926630+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:37:58.926630+0000","last_undegraded":"2024-09-11T14:37:58.926630+0000","last_fullsized":"2024-09-11T14:37:58.926630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605312,"num_objects":467,"num_object_clones":0,"num_object_copies":1401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":601,"num_write_kb":34176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.123729+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:37:27.123729+0000","last_peered":"2024-09-11T14:37:27.123729+0000","last_clean":"2024-09-11T14:37:27.123729+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:37:27.123729+0000","last_undegraded":"2024-09-11T14:37:27.123729+0000","last_fullsized":"2024-09-11T14:37:27.123729+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'548","reported_seq":584,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:58.141245+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:37:58.141245+0000","last_peered":"2024-09-11T14:37:58.141245+0000","last_clean":"2024-09-11T14:37:58.141245+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:37:58.141245+0000","last_undegraded":"2024-09-11T14:37:58.141245+0000","last_fullsized":"2024-09-11T14:37:58.141245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28049408,"num_objects":428,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"27'584","reported_seq":620,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:58.106077+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:37:58.106077+0000","last_peered":"2024-09-11T14:37:58.106077+0000","last_clean":"2024-09-11T14:37:58.106077+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:37:58.106077+0000","last_undegraded":"2024-09-11T14:37:58.106077+0000","last_fullsized":"2024-09-11T14:37:58.106077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":448,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.916515+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:37:26.916515+0000","last_peered":"2024-09-11T14:37:26.916515+0000","last_clean":"2024-09-11T14:37:26.916515+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:37:26.916515+0000","last_undegraded":"2024-09-11T14:37:26.916515+0000","last_fullsized":"2024-09-11T14:37:26.916515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"27'558","reported_seq":594,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:58.134611+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:37:58.134611+0000","last_peered":"2024-09-11T14:37:58.134611+0000","last_clean":"2024-09-11T14:37:58.134611+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:37:58.134611+0000","last_undegraded":"2024-09-11T14:37:58.134611+0000","last_fullsized":"2024-09-11T14:37:58.134611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30539776,"num_objects":466,"num_object_clones":0,"num_object_copies":1398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":558,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.014782+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:37:27.014782+0000","last_peered":"2024-09-11T14:37:27.014782+0000","last_clean":"2024-09-11T14:37:27.014782+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:37:27.014782+0000","last_undegraded":"2024-09-11T14:37:27.014782+0000","last_fullsized":"2024-09-11T14:37:27.014782+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'581","reported_seq":617,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:58.908922+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:37:58.908922+0000","last_peered":"2024-09-11T14:37:58.908922+0000","last_clean":"2024-09-11T14:37:58.908922+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:37:58.908922+0000","last_undegraded":"2024-09-11T14:37:58.908922+0000","last_fullsized":"2024-09-11T14:37:58.908922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30867456,"num_objects":471,"num_object_clones":0,"num_object_copies":1413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":581,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.914681+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:37:26.914681+0000","last_peered":"2024-09-11T14:37:26.914681+0000","last_clean":"2024-09-11T14:37:26.914681+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:37:26.914681+0000","last_undegraded":"2024-09-11T14:37:26.914681+0000","last_fullsized":"2024-09-11T14:37:26.914681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'613","reported_seq":649,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:57.576140+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:37:57.576140+0000","last_peered":"2024-09-11T14:37:57.576140+0000","last_clean":"2024-09-11T14:37:57.576140+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:37:57.576140+0000","last_undegraded":"2024-09-11T14:37:57.576140+0000","last_fullsized":"2024-09-11T14:37:57.576140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32309248,"num_objects":493,"num_object_clones":0,"num_object_copies":1479,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:26.918942+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:37:26.918942+0000","last_peered":"2024-09-11T14:37:26.918942+0000","last_clean":"2024-09-11T14:37:26.918942+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:37:26.918942+0000","last_undegraded":"2024-09-11T14:37:26.918942+0000","last_fullsized":"2024-09-11T14:37:26.918942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":495452184,"num_objects":7561,"num_object_clones":0,"num_object_copies":22683,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9341,"num_write_kb":540801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211200356352,"internally_reserved":0,"allocated":3011137536,"data_stored":3011137536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9341,"ondisk_log_size":9341,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211200356352,"internally_reserved":0,"allocated":3011137536,"data_stored":3011137536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52686815232,"internally_reserved":0,"allocated":866058240,"data_stored":866058240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673074,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":856704,"kb_used_data":856704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51441024,"statfs":{"total":53552873472,"available":52675608576,"internally_reserved":0,"allocated":877264896,"data_stored":877264896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":672768,"kb_used_data":672768,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51624960,"statfs":{"total":53552873472,"available":52863959040,"internally_reserved":0,"allocated":688914432,"data_stored":688914432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":694408,"kb_used_data":694408,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51603320,"statfs":{"total":53552873472,"available":52841799680,"internally_reserved":0,"allocated":711073792,"data_stored":711073792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":751972,"kb_used_data":751972,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51545756,"statfs":{"total":53552873472,"available":52782854144,"internally_reserved":0,"allocated":770019328,"data_stored":770019328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52686815232,"internally_reserved":0,"allocated":866058240,"data_stored":866058240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52850458624,"internally_reserved":0,"allocated":702414848,"data_stored":702414848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52792037376,"internally_reserved":0,"allocated":760836096,"data_stored":760836096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52871045120,"internally_reserved":0,"allocated":681828352,"data_stored":681828352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52686815232,"internally_reserved":0,"allocated":866058240,"data_stored":866058240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":52850458624,"internally_reserved":0,"allocated":702414848,"data_stored":702414848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":52792037376,"internally_reserved":0,"allocated":760836096,"data_stored":760836096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":52871045120,"internally_reserved":0,"allocated":681828352,"data_stored":681828352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52686815232,"internally_reserved":0,"allocated":866058240,"data_stored":866058240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:38:04.554 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:38:04.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:04.698+0000 7f86868fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:04.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:04.706+0000 7f86868fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:07.050 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:38:07.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:07.189+0000 7f22c0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:07.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:07.198+0000 7f22c0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:07.964 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:38:07.964 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:38:07.964 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:38:07.964 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:38:08.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:08.118+0000 7fef4c0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:08.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:08.128+0000 7fef4c0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:08.145 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:08.145 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:08.145 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:08.145 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:08.145 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:08.145 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:08.145 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:08.145 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:08.145 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:08.146 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:08.146 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:08.146 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:08.149 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:08.149 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:08.149 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:38:08.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:08.275+0000 7f731e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:08.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:08.290+0000 7f731e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:08.383 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:08.383 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:08.383 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:08.383 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:08.383 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:08.383 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:08.383 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:08.383 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:08.383 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:08.383 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:08.383 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:08.384 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:08.387 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:08.388 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:08.388 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:38:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:08.557+0000 7f8caa991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:08.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:08.571+0000 7f8caa991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:08.707 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:08.707 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:08.707 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:08.707 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:08.707 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:08.707 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:08.707 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:08.707 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:08.707 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:08.707 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:08.707 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:08.708 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:08.710 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:08.710 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:08.710 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:38:08.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:08.859+0000 7ff32b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:08.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:08.876+0000 7ff32b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:09.002 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:09.002 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:09.003 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:09.003 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:09.003 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:09.003 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:09.003 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:09.003 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:09.003 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:09.003 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:09.003 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:09.003 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:09.006 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:09.006 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:09.672 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:38:09.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:09.796+0000 7fd2c6263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:09.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:09.804+0000 7fd2c6263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:12.106 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:38:12.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:12.249+0000 7ffa780d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:12.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:12.258+0000 7ffa780d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:14.007 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:38:14.007 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:38:14.007 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:38:14.008 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:38:14.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:14.147+0000 7fc830951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:14.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:14.160+0000 7fc830951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:14.208 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:14.208 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:14.208 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:14.208 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:14.208 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:14.209 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:14.209 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:14.209 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:14.209 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:14.209 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:14.209 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:14.209 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:14.218 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:14.218 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:14.219 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:38:14.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:14.350+0000 7f772a551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:14.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:14.363+0000 7f772a551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:14.515 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:14.515 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:14.516 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:38:14.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:14.667+0000 7fe775aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:14.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:14.682+0000 7fe775aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:14.742 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:38:14.779 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:14.779 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:14.779 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:14.779 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:14.780 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:14.780 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:14.780 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:14.780 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:14.780 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:14.780 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:14.780 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:14.780 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:14.784 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:14.784 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:14.784 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:38:14.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:14.875+0000 7fa155b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:14.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:14.886+0000 7fa155b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:14.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:14.991+0000 7fd15f2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:15.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:15.002+0000 7fd15f2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:15.187 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:15.187 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:15.187 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:15.188 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:15.188 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:15.188 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:15.188 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:15.188 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:15.188 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:15.188 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:15.188 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:15.188 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:15.191 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:15.191 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:17.039 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:38:17.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:17.205+0000 7f79b3111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:17.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:17.211+0000 7f79b3111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:19.574 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:38:19.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:19.701+0000 7f6c53ae3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:19.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:19.709+0000 7f6c53ae3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:20.192 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:38:20.192 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T14:38:20.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:20.351+0000 7fe5d0d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:20.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:20.372+0000 7fe5d0d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:21.307 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T14:38:21.331 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T14:38:21.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:21.462+0000 7f561b493640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:21.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:21.477+0000 7f561b493640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:22.063 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:38:22.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:22.221+0000 7fd641591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:22.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:22.227+0000 7fd641591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:22.307 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T14:38:22.337 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T14:38:22.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:22.518+0000 7f5830b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:22.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:22.534+0000 7f5830b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:23.322 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T14:38:23.344 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T14:38:23.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:23.491+0000 7eff7e26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:23.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:23.505+0000 7eff7e26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:24.323 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T14:38:24.342 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T14:38:24.342 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:38:24.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:24.493+0000 7f8b1c2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:24.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:24.507+0000 7f8b1c2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:24.798 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:38:24.883 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:38:24.883 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:38:24.907 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2024-09-11T14:38:24.323194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":339280459,"num_objects":5173,"num_object_clones":0,"num_object_copies":15519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":11814,"num_write_kb":541909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11788,"ondisk_log_size":11788,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2058948,"kb_used_data":2058948,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207131964,"statfs":{"total":214211493888,"available":212103131136,"internally_reserved":0,"allocated":2108362752,"data_stored":2108362752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-30408704,"num_objects":-464,"num_object_clones":0,"num_object_copies":-1392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.077836"},"pg_stats":[{"pgid":"3.f","version":"29'785","reported_seq":828,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:23.285565+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:38:23.285565+0000","last_peered":"2024-09-11T14:38:23.285565+0000","last_clean":"2024-09-11T14:38:23.285565+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:38:23.285565+0000","last_undegraded":"2024-09-11T14:38:23.285565+0000","last_fullsized":"2024-09-11T14:38:23.285565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22740992,"num_objects":347,"num_object_clones":0,"num_object_copies":1041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":785,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"29'665","reported_seq":707,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.986064+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:38:22.986064+0000","last_peered":"2024-09-11T14:38:22.986064+0000","last_clean":"2024-09-11T14:38:22.986064+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:38:22.986064+0000","last_undegraded":"2024-09-11T14:38:22.986064+0000","last_fullsized":"2024-09-11T14:38:22.986064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18415616,"num_objects":281,"num_object_clones":0,"num_object_copies":843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":665,"num_write_kb":30272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'689","reported_seq":732,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.658016+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:38:22.658016+0000","last_peered":"2024-09-11T14:38:22.658016+0000","last_clean":"2024-09-11T14:38:22.658016+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:38:22.658016+0000","last_undegraded":"2024-09-11T14:38:22.658016+0000","last_fullsized":"2024-09-11T14:38:22.658016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":689,"log_dups_size":0,"ondisk_log_size":689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19791896,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":689,"num_write_kb":31681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"29'751","reported_seq":795,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:23.375960+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:38:23.375960+0000","last_peered":"2024-09-11T14:38:23.375960+0000","last_clean":"2024-09-11T14:38:23.375960+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:38:23.375960+0000","last_undegraded":"2024-09-11T14:38:23.375960+0000","last_fullsized":"2024-09-11T14:38:23.375960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20905984,"num_objects":319,"num_object_clones":0,"num_object_copies":957,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":751,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"27'725","reported_seq":761,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:38:19.199004+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:38:19.199004+0000","last_peered":"2024-09-11T14:38:19.199004+0000","last_clean":"2024-09-11T14:38:19.199004+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:38:19.199004+0000","last_undegraded":"2024-09-11T14:38:19.199004+0000","last_fullsized":"2024-09-11T14:38:19.199004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22872064,"num_objects":349,"num_object_clones":0,"num_object_copies":1047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":725,"num_write_kb":34368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"29'739","reported_seq":781,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.479660+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:38:22.479660+0000","last_peered":"2024-09-11T14:38:22.479660+0000","last_clean":"2024-09-11T14:38:22.479660+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:38:22.479660+0000","last_undegraded":"2024-09-11T14:38:22.479660+0000","last_fullsized":"2024-09-11T14:38:22.479660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21430272,"num_objects":327,"num_object_clones":0,"num_object_copies":981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":739,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"29'775","reported_seq":817,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.614215+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:38:22.614215+0000","last_peered":"2024-09-11T14:38:22.614215+0000","last_clean":"2024-09-11T14:38:22.614215+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:38:22.614215+0000","last_undegraded":"2024-09-11T14:38:22.614215+0000","last_fullsized":"2024-09-11T14:38:22.614215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":775,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'688","reported_seq":730,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T14:38:23.061128+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:38:23.061128+0000","last_peered":"2024-09-11T14:38:23.061128+0000","last_clean":"2024-09-11T14:38:23.061128+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:38:23.061128+0000","last_undegraded":"2024-09-11T14:38:23.061128+0000","last_fullsized":"2024-09-11T14:38:23.061128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19922944,"num_objects":304,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":121,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.012123+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:37:27.012123+0000","last_peered":"2024-09-11T14:37:27.012123+0000","last_clean":"2024-09-11T14:37:27.012123+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:37:27.012123+0000","last_undegraded":"2024-09-11T14:37:27.012123+0000","last_fullsized":"2024-09-11T14:37:27.012123+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.421541+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:38:22.421541+0000","last_peered":"2024-09-11T14:38:22.421541+0000","last_clean":"2024-09-11T14:38:22.421541+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:38:22.421541+0000","last_undegraded":"2024-09-11T14:38:22.421541+0000","last_fullsized":"2024-09-11T14:38:22.421541+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"29'752","reported_seq":794,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.586626+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:38:22.586626+0000","last_peered":"2024-09-11T14:38:22.586626+0000","last_clean":"2024-09-11T14:38:22.586626+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:38:22.586626+0000","last_undegraded":"2024-09-11T14:38:22.586626+0000","last_fullsized":"2024-09-11T14:38:22.586626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21364736,"num_objects":326,"num_object_clones":0,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":34496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:23.384352+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:38:23.384352+0000","last_peered":"2024-09-11T14:38:23.384352+0000","last_clean":"2024-09-11T14:38:23.384352+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:38:23.384352+0000","last_undegraded":"2024-09-11T14:38:23.384352+0000","last_fullsized":"2024-09-11T14:38:23.384352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'827","reported_seq":863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:38:18.704150+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:38:18.704150+0000","last_peered":"2024-09-11T14:38:18.704150+0000","last_clean":"2024-09-11T14:38:18.704150+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:38:18.704150+0000","last_undegraded":"2024-09-11T14:38:18.704150+0000","last_fullsized":"2024-09-11T14:38:18.704150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24313856,"num_objects":371,"num_object_clones":0,"num_object_copies":1113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":827,"num_write_kb":38336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.411499+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:38:22.411499+0000","last_peered":"2024-09-11T14:38:22.411499+0000","last_clean":"2024-09-11T14:38:22.411499+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:38:22.411499+0000","last_undegraded":"2024-09-11T14:38:22.411499+0000","last_fullsized":"2024-09-11T14:38:22.411499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'718","reported_seq":754,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:38:18.958360+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:38:18.958360+0000","last_peered":"2024-09-11T14:38:18.958360+0000","last_clean":"2024-09-11T14:38:18.958360+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:38:18.958360+0000","last_undegraded":"2024-09-11T14:38:18.958360+0000","last_fullsized":"2024-09-11T14:38:18.958360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":718,"log_dups_size":0,"ondisk_log_size":718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":34176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.483904+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:38:22.483904+0000","last_peered":"2024-09-11T14:38:22.483904+0000","last_clean":"2024-09-11T14:38:22.483904+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:38:22.483904+0000","last_undegraded":"2024-09-11T14:38:22.483904+0000","last_fullsized":"2024-09-11T14:38:22.483904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"29'680","reported_seq":722,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.771319+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:38:22.771319+0000","last_peered":"2024-09-11T14:38:22.771319+0000","last_clean":"2024-09-11T14:38:22.771319+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:38:22.771319+0000","last_undegraded":"2024-09-11T14:38:22.771319+0000","last_fullsized":"2024-09-11T14:38:22.771319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19398656,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"29'731","reported_seq":773,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.885837+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:38:22.885837+0000","last_peered":"2024-09-11T14:38:22.885837+0000","last_clean":"2024-09-11T14:38:22.885837+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:38:22.885837+0000","last_undegraded":"2024-09-11T14:38:22.885837+0000","last_fullsized":"2024-09-11T14:38:22.885837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19726336,"num_objects":301,"num_object_clones":0,"num_object_copies":903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.395550+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:38:22.395550+0000","last_peered":"2024-09-11T14:38:22.395550+0000","last_clean":"2024-09-11T14:38:22.395550+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:38:22.395550+0000","last_undegraded":"2024-09-11T14:38:22.395550+0000","last_fullsized":"2024-09-11T14:38:22.395550+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"29'717","reported_seq":759,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:23.261174+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:38:23.261174+0000","last_peered":"2024-09-11T14:38:23.261174+0000","last_clean":"2024-09-11T14:38:23.261174+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:38:23.261174+0000","last_undegraded":"2024-09-11T14:38:23.261174+0000","last_fullsized":"2024-09-11T14:38:23.261174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20119552,"num_objects":307,"num_object_clones":0,"num_object_copies":921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:37:27.014782+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:37:27.014782+0000","last_peered":"2024-09-11T14:37:27.014782+0000","last_clean":"2024-09-11T14:37:27.014782+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:37:27.014782+0000","last_undegraded":"2024-09-11T14:37:27.014782+0000","last_fullsized":"2024-09-11T14:37:27.014782+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'722","reported_seq":758,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T14:38:19.233686+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:38:19.233686+0000","last_peered":"2024-09-11T14:38:19.233686+0000","last_clean":"2024-09-11T14:38:19.233686+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:38:19.233686+0000","last_undegraded":"2024-09-11T14:38:19.233686+0000","last_fullsized":"2024-09-11T14:38:19.233686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21626880,"num_objects":330,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":722,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.385275+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:38:22.385275+0000","last_peered":"2024-09-11T14:38:22.385275+0000","last_clean":"2024-09-11T14:38:22.385275+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:38:22.385275+0000","last_undegraded":"2024-09-11T14:38:22.385275+0000","last_fullsized":"2024-09-11T14:38:22.385275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'769","reported_seq":811,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:23.177093+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:38:23.177093+0000","last_peered":"2024-09-11T14:38:23.177093+0000","last_clean":"2024-09-11T14:38:23.177093+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:38:23.177093+0000","last_undegraded":"2024-09-11T14:38:23.177093+0000","last_fullsized":"2024-09-11T14:38:23.177093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22085632,"num_objects":337,"num_object_clones":0,"num_object_copies":1011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":769,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.419056+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:38:22.419056+0000","last_peered":"2024-09-11T14:38:22.419056+0000","last_clean":"2024-09-11T14:38:22.419056+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:38:22.419056+0000","last_undegraded":"2024-09-11T14:38:22.419056+0000","last_fullsized":"2024-09-11T14:38:22.419056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":338690072,"num_objects":5169,"num_object_clones":0,"num_object_copies":15507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11733,"num_write_kb":540801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212133056512,"internally_reserved":0,"allocated":2078437376,"data_stored":2078437376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11733,"ondisk_log_size":11733,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212132925440,"internally_reserved":0,"allocated":2078568448,"data_stored":2078568448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52916613120,"internally_reserved":0,"allocated":636260352,"data_stored":636260352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673094,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":629824,"kb_used_data":629824,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51667904,"statfs":{"total":53552873472,"available":52907933696,"internally_reserved":0,"allocated":644939776,"data_stored":644939776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":456564,"kb_used_data":456564,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51841164,"statfs":{"total":53552873472,"available":53085351936,"internally_reserved":0,"allocated":467521536,"data_stored":467521536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":466156,"kb_used_data":466156,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51831572,"statfs":{"total":53552873472,"available":53075529728,"internally_reserved":0,"allocated":477343744,"data_stored":477343744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":506404,"kb_used_data":506404,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51791324,"statfs":{"total":53552873472,"available":53034315776,"internally_reserved":0,"allocated":518557696,"data_stored":518557696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52916613120,"internally_reserved":0,"allocated":636260352,"data_stored":636260352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53081706496,"internally_reserved":0,"allocated":471166976,"data_stored":471166976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53042704384,"internally_reserved":0,"allocated":510169088,"data_stored":510169088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53091770368,"internally_reserved":0,"allocated":461103104,"data_stored":461103104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52916744192,"internally_reserved":0,"allocated":636129280,"data_stored":636129280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53081706496,"internally_reserved":0,"allocated":471166976,"data_stored":471166976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53042835456,"internally_reserved":0,"allocated":510038016,"data_stored":510038016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53091770368,"internally_reserved":0,"allocated":461103104,"data_stored":461103104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52916744192,"internally_reserved":0,"allocated":636129280,"data_stored":636129280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:38:24.909 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:38:24.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:24.966+0000 7f69e6991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:24.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:24.977+0000 7f69e6991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:25.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:25.080+0000 7ff0d4657640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:25.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:25.093+0000 7ff0d4657640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:25.429 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:38:25.430 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:38:25.445 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-09-11T14:38:25.246683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":331285067,"num_objects":5051,"num_object_clones":0,"num_object_copies":15153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":11936,"num_write_kb":541909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11910,"ondisk_log_size":11910,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2005824,"kb_used_data":2005824,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207185088,"statfs":{"total":214211493888,"available":212157530112,"internally_reserved":0,"allocated":2053963776,"data_stored":2053963776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-30736384,"num_objects":-469,"num_object_clones":0,"num_object_copies":-1407,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":469,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000821"},"pg_stats":[{"pgid":"3.f","version":"29'785","reported_seq":828,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:23.285565+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:38:23.285565+0000","last_peered":"2024-09-11T14:38:23.285565+0000","last_clean":"2024-09-11T14:38:23.285565+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:38:23.285565+0000","last_undegraded":"2024-09-11T14:38:23.285565+0000","last_fullsized":"2024-09-11T14:38:23.285565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22740992,"num_objects":347,"num_object_clones":0,"num_object_copies":1041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":785,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"29'665","reported_seq":707,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.986064+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:38:22.986064+0000","last_peered":"2024-09-11T14:38:22.986064+0000","last_clean":"2024-09-11T14:38:22.986064+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:38:22.986064+0000","last_undegraded":"2024-09-11T14:38:22.986064+0000","last_fullsized":"2024-09-11T14:38:22.986064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18415616,"num_objects":281,"num_object_clones":0,"num_object_copies":843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":665,"num_write_kb":30272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'689","reported_seq":732,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.658016+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:38:22.658016+0000","last_peered":"2024-09-11T14:38:22.658016+0000","last_clean":"2024-09-11T14:38:22.658016+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:38:22.658016+0000","last_undegraded":"2024-09-11T14:38:22.658016+0000","last_fullsized":"2024-09-11T14:38:22.658016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":689,"log_dups_size":0,"ondisk_log_size":689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19791896,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":689,"num_write_kb":31681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"29'751","reported_seq":795,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:23.375960+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:38:23.375960+0000","last_peered":"2024-09-11T14:38:23.375960+0000","last_clean":"2024-09-11T14:38:23.375960+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:38:23.375960+0000","last_undegraded":"2024-09-11T14:38:23.375960+0000","last_fullsized":"2024-09-11T14:38:23.375960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20905984,"num_objects":319,"num_object_clones":0,"num_object_copies":957,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":751,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"30'752","reported_seq":797,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:23.944925+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:38:23.944925+0000","last_peered":"2024-09-11T14:38:23.944925+0000","last_clean":"2024-09-11T14:38:23.944925+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:38:23.944925+0000","last_undegraded":"2024-09-11T14:38:23.944925+0000","last_fullsized":"2024-09-11T14:38:23.944925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21102592,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":34368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"29'739","reported_seq":781,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.479660+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:38:22.479660+0000","last_peered":"2024-09-11T14:38:22.479660+0000","last_clean":"2024-09-11T14:38:22.479660+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:38:22.479660+0000","last_undegraded":"2024-09-11T14:38:22.479660+0000","last_fullsized":"2024-09-11T14:38:22.479660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21430272,"num_objects":327,"num_object_clones":0,"num_object_copies":981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":739,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"29'775","reported_seq":817,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.614215+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:38:22.614215+0000","last_peered":"2024-09-11T14:38:22.614215+0000","last_clean":"2024-09-11T14:38:22.614215+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:38:22.614215+0000","last_undegraded":"2024-09-11T14:38:22.614215+0000","last_fullsized":"2024-09-11T14:38:22.614215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":775,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'688","reported_seq":730,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T14:38:23.061128+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:38:23.061128+0000","last_peered":"2024-09-11T14:38:23.061128+0000","last_clean":"2024-09-11T14:38:23.061128+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:38:23.061128+0000","last_undegraded":"2024-09-11T14:38:23.061128+0000","last_fullsized":"2024-09-11T14:38:23.061128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19922944,"num_objects":304,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:23.483831+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:38:23.483831+0000","last_peered":"2024-09-11T14:38:23.483831+0000","last_clean":"2024-09-11T14:38:23.483831+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:38:23.483831+0000","last_undegraded":"2024-09-11T14:38:23.483831+0000","last_fullsized":"2024-09-11T14:38:23.483831+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.421541+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:38:22.421541+0000","last_peered":"2024-09-11T14:38:22.421541+0000","last_clean":"2024-09-11T14:38:22.421541+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:38:22.421541+0000","last_undegraded":"2024-09-11T14:38:22.421541+0000","last_fullsized":"2024-09-11T14:38:22.421541+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"29'752","reported_seq":794,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.586626+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:38:22.586626+0000","last_peered":"2024-09-11T14:38:22.586626+0000","last_clean":"2024-09-11T14:38:22.586626+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:38:22.586626+0000","last_undegraded":"2024-09-11T14:38:22.586626+0000","last_fullsized":"2024-09-11T14:38:22.586626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21364736,"num_objects":326,"num_object_clones":0,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":34496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:23.384352+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:38:23.384352+0000","last_peered":"2024-09-11T14:38:23.384352+0000","last_clean":"2024-09-11T14:38:23.384352+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:38:23.384352+0000","last_undegraded":"2024-09-11T14:38:23.384352+0000","last_fullsized":"2024-09-11T14:38:23.384352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"30'866","reported_seq":911,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:23.815664+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:38:23.815664+0000","last_peered":"2024-09-11T14:38:23.815664+0000","last_clean":"2024-09-11T14:38:23.815664+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:38:23.815664+0000","last_undegraded":"2024-09-11T14:38:23.815664+0000","last_fullsized":"2024-09-11T14:38:23.815664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21757952,"num_objects":332,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":866,"num_write_kb":38336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.411499+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:38:22.411499+0000","last_peered":"2024-09-11T14:38:22.411499+0000","last_clean":"2024-09-11T14:38:22.411499+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:38:22.411499+0000","last_undegraded":"2024-09-11T14:38:22.411499+0000","last_fullsized":"2024-09-11T14:38:22.411499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"30'749","reported_seq":794,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:23.743840+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:38:23.743840+0000","last_peered":"2024-09-11T14:38:23.743840+0000","last_clean":"2024-09-11T14:38:23.743840+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:38:23.743840+0000","last_undegraded":"2024-09-11T14:38:23.743840+0000","last_fullsized":"2024-09-11T14:38:23.743840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20905984,"num_objects":319,"num_object_clones":0,"num_object_copies":957,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":34176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.483904+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:38:22.483904+0000","last_peered":"2024-09-11T14:38:22.483904+0000","last_clean":"2024-09-11T14:38:22.483904+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:38:22.483904+0000","last_undegraded":"2024-09-11T14:38:22.483904+0000","last_fullsized":"2024-09-11T14:38:22.483904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"29'680","reported_seq":722,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.771319+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:38:22.771319+0000","last_peered":"2024-09-11T14:38:22.771319+0000","last_clean":"2024-09-11T14:38:22.771319+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:38:22.771319+0000","last_undegraded":"2024-09-11T14:38:22.771319+0000","last_fullsized":"2024-09-11T14:38:22.771319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19398656,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"29'731","reported_seq":773,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.885837+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:38:22.885837+0000","last_peered":"2024-09-11T14:38:22.885837+0000","last_clean":"2024-09-11T14:38:22.885837+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:38:22.885837+0000","last_undegraded":"2024-09-11T14:38:22.885837+0000","last_fullsized":"2024-09-11T14:38:22.885837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19726336,"num_objects":301,"num_object_clones":0,"num_object_copies":903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.395550+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:38:22.395550+0000","last_peered":"2024-09-11T14:38:22.395550+0000","last_clean":"2024-09-11T14:38:22.395550+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:38:22.395550+0000","last_undegraded":"2024-09-11T14:38:22.395550+0000","last_fullsized":"2024-09-11T14:38:22.395550+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"29'717","reported_seq":759,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:23.261174+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:38:23.261174+0000","last_peered":"2024-09-11T14:38:23.261174+0000","last_clean":"2024-09-11T14:38:23.261174+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:38:23.261174+0000","last_undegraded":"2024-09-11T14:38:23.261174+0000","last_fullsized":"2024-09-11T14:38:23.261174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20119552,"num_objects":307,"num_object_clones":0,"num_object_copies":921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:23.487691+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:38:23.487691+0000","last_peered":"2024-09-11T14:38:23.487691+0000","last_clean":"2024-09-11T14:38:23.487691+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:38:23.487691+0000","last_undegraded":"2024-09-11T14:38:23.487691+0000","last_fullsized":"2024-09-11T14:38:23.487691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"30'747","reported_seq":792,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.299224+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:38:24.299224+0000","last_peered":"2024-09-11T14:38:24.299224+0000","last_clean":"2024-09-11T14:38:24.299224+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:38:24.299224+0000","last_undegraded":"2024-09-11T14:38:24.299224+0000","last_fullsized":"2024-09-11T14:38:24.299224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19988480,"num_objects":305,"num_object_clones":0,"num_object_copies":915,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.385275+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:38:22.385275+0000","last_peered":"2024-09-11T14:38:22.385275+0000","last_clean":"2024-09-11T14:38:22.385275+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:38:22.385275+0000","last_undegraded":"2024-09-11T14:38:22.385275+0000","last_fullsized":"2024-09-11T14:38:22.385275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'769","reported_seq":811,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T14:38:23.177093+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:38:23.177093+0000","last_peered":"2024-09-11T14:38:23.177093+0000","last_clean":"2024-09-11T14:38:23.177093+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:38:23.177093+0000","last_undegraded":"2024-09-11T14:38:23.177093+0000","last_fullsized":"2024-09-11T14:38:23.177093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22085632,"num_objects":337,"num_object_clones":0,"num_object_copies":1011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":769,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T14:38:22.419056+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:38:22.419056+0000","last_peered":"2024-09-11T14:38:22.419056+0000","last_clean":"2024-09-11T14:38:22.419056+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:38:22.419056+0000","last_undegraded":"2024-09-11T14:38:22.419056+0000","last_fullsized":"2024-09-11T14:38:22.419056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":330694680,"num_objects":5047,"num_object_clones":0,"num_object_copies":15141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11855,"num_write_kb":540801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212188626944,"internally_reserved":0,"allocated":2022866944,"data_stored":2022866944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11855,"ondisk_log_size":11855,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212188233728,"internally_reserved":0,"allocated":2023260160,"data_stored":2023260160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52972052480,"internally_reserved":0,"allocated":580820992,"data_stored":580820992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673099,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":576700,"kb_used_data":576700,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51721028,"statfs":{"total":53552873472,"available":52962332672,"internally_reserved":0,"allocated":590540800,"data_stored":590540800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":456564,"kb_used_data":456564,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51841164,"statfs":{"total":53552873472,"available":53085351936,"internally_reserved":0,"allocated":467521536,"data_stored":467521536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":466156,"kb_used_data":466156,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51831572,"statfs":{"total":53552873472,"available":53075529728,"internally_reserved":0,"allocated":477343744,"data_stored":477343744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":506404,"kb_used_data":506404,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51791324,"statfs":{"total":53552873472,"available":53034315776,"internally_reserved":0,"allocated":518557696,"data_stored":518557696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52972052480,"internally_reserved":0,"allocated":580820992,"data_stored":580820992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53081706496,"internally_reserved":0,"allocated":471166976,"data_stored":471166976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53042704384,"internally_reserved":0,"allocated":510169088,"data_stored":510169088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53091770368,"internally_reserved":0,"allocated":461103104,"data_stored":461103104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52972052480,"internally_reserved":0,"allocated":580820992,"data_stored":580820992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53081706496,"internally_reserved":0,"allocated":471166976,"data_stored":471166976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53042835456,"internally_reserved":0,"allocated":510038016,"data_stored":510038016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53091770368,"internally_reserved":0,"allocated":461103104,"data_stored":461103104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52972314624,"internally_reserved":0,"allocated":580558848,"data_stored":580558848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:38:25.447 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T14:38:25.447 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:38:25.447 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:38:25.447 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:38:25.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:25.600+0000 7f3ef1551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:25.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:25.617+0000 7f3ef1551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:25.646 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:25.646 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:25.646 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:25.646 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:25.647 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:25.647 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:25.647 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:25.647 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:25.647 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:25.647 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:25.647 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:25.647 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:25.650 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:25.651 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:25.651 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:38:25.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:25.793+0000 7f864367d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:25.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:25.803+0000 7f864367d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:25.827 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:25.827 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:25.827 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:25.827 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:25.827 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:25.827 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:25.827 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:25.828 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:25.828 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:25.828 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:25.828 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:25.828 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:25.831 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:25.831 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:25.832 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:38:25.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:25.955+0000 7fd27389c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:25.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:25.970+0000 7fd27389c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:26.027 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:26.027 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:26.027 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:26.027 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:26.027 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:26.027 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:26.027 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:26.027 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:26.027 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:26.027 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:26.027 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:26.028 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:26.031 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:26.031 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:26.031 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:38:26.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:26.205+0000 7f814c8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:26.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:26.222+0000 7f814c8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:26.368 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:26.368 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:26.368 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:26.369 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:26.369 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:26.369 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:26.369 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:26.369 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:26.369 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:26.369 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:26.369 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:26.369 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:26.373 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:26.373 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:27.345 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:38:27.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:27.512+0000 7fba212d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:27.518+0000 7fba212d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:30.007 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:38:30.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:30.127+0000 7efec4111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:30.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:30.136+0000 7efec4111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:31.374 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:38:31.375 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:38:31.375 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:38:31.375 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:38:31.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:31.514+0000 7f2abccd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:31.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:31.531+0000 7f2abccd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:31.650 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:31.650 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:31.651 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:31.651 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:31.651 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:31.651 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:31.651 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:31.651 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:31.651 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:31.651 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:31.651 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:31.651 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:31.654 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:31.654 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:31.655 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:38:31.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:31.781+0000 7f7a27d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:31.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:31.799+0000 7f7a27d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:31.877 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:31.878 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:31.878 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:31.878 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:31.878 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:31.878 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:31.878 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:31.878 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:31.878 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:31.878 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:31.878 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:31.878 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:31.882 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:31.882 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:31.882 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:38:32.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:32.047+0000 7f1987111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:32.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:32.059+0000 7f1987111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:32.180 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:32.180 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:32.180 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:32.180 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:32.180 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:32.180 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:32.180 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:32.180 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:32.180 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:32.181 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:32.181 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:32.181 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:32.184 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:32.184 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:32.184 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:38:32.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:32.321+0000 7fb74f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:32.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:32.333+0000 7fb74f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:32.532 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:32.532 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:32.532 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:32.533 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:32.533 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:32.533 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:32.533 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:32.533 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:32.533 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:32.533 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:32.533 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:32.533 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:32.535 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:32.536 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:32.676 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:38:32.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:32.833+0000 7f05ef0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:32.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:32.841+0000 7f05ef0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:35.264 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:38:35.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:35.406+0000 7fa93267d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:35.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:35.416+0000 7fa93267d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:37.537 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:38:37.537 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:38:37.537 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:38:37.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:37.684+0000 7f3b0bed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:37.694+0000 7f3b0bed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:37.976 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:38:38.017 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:38:38.019 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:38:38.046 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-09-11T14:38:37.249574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":267780683,"num_objects":4082,"num_object_clones":0,"num_object_copies":12246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12905,"num_write_kb":541909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12879,"ondisk_log_size":12879,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1641344,"kb_used_data":1641344,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207549568,"statfs":{"total":214211493888,"available":212530757632,"internally_reserved":0,"allocated":1680736256,"data_stored":1680736256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-63504384,"num_objects":-969,"num_object_clones":0,"num_object_copies":-2907,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":969,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002890"},"pg_stats":[{"pgid":"3.f","version":"31'855","reported_seq":903,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:33.154335+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:38:33.154335+0000","last_peered":"2024-09-11T14:38:33.154335+0000","last_clean":"2024-09-11T14:38:33.154335+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:38:33.154335+0000","last_undegraded":"2024-09-11T14:38:33.154335+0000","last_fullsized":"2024-09-11T14:38:33.154335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18153472,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":855,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"31'718","reported_seq":766,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:33.005742+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:38:33.005742+0000","last_peered":"2024-09-11T14:38:33.005742+0000","last_clean":"2024-09-11T14:38:33.005742+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:38:33.005742+0000","last_undegraded":"2024-09-11T14:38:33.005742+0000","last_fullsized":"2024-09-11T14:38:33.005742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":718,"log_dups_size":0,"ondisk_log_size":718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14942208,"num_objects":228,"num_object_clones":0,"num_object_copies":684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":30272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'742","reported_seq":791,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:33.039875+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:38:33.039875+0000","last_peered":"2024-09-11T14:38:33.039875+0000","last_clean":"2024-09-11T14:38:33.039875+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:38:33.039875+0000","last_undegraded":"2024-09-11T14:38:33.039875+0000","last_fullsized":"2024-09-11T14:38:33.039875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16318488,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":742,"num_write_kb":31681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"31'815","reported_seq":863,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:33.120059+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:38:33.120059+0000","last_peered":"2024-09-11T14:38:33.120059+0000","last_clean":"2024-09-11T14:38:33.120059+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:38:33.120059+0000","last_undegraded":"2024-09-11T14:38:33.120059+0000","last_fullsized":"2024-09-11T14:38:33.120059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16711680,"num_objects":255,"num_object_clones":0,"num_object_copies":765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"31'811","reported_seq":859,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:33.960496+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:38:33.960496+0000","last_peered":"2024-09-11T14:38:33.960496+0000","last_clean":"2024-09-11T14:38:33.960496+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:38:33.960496+0000","last_undegraded":"2024-09-11T14:38:33.960496+0000","last_fullsized":"2024-09-11T14:38:33.960496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17235968,"num_objects":263,"num_object_clones":0,"num_object_copies":789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":34368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'808","reported_seq":856,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:32.789414+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:38:32.789414+0000","last_peered":"2024-09-11T14:38:32.789414+0000","last_clean":"2024-09-11T14:38:32.789414+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:38:32.789414+0000","last_undegraded":"2024-09-11T14:38:32.789414+0000","last_fullsized":"2024-09-11T14:38:32.789414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"31'837","reported_seq":885,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:33.258012+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:38:33.258012+0000","last_peered":"2024-09-11T14:38:33.258012+0000","last_clean":"2024-09-11T14:38:33.258012+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:38:33.258012+0000","last_undegraded":"2024-09-11T14:38:33.258012+0000","last_fullsized":"2024-09-11T14:38:33.258012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16973824,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"31'740","reported_seq":788,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:33.007070+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:38:33.007070+0000","last_peered":"2024-09-11T14:38:33.007070+0000","last_clean":"2024-09-11T14:38:33.007070+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:38:33.007070+0000","last_undegraded":"2024-09-11T14:38:33.007070+0000","last_fullsized":"2024-09-11T14:38:33.007070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16515072,"num_objects":252,"num_object_clones":0,"num_object_copies":756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.394736+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:38:24.394736+0000","last_peered":"2024-09-11T14:38:24.394736+0000","last_clean":"2024-09-11T14:38:24.394736+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:38:24.394736+0000","last_undegraded":"2024-09-11T14:38:24.394736+0000","last_fullsized":"2024-09-11T14:38:24.394736+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.364524+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:38:24.364524+0000","last_peered":"2024-09-11T14:38:24.364524+0000","last_clean":"2024-09-11T14:38:24.364524+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:38:24.364524+0000","last_undegraded":"2024-09-11T14:38:24.364524+0000","last_fullsized":"2024-09-11T14:38:24.364524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"31'805","reported_seq":853,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:33.157948+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:38:33.157948+0000","last_peered":"2024-09-11T14:38:33.157948+0000","last_clean":"2024-09-11T14:38:33.157948+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:38:33.157948+0000","last_undegraded":"2024-09-11T14:38:33.157948+0000","last_fullsized":"2024-09-11T14:38:33.157948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17891328,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":34496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.554837+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:38:24.554837+0000","last_peered":"2024-09-11T14:38:24.554837+0000","last_clean":"2024-09-11T14:38:24.554837+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:38:24.554837+0000","last_undegraded":"2024-09-11T14:38:24.554837+0000","last_fullsized":"2024-09-11T14:38:24.554837+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"31'934","reported_seq":982,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:34.114387+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:38:34.114387+0000","last_peered":"2024-09-11T14:38:34.114387+0000","last_clean":"2024-09-11T14:38:34.114387+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:38:34.114387+0000","last_undegraded":"2024-09-11T14:38:34.114387+0000","last_fullsized":"2024-09-11T14:38:34.114387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17301504,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":934,"num_write_kb":38336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.360270+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:38:24.360270+0000","last_peered":"2024-09-11T14:38:24.360270+0000","last_clean":"2024-09-11T14:38:24.360270+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:38:24.360270+0000","last_undegraded":"2024-09-11T14:38:24.360270+0000","last_fullsized":"2024-09-11T14:38:24.360270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'825","reported_seq":873,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:34.300129+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:38:34.300129+0000","last_peered":"2024-09-11T14:38:34.300129+0000","last_clean":"2024-09-11T14:38:34.300129+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:38:34.300129+0000","last_undegraded":"2024-09-11T14:38:34.300129+0000","last_fullsized":"2024-09-11T14:38:34.300129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925248,"num_objects":243,"num_object_clones":0,"num_object_copies":729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":825,"num_write_kb":34176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.553754+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:38:24.553754+0000","last_peered":"2024-09-11T14:38:24.553754+0000","last_clean":"2024-09-11T14:38:24.553754+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:38:24.553754+0000","last_undegraded":"2024-09-11T14:38:24.553754+0000","last_fullsized":"2024-09-11T14:38:24.553754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"31'737","reported_seq":785,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:32.333754+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:38:32.333754+0000","last_peered":"2024-09-11T14:38:32.333754+0000","last_clean":"2024-09-11T14:38:32.333754+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:38:32.333754+0000","last_undegraded":"2024-09-11T14:38:32.333754+0000","last_fullsized":"2024-09-11T14:38:32.333754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":737,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"31'785","reported_seq":833,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:33.046841+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:38:33.046841+0000","last_peered":"2024-09-11T14:38:33.046841+0000","last_clean":"2024-09-11T14:38:33.046841+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:38:33.046841+0000","last_undegraded":"2024-09-11T14:38:33.046841+0000","last_fullsized":"2024-09-11T14:38:33.046841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16187392,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":785,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.420843+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:38:24.420843+0000","last_peered":"2024-09-11T14:38:24.420843+0000","last_clean":"2024-09-11T14:38:24.420843+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:38:24.420843+0000","last_undegraded":"2024-09-11T14:38:24.420843+0000","last_fullsized":"2024-09-11T14:38:24.420843+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"31'770","reported_seq":818,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:32.850814+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:38:32.850814+0000","last_peered":"2024-09-11T14:38:32.850814+0000","last_clean":"2024-09-11T14:38:32.850814+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:38:32.850814+0000","last_undegraded":"2024-09-11T14:38:32.850814+0000","last_fullsized":"2024-09-11T14:38:32.850814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16646144,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":770,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.401571+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:38:24.401571+0000","last_peered":"2024-09-11T14:38:24.401571+0000","last_clean":"2024-09-11T14:38:24.401571+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:38:24.401571+0000","last_undegraded":"2024-09-11T14:38:24.401571+0000","last_fullsized":"2024-09-11T14:38:24.401571+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"31'805","reported_seq":853,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:34.020921+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:38:34.020921+0000","last_peered":"2024-09-11T14:38:34.020921+0000","last_clean":"2024-09-11T14:38:34.020921+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:38:34.020921+0000","last_undegraded":"2024-09-11T14:38:34.020921+0000","last_fullsized":"2024-09-11T14:38:34.020921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16187392,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.419106+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:38:24.419106+0000","last_peered":"2024-09-11T14:38:24.419106+0000","last_clean":"2024-09-11T14:38:24.419106+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:38:24.419106+0000","last_undegraded":"2024-09-11T14:38:24.419106+0000","last_fullsized":"2024-09-11T14:38:24.419106+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'837","reported_seq":885,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:33.035152+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:38:33.035152+0000","last_peered":"2024-09-11T14:38:33.035152+0000","last_clean":"2024-09-11T14:38:33.035152+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:38:33.035152+0000","last_undegraded":"2024-09-11T14:38:33.035152+0000","last_fullsized":"2024-09-11T14:38:33.035152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.367002+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:38:24.367002+0000","last_peered":"2024-09-11T14:38:24.367002+0000","last_clean":"2024-09-11T14:38:24.367002+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:38:24.367002+0000","last_undegraded":"2024-09-11T14:38:24.367002+0000","last_fullsized":"2024-09-11T14:38:24.367002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":267190296,"num_objects":4078,"num_object_clones":0,"num_object_copies":12234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12824,"num_write_kb":540801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212567322624,"internally_reserved":0,"allocated":1644171264,"data_stored":1644171264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12824,"ondisk_log_size":12824,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212567322624,"internally_reserved":0,"allocated":1644171264,"data_stored":1644171264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53082169344,"internally_reserved":0,"allocated":470704128,"data_stored":470704128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":470684,"kb_used_data":470684,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51827044,"statfs":{"total":53552873472,"available":53070893056,"internally_reserved":0,"allocated":481980416,"data_stored":481980416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":373176,"kb_used_data":373176,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51924552,"statfs":{"total":53552873472,"available":53170741248,"internally_reserved":0,"allocated":382132224,"data_stored":382132224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":382692,"kb_used_data":382692,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51915036,"statfs":{"total":53552873472,"available":53160996864,"internally_reserved":0,"allocated":391876608,"data_stored":391876608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":414792,"kb_used_data":414792,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51882936,"statfs":{"total":53552873472,"available":53128126464,"internally_reserved":0,"allocated":424747008,"data_stored":424747008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53082169344,"internally_reserved":0,"allocated":470704128,"data_stored":470704128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53168697344,"internally_reserved":0,"allocated":384176128,"data_stored":384176128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53137379328,"internally_reserved":0,"allocated":415494144,"data_stored":415494144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53178945536,"internally_reserved":0,"allocated":373927936,"data_stored":373927936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53082300416,"internally_reserved":0,"allocated":470573056,"data_stored":470573056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53168697344,"internally_reserved":0,"allocated":384176128,"data_stored":384176128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53137379328,"internally_reserved":0,"allocated":415494144,"data_stored":415494144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53178945536,"internally_reserved":0,"allocated":373927936,"data_stored":373927936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53082300416,"internally_reserved":0,"allocated":470573056,"data_stored":470573056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:38:38.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:38.128+0000 7f7c04311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:38.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:38.134+0000 7f7c04311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:40.678 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:38:40.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:40.819+0000 7f1339d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:40.825+0000 7f1339d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:43.048 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:38:43.048 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:38:43.048 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:38:43.048 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:38:43.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:43.192+0000 7fe44d64f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:43.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:43.205+0000 7fe44d64f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:43.228 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:43.228 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:43.228 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:43.228 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:43.228 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:43.228 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:43.228 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:43.228 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:43.228 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:43.229 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:43.229 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:43.229 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:43.232 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:43.232 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:43.232 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:38:43.255 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:38:43.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:43.376+0000 7fe2f9751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:43.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:43.391+0000 7fe2f9751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:43.423 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:43.423 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:43.423 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:43.423 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:43.423 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:43.423 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:43.423 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:43.423 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:43.423 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:43.423 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:43.423 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:43.423 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:43.429 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:43.429 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:43.430 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:38:43.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:43.429+0000 7f2ace87d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:43.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:43.437+0000 7f2ace87d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:43.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:43.580+0000 7faf40991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:43.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:43.595+0000 7faf40991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:43.638 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:43.639 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:43.639 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:43.639 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:43.639 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:43.639 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:43.639 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:43.639 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:43.639 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:43.639 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:43.639 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:43.639 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:43.641 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:43.642 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:43.642 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:38:43.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:43.809+0000 7fc191751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:43.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:43.823+0000 7fc191751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:43.945 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:43.945 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:43.945 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:43.946 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:43.946 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:43.946 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:43.946 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:43.946 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:43.946 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:43.946 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:43.946 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:43.946 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:43.948 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:43.949 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:45.602 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:38:45.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:45.751+0000 7fecc9f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:45.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:45.761+0000 7fecc9f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:48.263 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:38:48.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:48.448+0000 7fd517b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:48.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:48.459+0000 7fd517b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:48.950 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:38:48.950 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:38:48.951 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:38:48.951 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:38:49.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:49.134+0000 7fec36b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:49.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:49.151+0000 7fec36b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:49.321 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:49.321 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:49.321 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:49.321 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:49.321 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:49.321 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:49.321 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:49.321 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:49.321 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:49.321 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:49.321 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:49.321 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:49.325 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:49.326 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:49.326 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:38:49.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:49.515+0000 7f4e41791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:49.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:49.533+0000 7f4e41791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:49.813 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:49.813 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:49.813 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:49.813 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:49.813 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:49.814 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:49.814 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:49.814 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:49.814 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:49.814 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:49.814 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:49.814 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:49.818 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:49.818 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:49.818 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:38:50.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:50.004+0000 7f6afc391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:50.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:50.023+0000 7f6afc391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:50.176 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:50.181 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:50.181 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:50.182 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:38:50.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:50.371+0000 7fcdb2b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:50.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:50.389+0000 7fcdb2b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:50.605 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:38:50.605 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:38:50.605 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:38:50.606 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:38:50.606 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:38:50.606 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:38:50.606 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:38:50.606 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:38:50.606 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:38:50.606 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:38:50.606 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:38:50.606 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:38:50.610 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:38:50.610 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:38:51.355 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:38:51.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:51.538+0000 7f5e13791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:51.548+0000 7f5e13791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:54.389 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:38:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:54.529+0000 7f4948991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:54.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:54.536+0000 7f4948991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:55.611 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:38:55.611 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:38:55.611 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:38:55.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:55.745+0000 7f03a0c93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:55.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:55.757+0000 7f03a0c93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:55.965 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:38:55.966 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:38:55.979 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-09-11T14:38:55.253532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":164627019,"num_objects":2508,"num_object_clones":0,"num_object_copies":7524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":14479,"num_write_kb":541909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14453,"ondisk_log_size":14453,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1016464,"kb_used_data":1016464,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208174448,"statfs":{"total":214211493888,"available":213170634752,"internally_reserved":0,"allocated":1040859136,"data_stored":1040859136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-72679424,"num_objects":-1109,"num_object_clones":0,"num_object_copies":-3327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1109,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002594"},"pg_stats":[{"pgid":"3.f","version":"31'946","reported_seq":994,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:51.911135+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:38:51.911135+0000","last_peered":"2024-09-11T14:38:51.911135+0000","last_clean":"2024-09-11T14:38:51.911135+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:38:51.911135+0000","last_undegraded":"2024-09-11T14:38:51.911135+0000","last_fullsized":"2024-09-11T14:38:51.911135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":946,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"31'805","reported_seq":853,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:52.268999+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:38:52.268999+0000","last_peered":"2024-09-11T14:38:52.268999+0000","last_clean":"2024-09-11T14:38:52.268999+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:38:52.268999+0000","last_undegraded":"2024-09-11T14:38:52.268999+0000","last_fullsized":"2024-09-11T14:38:52.268999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9240576,"num_objects":141,"num_object_clones":0,"num_object_copies":423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":30272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'855","reported_seq":904,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:52.748018+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:38:52.748018+0000","last_peered":"2024-09-11T14:38:52.748018+0000","last_clean":"2024-09-11T14:38:52.748018+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:38:52.748018+0000","last_undegraded":"2024-09-11T14:38:52.748018+0000","last_fullsized":"2024-09-11T14:38:52.748018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8912920,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":855,"num_write_kb":31681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"31'918","reported_seq":966,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:52.250199+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:38:52.250199+0000","last_peered":"2024-09-11T14:38:52.250199+0000","last_clean":"2024-09-11T14:38:52.250199+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:38:52.250199+0000","last_undegraded":"2024-09-11T14:38:52.250199+0000","last_fullsized":"2024-09-11T14:38:52.250199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":918,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"31'927","reported_seq":975,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:54.232020+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:38:54.232020+0000","last_peered":"2024-09-11T14:38:54.232020+0000","last_clean":"2024-09-11T14:38:54.232020+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:38:54.232020+0000","last_undegraded":"2024-09-11T14:38:54.232020+0000","last_fullsized":"2024-09-11T14:38:54.232020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9633792,"num_objects":147,"num_object_clones":0,"num_object_copies":441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":927,"num_write_kb":34368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'903","reported_seq":951,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:52.238375+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:38:52.238375+0000","last_peered":"2024-09-11T14:38:52.238375+0000","last_clean":"2024-09-11T14:38:52.238375+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:38:52.238375+0000","last_undegraded":"2024-09-11T14:38:52.238375+0000","last_fullsized":"2024-09-11T14:38:52.238375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":903,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"31'941","reported_seq":989,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:52.919377+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:38:52.919377+0000","last_peered":"2024-09-11T14:38:52.919377+0000","last_clean":"2024-09-11T14:38:52.919377+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:38:52.919377+0000","last_undegraded":"2024-09-11T14:38:52.919377+0000","last_fullsized":"2024-09-11T14:38:52.919377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":941,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"31'829","reported_seq":877,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:52.803665+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:38:52.803665+0000","last_peered":"2024-09-11T14:38:52.803665+0000","last_clean":"2024-09-11T14:38:52.803665+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:38:52.803665+0000","last_undegraded":"2024-09-11T14:38:52.803665+0000","last_fullsized":"2024-09-11T14:38:52.803665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":829,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.394736+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:38:24.394736+0000","last_peered":"2024-09-11T14:38:24.394736+0000","last_clean":"2024-09-11T14:38:24.394736+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:38:24.394736+0000","last_undegraded":"2024-09-11T14:38:24.394736+0000","last_fullsized":"2024-09-11T14:38:24.394736+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.364524+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:38:24.364524+0000","last_peered":"2024-09-11T14:38:24.364524+0000","last_clean":"2024-09-11T14:38:24.364524+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:38:24.364524+0000","last_undegraded":"2024-09-11T14:38:24.364524+0000","last_fullsized":"2024-09-11T14:38:24.364524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"31'911","reported_seq":959,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:53.138581+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:38:53.138581+0000","last_peered":"2024-09-11T14:38:53.138581+0000","last_clean":"2024-09-11T14:38:53.138581+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:38:53.138581+0000","last_undegraded":"2024-09-11T14:38:53.138581+0000","last_fullsized":"2024-09-11T14:38:53.138581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":911,"log_dups_size":0,"ondisk_log_size":911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10944512,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":34496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.554837+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:38:24.554837+0000","last_peered":"2024-09-11T14:38:24.554837+0000","last_clean":"2024-09-11T14:38:24.554837+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:38:24.554837+0000","last_undegraded":"2024-09-11T14:38:24.554837+0000","last_fullsized":"2024-09-11T14:38:24.554837+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"31'1031","reported_seq":1079,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:53.949790+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:38:53.949790+0000","last_peered":"2024-09-11T14:38:53.949790+0000","last_clean":"2024-09-11T14:38:53.949790+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:38:53.949790+0000","last_undegraded":"2024-09-11T14:38:53.949790+0000","last_fullsized":"2024-09-11T14:38:53.949790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1031,"log_dups_size":0,"ondisk_log_size":1031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10944512,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1031,"num_write_kb":38336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.360270+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:38:24.360270+0000","last_peered":"2024-09-11T14:38:24.360270+0000","last_clean":"2024-09-11T14:38:24.360270+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:38:24.360270+0000","last_undegraded":"2024-09-11T14:38:24.360270+0000","last_fullsized":"2024-09-11T14:38:24.360270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'924","reported_seq":972,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:54.029154+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:38:54.029154+0000","last_peered":"2024-09-11T14:38:54.029154+0000","last_clean":"2024-09-11T14:38:54.029154+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:38:54.029154+0000","last_undegraded":"2024-09-11T14:38:54.029154+0000","last_fullsized":"2024-09-11T14:38:54.029154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":924,"log_dups_size":0,"ondisk_log_size":924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":924,"num_write_kb":34176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.553754+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:38:24.553754+0000","last_peered":"2024-09-11T14:38:24.553754+0000","last_clean":"2024-09-11T14:38:24.553754+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:38:24.553754+0000","last_undegraded":"2024-09-11T14:38:24.553754+0000","last_fullsized":"2024-09-11T14:38:24.553754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"31'826","reported_seq":874,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:53.079984+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:38:53.079984+0000","last_peered":"2024-09-11T14:38:53.079984+0000","last_clean":"2024-09-11T14:38:53.079984+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:38:53.079984+0000","last_undegraded":"2024-09-11T14:38:53.079984+0000","last_fullsized":"2024-09-11T14:38:53.079984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":826,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"31'886","reported_seq":934,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:52.962350+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:38:52.962350+0000","last_peered":"2024-09-11T14:38:52.962350+0000","last_clean":"2024-09-11T14:38:52.962350+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:38:52.962350+0000","last_undegraded":"2024-09-11T14:38:52.962350+0000","last_fullsized":"2024-09-11T14:38:52.962350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":886,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.420843+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:38:24.420843+0000","last_peered":"2024-09-11T14:38:24.420843+0000","last_clean":"2024-09-11T14:38:24.420843+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:38:24.420843+0000","last_undegraded":"2024-09-11T14:38:24.420843+0000","last_fullsized":"2024-09-11T14:38:24.420843+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"31'852","reported_seq":900,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:52.737163+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:38:52.737163+0000","last_peered":"2024-09-11T14:38:52.737163+0000","last_clean":"2024-09-11T14:38:52.737163+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:38:52.737163+0000","last_undegraded":"2024-09-11T14:38:52.737163+0000","last_fullsized":"2024-09-11T14:38:52.737163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":852,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.401571+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:38:24.401571+0000","last_peered":"2024-09-11T14:38:24.401571+0000","last_clean":"2024-09-11T14:38:24.401571+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:38:24.401571+0000","last_undegraded":"2024-09-11T14:38:24.401571+0000","last_fullsized":"2024-09-11T14:38:24.401571+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"31'897","reported_seq":945,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:53.129738+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:38:53.129738+0000","last_peered":"2024-09-11T14:38:53.129738+0000","last_clean":"2024-09-11T14:38:53.129738+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:38:53.129738+0000","last_undegraded":"2024-09-11T14:38:53.129738+0000","last_fullsized":"2024-09-11T14:38:53.129738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":897,"log_dups_size":0,"ondisk_log_size":897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":897,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.419106+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:38:24.419106+0000","last_peered":"2024-09-11T14:38:24.419106+0000","last_clean":"2024-09-11T14:38:24.419106+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:38:24.419106+0000","last_undegraded":"2024-09-11T14:38:24.419106+0000","last_fullsized":"2024-09-11T14:38:24.419106+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'947","reported_seq":995,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:52.834146+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:38:52.834146+0000","last_peered":"2024-09-11T14:38:52.834146+0000","last_clean":"2024-09-11T14:38:52.834146+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:38:52.834146+0000","last_undegraded":"2024-09-11T14:38:52.834146+0000","last_fullsized":"2024-09-11T14:38:52.834146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":947,"log_dups_size":0,"ondisk_log_size":947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":947,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.367002+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:38:24.367002+0000","last_peered":"2024-09-11T14:38:24.367002+0000","last_clean":"2024-09-11T14:38:24.367002+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:38:24.367002+0000","last_undegraded":"2024-09-11T14:38:24.367002+0000","last_fullsized":"2024-09-11T14:38:24.367002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":164036632,"num_objects":2504,"num_object_clones":0,"num_object_copies":7512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14398,"num_write_kb":540801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213187747840,"internally_reserved":0,"allocated":1023746048,"data_stored":1023746048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14398,"ondisk_log_size":14398,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213187616768,"internally_reserved":0,"allocated":1023877120,"data_stored":1023877120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53259538432,"internally_reserved":0,"allocated":293335040,"data_stored":293335040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673129,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":291580,"kb_used_data":291580,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52006148,"statfs":{"total":53552873472,"available":53254295552,"internally_reserved":0,"allocated":298577920,"data_stored":298577920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":231616,"kb_used_data":231616,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52066112,"statfs":{"total":53552873472,"available":53315698688,"internally_reserved":0,"allocated":237174784,"data_stored":237174784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":238100,"kb_used_data":238100,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52059628,"statfs":{"total":53552873472,"available":53309059072,"internally_reserved":0,"allocated":243814400,"data_stored":243814400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":255168,"kb_used_data":255168,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52042560,"statfs":{"total":53552873472,"available":53291581440,"internally_reserved":0,"allocated":261292032,"data_stored":261292032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53259538432,"internally_reserved":0,"allocated":293335040,"data_stored":293335040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53312995328,"internally_reserved":0,"allocated":239878144,"data_stored":239878144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53296070656,"internally_reserved":0,"allocated":256802816,"data_stored":256802816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53319012352,"internally_reserved":0,"allocated":233861120,"data_stored":233861120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53259538432,"internally_reserved":0,"allocated":293335040,"data_stored":293335040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53312995328,"internally_reserved":0,"allocated":239878144,"data_stored":239878144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53296070656,"internally_reserved":0,"allocated":256802816,"data_stored":256802816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53319012352,"internally_reserved":0,"allocated":233861120,"data_stored":233861120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53259669504,"internally_reserved":0,"allocated":293203968,"data_stored":293203968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:38:57.310 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:38:57.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:57.426+0000 7f6be6f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:57.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:38:57.432+0000 7f6be6f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:00.168 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:39:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:00.309+0000 7f24e5991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:00.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:00.317+0000 7f24e5991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:00.982 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:39:00.982 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:39:00.982 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:39:01.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:01.145+0000 7f13b5e93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:01.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:01.155+0000 7f13b5e93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:01.465 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:39:01.466 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:39:01.482 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-09-11T14:39:01.254692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":146932299,"num_objects":2238,"num_object_clones":0,"num_object_copies":6714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":14749,"num_write_kb":541909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14723,"ondisk_log_size":14723,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":913536,"kb_used_data":913536,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208277376,"statfs":{"total":214211493888,"available":213276033024,"internally_reserved":0,"allocated":935460864,"data_stored":935460864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-41877504,"num_objects":-639,"num_object_clones":0,"num_object_copies":-1917,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":639,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002338"},"pg_stats":[{"pgid":"3.f","version":"31'973","reported_seq":1021,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:57.649243+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:38:57.649243+0000","last_peered":"2024-09-11T14:38:57.649243+0000","last_clean":"2024-09-11T14:38:57.649243+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:38:57.649243+0000","last_undegraded":"2024-09-11T14:38:57.649243+0000","last_fullsized":"2024-09-11T14:38:57.649243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":973,"log_dups_size":0,"ondisk_log_size":973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":973,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"31'816","reported_seq":864,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:57.345948+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:38:57.345948+0000","last_peered":"2024-09-11T14:38:57.345948+0000","last_clean":"2024-09-11T14:38:57.345948+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:38:57.345948+0000","last_undegraded":"2024-09-11T14:38:57.345948+0000","last_fullsized":"2024-09-11T14:38:57.345948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":30272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'871","reported_seq":920,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:57.874531+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:38:57.874531+0000","last_peered":"2024-09-11T14:38:57.874531+0000","last_clean":"2024-09-11T14:38:57.874531+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:38:57.874531+0000","last_undegraded":"2024-09-11T14:38:57.874531+0000","last_fullsized":"2024-09-11T14:38:57.874531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864344,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":871,"num_write_kb":31681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"31'930","reported_seq":978,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:57.117696+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:38:57.117696+0000","last_peered":"2024-09-11T14:38:57.117696+0000","last_clean":"2024-09-11T14:38:57.117696+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:38:57.117696+0000","last_undegraded":"2024-09-11T14:38:57.117696+0000","last_fullsized":"2024-09-11T14:38:57.117696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":930,"log_dups_size":0,"ondisk_log_size":930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":930,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"31'946","reported_seq":994,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:58.881731+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:38:58.881731+0000","last_peered":"2024-09-11T14:38:58.881731+0000","last_clean":"2024-09-11T14:38:58.881731+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:38:58.881731+0000","last_undegraded":"2024-09-11T14:38:58.881731+0000","last_fullsized":"2024-09-11T14:38:58.881731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":946,"num_write_kb":34368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'924","reported_seq":972,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:58.277701+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:38:58.277701+0000","last_peered":"2024-09-11T14:38:58.277701+0000","last_clean":"2024-09-11T14:38:58.277701+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:38:58.277701+0000","last_undegraded":"2024-09-11T14:38:58.277701+0000","last_fullsized":"2024-09-11T14:38:58.277701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":924,"log_dups_size":0,"ondisk_log_size":924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":924,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"31'958","reported_seq":1006,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:58.116434+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:38:58.116434+0000","last_peered":"2024-09-11T14:38:58.116434+0000","last_clean":"2024-09-11T14:38:58.116434+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:38:58.116434+0000","last_undegraded":"2024-09-11T14:38:58.116434+0000","last_fullsized":"2024-09-11T14:38:58.116434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"31'847","reported_seq":895,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:57.832522+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:38:57.832522+0000","last_peered":"2024-09-11T14:38:57.832522+0000","last_clean":"2024-09-11T14:38:57.832522+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:38:57.832522+0000","last_undegraded":"2024-09-11T14:38:57.832522+0000","last_fullsized":"2024-09-11T14:38:57.832522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502720,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.394736+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:38:24.394736+0000","last_peered":"2024-09-11T14:38:24.394736+0000","last_clean":"2024-09-11T14:38:24.394736+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:38:24.394736+0000","last_undegraded":"2024-09-11T14:38:24.394736+0000","last_fullsized":"2024-09-11T14:38:24.394736+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.364524+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:38:24.364524+0000","last_peered":"2024-09-11T14:38:24.364524+0000","last_clean":"2024-09-11T14:38:24.364524+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:38:24.364524+0000","last_undegraded":"2024-09-11T14:38:24.364524+0000","last_fullsized":"2024-09-11T14:38:24.364524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"31'921","reported_seq":969,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:57.612185+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:38:57.612185+0000","last_peered":"2024-09-11T14:38:57.612185+0000","last_clean":"2024-09-11T14:38:57.612185+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:38:57.612185+0000","last_undegraded":"2024-09-11T14:38:57.612185+0000","last_fullsized":"2024-09-11T14:38:57.612185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":921,"num_write_kb":34496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.554837+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:38:24.554837+0000","last_peered":"2024-09-11T14:38:24.554837+0000","last_clean":"2024-09-11T14:38:24.554837+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:38:24.554837+0000","last_undegraded":"2024-09-11T14:38:24.554837+0000","last_fullsized":"2024-09-11T14:38:24.554837+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"31'1049","reported_seq":1097,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:58.780862+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:38:58.780862+0000","last_peered":"2024-09-11T14:38:58.780862+0000","last_clean":"2024-09-11T14:38:58.780862+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:38:58.780862+0000","last_undegraded":"2024-09-11T14:38:58.780862+0000","last_fullsized":"2024-09-11T14:38:58.780862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1049,"num_write_kb":38336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.360270+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:38:24.360270+0000","last_peered":"2024-09-11T14:38:24.360270+0000","last_clean":"2024-09-11T14:38:24.360270+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:38:24.360270+0000","last_undegraded":"2024-09-11T14:38:24.360270+0000","last_fullsized":"2024-09-11T14:38:24.360270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'939","reported_seq":987,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:59.357787+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:38:59.357787+0000","last_peered":"2024-09-11T14:38:59.357787+0000","last_clean":"2024-09-11T14:38:59.357787+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:38:59.357787+0000","last_undegraded":"2024-09-11T14:38:59.357787+0000","last_fullsized":"2024-09-11T14:38:59.357787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":939,"log_dups_size":0,"ondisk_log_size":939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":939,"num_write_kb":34176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.553754+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:38:24.553754+0000","last_peered":"2024-09-11T14:38:24.553754+0000","last_clean":"2024-09-11T14:38:24.553754+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:38:24.553754+0000","last_undegraded":"2024-09-11T14:38:24.553754+0000","last_fullsized":"2024-09-11T14:38:24.553754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"31'847","reported_seq":895,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:58.157153+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:38:58.157153+0000","last_peered":"2024-09-11T14:38:58.157153+0000","last_clean":"2024-09-11T14:38:58.157153+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:38:58.157153+0000","last_undegraded":"2024-09-11T14:38:58.157153+0000","last_fullsized":"2024-09-11T14:38:58.157153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"31'900","reported_seq":948,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:58.253213+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:38:58.253213+0000","last_peered":"2024-09-11T14:38:58.253213+0000","last_clean":"2024-09-11T14:38:58.253213+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:38:58.253213+0000","last_undegraded":"2024-09-11T14:38:58.253213+0000","last_fullsized":"2024-09-11T14:38:58.253213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":900,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.420843+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:38:24.420843+0000","last_peered":"2024-09-11T14:38:24.420843+0000","last_clean":"2024-09-11T14:38:24.420843+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:38:24.420843+0000","last_undegraded":"2024-09-11T14:38:24.420843+0000","last_fullsized":"2024-09-11T14:38:24.420843+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"31'870","reported_seq":918,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:58.082016+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:38:58.082016+0000","last_peered":"2024-09-11T14:38:58.082016+0000","last_clean":"2024-09-11T14:38:58.082016+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:38:58.082016+0000","last_undegraded":"2024-09-11T14:38:58.082016+0000","last_fullsized":"2024-09-11T14:38:58.082016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":870,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.401571+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:38:24.401571+0000","last_peered":"2024-09-11T14:38:24.401571+0000","last_clean":"2024-09-11T14:38:24.401571+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:38:24.401571+0000","last_undegraded":"2024-09-11T14:38:24.401571+0000","last_fullsized":"2024-09-11T14:38:24.401571+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"31'920","reported_seq":968,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:59.141541+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:38:59.141541+0000","last_peered":"2024-09-11T14:38:59.141541+0000","last_clean":"2024-09-11T14:38:59.141541+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:38:59.141541+0000","last_undegraded":"2024-09-11T14:38:59.141541+0000","last_fullsized":"2024-09-11T14:38:59.141541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":920,"log_dups_size":0,"ondisk_log_size":920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":920,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.419106+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:38:24.419106+0000","last_peered":"2024-09-11T14:38:24.419106+0000","last_clean":"2024-09-11T14:38:24.419106+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:38:24.419106+0000","last_undegraded":"2024-09-11T14:38:24.419106+0000","last_fullsized":"2024-09-11T14:38:24.419106+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'957","reported_seq":1005,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:57.841917+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:38:57.841917+0000","last_peered":"2024-09-11T14:38:57.841917+0000","last_clean":"2024-09-11T14:38:57.841917+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:38:57.841917+0000","last_undegraded":"2024-09-11T14:38:57.841917+0000","last_fullsized":"2024-09-11T14:38:57.841917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":957,"log_dups_size":0,"ondisk_log_size":957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":957,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.367002+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:38:24.367002+0000","last_peered":"2024-09-11T14:38:24.367002+0000","last_clean":"2024-09-11T14:38:24.367002+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:38:24.367002+0000","last_undegraded":"2024-09-11T14:38:24.367002+0000","last_fullsized":"2024-09-11T14:38:24.367002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":146341912,"num_objects":2234,"num_object_clones":0,"num_object_copies":6702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14668,"num_write_kb":540801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213296324608,"internally_reserved":0,"allocated":915169280,"data_stored":915169280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14668,"ondisk_log_size":14668,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213296324608,"internally_reserved":0,"allocated":915169280,"data_stored":915169280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53291622400,"internally_reserved":0,"allocated":261251072,"data_stored":261251072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673134,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":261988,"kb_used_data":261988,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52035740,"statfs":{"total":53552873472,"available":53284597760,"internally_reserved":0,"allocated":268275712,"data_stored":268275712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705838,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":208000,"kb_used_data":208000,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52089728,"statfs":{"total":53552873472,"available":53339881472,"internally_reserved":0,"allocated":212992000,"data_stored":212992000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705838,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":213744,"kb_used_data":213744,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52083984,"statfs":{"total":53552873472,"available":53333999616,"internally_reserved":0,"allocated":218873856,"data_stored":218873856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705838,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":229804,"kb_used_data":229804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52067924,"statfs":{"total":53552873472,"available":53317554176,"internally_reserved":0,"allocated":235319296,"data_stored":235319296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53291622400,"internally_reserved":0,"allocated":261251072,"data_stored":261251072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53339566080,"internally_reserved":0,"allocated":213307392,"data_stored":213307392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53322039296,"internally_reserved":0,"allocated":230834176,"data_stored":230834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53343096832,"internally_reserved":0,"allocated":209776640,"data_stored":209776640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53291622400,"internally_reserved":0,"allocated":261251072,"data_stored":261251072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53339566080,"internally_reserved":0,"allocated":213307392,"data_stored":213307392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53322039296,"internally_reserved":0,"allocated":230834176,"data_stored":230834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53343096832,"internally_reserved":0,"allocated":209776640,"data_stored":209776640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53291622400,"internally_reserved":0,"allocated":261251072,"data_stored":261251072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:39:02.887 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:39:03.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:03.006+0000 7f4a7ee46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:03.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:03.012+0000 7f4a7ee46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:05.674 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:39:05.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:05.840+0000 7f6779511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:05.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:05.848+0000 7f6779511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:06.484 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:39:06.484 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:39:06.484 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:39:06.484 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:39:06.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:06.635+0000 7f766f908640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:06.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:06.649+0000 7f766f908640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:06.726 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:39:06.726 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:39:06.726 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:39:06.726 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:39:06.726 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:39:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:39:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:39:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:39:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:39:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:39:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:39:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:39:06.730 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:39:06.730 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:39:06.731 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:39:06.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:06.878+0000 7fc906a46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:06.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:06.889+0000 7fc906a46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:06.945 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:39:06.945 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:39:06.945 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:39:06.946 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:39:06.946 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:39:06.946 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:39:06.946 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:39:06.946 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:39:06.946 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:39:06.946 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:39:06.947 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:39:06.947 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:39:06.948 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:39:06.949 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:39:06.949 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:39:07.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:07.068+0000 7fdc476bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:07.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:07.080+0000 7fdc476bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:07.216 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:39:07.216 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:39:07.217 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:39:07.217 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:39:07.217 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:39:07.217 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:39:07.217 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:39:07.221 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:39:07.221 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:39:07.221 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:39:07.221 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:39:07.221 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:39:07.222 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:39:07.222 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:39:07.223 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:39:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:07.351+0000 7fadbbf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:07.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:07.363+0000 7fadbbf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:07.558 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:39:07.558 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:39:07.558 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:39:07.558 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:39:07.559 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:39:07.559 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:39:07.559 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:39:07.559 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:39:07.559 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:39:07.559 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:39:07.559 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:39:07.559 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:39:07.561 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:39:07.561 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:39:08.527 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:39:08.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:08.646+0000 7f05cfb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:08.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:08.653+0000 7f05cfb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:11.164 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:39:11.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:11.317+0000 7ff864088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:11.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:11.324+0000 7ff864088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:12.562 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:39:12.562 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:39:12.562 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:39:12.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:12.681+0000 7f8f6ca63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:12.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:12.693+0000 7f8f6ca63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:12.900 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:39:12.901 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:39:12.915 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2024-09-11T14:39:11.257087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":98566731,"num_objects":1500,"num_object_clones":0,"num_object_copies":4500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":15487,"num_write_kb":541909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15461,"ondisk_log_size":15461,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":630512,"kb_used_data":630512,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208560400,"statfs":{"total":214211493888,"available":213565849600,"internally_reserved":0,"allocated":645644288,"data_stored":645644288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-53280768,"num_objects":-813,"num_object_clones":0,"num_object_copies":-2439,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":813,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002782"},"pg_stats":[{"pgid":"3.f","version":"31'1024","reported_seq":1072,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:07.607108+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:39:07.607108+0000","last_peered":"2024-09-11T14:39:07.607108+0000","last_clean":"2024-09-11T14:39:07.607108+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:39:07.607108+0000","last_undegraded":"2024-09-11T14:39:07.607108+0000","last_fullsized":"2024-09-11T14:39:07.607108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"31'867","reported_seq":915,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:07.721239+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:39:07.721239+0000","last_peered":"2024-09-11T14:39:07.721239+0000","last_clean":"2024-09-11T14:39:07.721239+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:39:07.721239+0000","last_undegraded":"2024-09-11T14:39:07.721239+0000","last_fullsized":"2024-09-11T14:39:07.721239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":867,"num_write_kb":30272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'910","reported_seq":959,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:08.015304+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:39:08.015304+0000","last_peered":"2024-09-11T14:39:08.015304+0000","last_clean":"2024-09-11T14:39:08.015304+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:39:08.015304+0000","last_undegraded":"2024-09-11T14:39:08.015304+0000","last_fullsized":"2024-09-11T14:39:08.015304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308440,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":910,"num_write_kb":31681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"31'974","reported_seq":1022,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:07.323366+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:39:07.323366+0000","last_peered":"2024-09-11T14:39:07.323366+0000","last_clean":"2024-09-11T14:39:07.323366+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:39:07.323366+0000","last_undegraded":"2024-09-11T14:39:07.323366+0000","last_fullsized":"2024-09-11T14:39:07.323366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":974,"log_dups_size":0,"ondisk_log_size":974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":974,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"31'986","reported_seq":1034,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:09.329580+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:39:09.329580+0000","last_peered":"2024-09-11T14:39:09.329580+0000","last_clean":"2024-09-11T14:39:09.329580+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:39:09.329580+0000","last_undegraded":"2024-09-11T14:39:09.329580+0000","last_fullsized":"2024-09-11T14:39:09.329580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":986,"num_write_kb":34368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'974","reported_seq":1022,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:08.151594+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:39:08.151594+0000","last_peered":"2024-09-11T14:39:08.151594+0000","last_clean":"2024-09-11T14:39:08.151594+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:39:08.151594+0000","last_undegraded":"2024-09-11T14:39:08.151594+0000","last_fullsized":"2024-09-11T14:39:08.151594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":974,"log_dups_size":0,"ondisk_log_size":974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":974,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"31'1009","reported_seq":1057,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:07.935313+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:39:07.935313+0000","last_peered":"2024-09-11T14:39:07.935313+0000","last_clean":"2024-09-11T14:39:07.935313+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:39:07.935313+0000","last_undegraded":"2024-09-11T14:39:07.935313+0000","last_fullsized":"2024-09-11T14:39:07.935313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1009,"log_dups_size":0,"ondisk_log_size":1009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1009,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"31'883","reported_seq":931,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:08.235879+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:39:08.235879+0000","last_peered":"2024-09-11T14:39:08.235879+0000","last_clean":"2024-09-11T14:39:08.235879+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:39:08.235879+0000","last_undegraded":"2024-09-11T14:39:08.235879+0000","last_fullsized":"2024-09-11T14:39:08.235879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":883,"log_dups_size":0,"ondisk_log_size":883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":883,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.394736+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:38:24.394736+0000","last_peered":"2024-09-11T14:38:24.394736+0000","last_clean":"2024-09-11T14:38:24.394736+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:38:24.394736+0000","last_undegraded":"2024-09-11T14:38:24.394736+0000","last_fullsized":"2024-09-11T14:38:24.394736+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.364524+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:38:24.364524+0000","last_peered":"2024-09-11T14:38:24.364524+0000","last_clean":"2024-09-11T14:38:24.364524+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:38:24.364524+0000","last_undegraded":"2024-09-11T14:38:24.364524+0000","last_fullsized":"2024-09-11T14:38:24.364524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"31'975","reported_seq":1023,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:08.258340+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:39:08.258340+0000","last_peered":"2024-09-11T14:39:08.258340+0000","last_clean":"2024-09-11T14:39:08.258340+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:39:08.258340+0000","last_undegraded":"2024-09-11T14:39:08.258340+0000","last_fullsized":"2024-09-11T14:39:08.258340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":975,"log_dups_size":0,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750208,"num_objects":103,"num_object_clones":0,"num_object_copies":309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":975,"num_write_kb":34496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.554837+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:38:24.554837+0000","last_peered":"2024-09-11T14:38:24.554837+0000","last_clean":"2024-09-11T14:38:24.554837+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:38:24.554837+0000","last_undegraded":"2024-09-11T14:38:24.554837+0000","last_fullsized":"2024-09-11T14:38:24.554837+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"31'1107","reported_seq":1155,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:09.102427+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:39:09.102427+0000","last_peered":"2024-09-11T14:39:09.102427+0000","last_clean":"2024-09-11T14:39:09.102427+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:39:09.102427+0000","last_undegraded":"2024-09-11T14:39:09.102427+0000","last_fullsized":"2024-09-11T14:39:09.102427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1107,"log_dups_size":0,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5963776,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1107,"num_write_kb":38336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.360270+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:38:24.360270+0000","last_peered":"2024-09-11T14:38:24.360270+0000","last_clean":"2024-09-11T14:38:24.360270+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:38:24.360270+0000","last_undegraded":"2024-09-11T14:38:24.360270+0000","last_fullsized":"2024-09-11T14:38:24.360270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'982","reported_seq":1030,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:09.194299+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:39:09.194299+0000","last_peered":"2024-09-11T14:39:09.194299+0000","last_clean":"2024-09-11T14:39:09.194299+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:39:09.194299+0000","last_undegraded":"2024-09-11T14:39:09.194299+0000","last_fullsized":"2024-09-11T14:39:09.194299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":982,"log_dups_size":0,"ondisk_log_size":982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":982,"num_write_kb":34176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.553754+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:38:24.553754+0000","last_peered":"2024-09-11T14:38:24.553754+0000","last_clean":"2024-09-11T14:38:24.553754+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:38:24.553754+0000","last_undegraded":"2024-09-11T14:38:24.553754+0000","last_fullsized":"2024-09-11T14:38:24.553754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"31'892","reported_seq":940,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:07.977790+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:39:07.977790+0000","last_peered":"2024-09-11T14:39:07.977790+0000","last_clean":"2024-09-11T14:39:07.977790+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:39:07.977790+0000","last_undegraded":"2024-09-11T14:39:07.977790+0000","last_fullsized":"2024-09-11T14:39:07.977790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"31'934","reported_seq":982,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:07.767902+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:39:07.767902+0000","last_peered":"2024-09-11T14:39:07.767902+0000","last_clean":"2024-09-11T14:39:07.767902+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:39:07.767902+0000","last_undegraded":"2024-09-11T14:39:07.767902+0000","last_fullsized":"2024-09-11T14:39:07.767902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":934,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.420843+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:38:24.420843+0000","last_peered":"2024-09-11T14:38:24.420843+0000","last_clean":"2024-09-11T14:38:24.420843+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:38:24.420843+0000","last_undegraded":"2024-09-11T14:38:24.420843+0000","last_fullsized":"2024-09-11T14:38:24.420843+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"31'918","reported_seq":966,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:07.976091+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:39:07.976091+0000","last_peered":"2024-09-11T14:39:07.976091+0000","last_clean":"2024-09-11T14:39:07.976091+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:39:07.976091+0000","last_undegraded":"2024-09-11T14:39:07.976091+0000","last_fullsized":"2024-09-11T14:39:07.976091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":918,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.401571+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:38:24.401571+0000","last_peered":"2024-09-11T14:38:24.401571+0000","last_clean":"2024-09-11T14:38:24.401571+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:38:24.401571+0000","last_undegraded":"2024-09-11T14:38:24.401571+0000","last_fullsized":"2024-09-11T14:38:24.401571+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"31'967","reported_seq":1015,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:09.170949+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:39:09.170949+0000","last_peered":"2024-09-11T14:39:09.170949+0000","last_clean":"2024-09-11T14:39:09.170949+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:39:09.170949+0000","last_undegraded":"2024-09-11T14:39:09.170949+0000","last_fullsized":"2024-09-11T14:39:09.170949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":967,"log_dups_size":0,"ondisk_log_size":967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":967,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.419106+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:38:24.419106+0000","last_peered":"2024-09-11T14:38:24.419106+0000","last_clean":"2024-09-11T14:38:24.419106+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:38:24.419106+0000","last_undegraded":"2024-09-11T14:38:24.419106+0000","last_fullsized":"2024-09-11T14:38:24.419106+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'1004","reported_seq":1052,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:07.619469+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:39:07.619469+0000","last_peered":"2024-09-11T14:39:07.619469+0000","last_clean":"2024-09-11T14:39:07.619469+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:39:07.619469+0000","last_undegraded":"2024-09-11T14:39:07.619469+0000","last_fullsized":"2024-09-11T14:39:07.619469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1004,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.367002+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:38:24.367002+0000","last_peered":"2024-09-11T14:38:24.367002+0000","last_clean":"2024-09-11T14:38:24.367002+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:38:24.367002+0000","last_undegraded":"2024-09-11T14:38:24.367002+0000","last_fullsized":"2024-09-11T14:38:24.367002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":97976344,"num_objects":1496,"num_object_clones":0,"num_object_copies":4488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15406,"num_write_kb":540801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213586558976,"internally_reserved":0,"allocated":624934912,"data_stored":624934912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15406,"ondisk_log_size":15406,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213586411520,"internally_reserved":0,"allocated":625082368,"data_stored":625082368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53375365120,"internally_reserved":0,"allocated":177508352,"data_stored":177508352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673144,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":180268,"kb_used_data":180268,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52117460,"statfs":{"total":53552873472,"available":53368279040,"internally_reserved":0,"allocated":184594432,"data_stored":184594432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":146588,"kb_used_data":146588,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52151140,"statfs":{"total":53552873472,"available":53402767360,"internally_reserved":0,"allocated":150106112,"data_stored":150106112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":145044,"kb_used_data":145044,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52152684,"statfs":{"total":53552873472,"available":53404348416,"internally_reserved":0,"allocated":148525056,"data_stored":148525056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":158612,"kb_used_data":158612,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52139116,"statfs":{"total":53552873472,"available":53390454784,"internally_reserved":0,"allocated":162418688,"data_stored":162418688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53375365120,"internally_reserved":0,"allocated":177508352,"data_stored":177508352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53408768000,"internally_reserved":0,"allocated":144105472,"data_stored":144105472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53395750912,"internally_reserved":0,"allocated":157122560,"data_stored":157122560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53406396416,"internally_reserved":0,"allocated":146477056,"data_stored":146477056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53375496192,"internally_reserved":0,"allocated":177377280,"data_stored":177377280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53408768000,"internally_reserved":0,"allocated":144105472,"data_stored":144105472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53395750912,"internally_reserved":0,"allocated":157122560,"data_stored":157122560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53406396416,"internally_reserved":0,"allocated":146477056,"data_stored":146477056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53375643648,"internally_reserved":0,"allocated":177229824,"data_stored":177229824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:39:13.854 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:39:14.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:14.011+0000 7fcdb3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:14.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:14.019+0000 7fcdb3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:16.741 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:39:16.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:16.895+0000 7f6bdeb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:16.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:16.902+0000 7f6bdeb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:17.917 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:39:17.917 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:39:17.917 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:39:18.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:18.042+0000 7f698887f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:18.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:18.051+0000 7f698887f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:18.321 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:39:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:39:18.341 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-09-11T14:39:17.258575+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":76153419,"num_objects":1158,"num_object_clones":0,"num_object_copies":3474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":15829,"num_write_kb":541909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15803,"ondisk_log_size":15803,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":497088,"kb_used_data":497088,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208693824,"statfs":{"total":214211493888,"available":213702475776,"internally_reserved":0,"allocated":509018112,"data_stored":509018112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-47185920,"num_objects":-720,"num_object_clones":0,"num_object_copies":-2160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003044"},"pg_stats":[{"pgid":"3.f","version":"31'1046","reported_seq":1094,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:13.219046+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:39:13.219046+0000","last_peered":"2024-09-11T14:39:13.219046+0000","last_clean":"2024-09-11T14:39:13.219046+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:39:13.219046+0000","last_undegraded":"2024-09-11T14:39:13.219046+0000","last_fullsized":"2024-09-11T14:39:13.219046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1046,"log_dups_size":0,"ondisk_log_size":1046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1046,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"31'888","reported_seq":936,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:12.583457+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:39:12.583457+0000","last_peered":"2024-09-11T14:39:12.583457+0000","last_clean":"2024-09-11T14:39:12.583457+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:39:12.583457+0000","last_undegraded":"2024-09-11T14:39:12.583457+0000","last_fullsized":"2024-09-11T14:39:12.583457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":30272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'922","reported_seq":971,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:12.277220+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:39:12.277220+0000","last_peered":"2024-09-11T14:39:12.277220+0000","last_clean":"2024-09-11T14:39:12.277220+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:39:12.277220+0000","last_undegraded":"2024-09-11T14:39:12.277220+0000","last_fullsized":"2024-09-11T14:39:12.277220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":922,"log_dups_size":0,"ondisk_log_size":922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4522008,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":922,"num_write_kb":31681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"31'993","reported_seq":1041,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:12.838896+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:39:12.838896+0000","last_peered":"2024-09-11T14:39:12.838896+0000","last_clean":"2024-09-11T14:39:12.838896+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:39:12.838896+0000","last_undegraded":"2024-09-11T14:39:12.838896+0000","last_fullsized":"2024-09-11T14:39:12.838896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":993,"log_dups_size":0,"ondisk_log_size":993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":993,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"31'1004","reported_seq":1052,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:13.828592+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:39:13.828592+0000","last_peered":"2024-09-11T14:39:13.828592+0000","last_clean":"2024-09-11T14:39:13.828592+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:39:13.828592+0000","last_undegraded":"2024-09-11T14:39:13.828592+0000","last_fullsized":"2024-09-11T14:39:13.828592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1004,"num_write_kb":34368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'996","reported_seq":1044,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:13.195118+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:39:13.195118+0000","last_peered":"2024-09-11T14:39:13.195118+0000","last_clean":"2024-09-11T14:39:13.195118+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:39:13.195118+0000","last_undegraded":"2024-09-11T14:39:13.195118+0000","last_fullsized":"2024-09-11T14:39:13.195118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":996,"log_dups_size":0,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":996,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"31'1032","reported_seq":1080,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:13.267682+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:39:13.267682+0000","last_peered":"2024-09-11T14:39:13.267682+0000","last_clean":"2024-09-11T14:39:13.267682+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:39:13.267682+0000","last_undegraded":"2024-09-11T14:39:13.267682+0000","last_fullsized":"2024-09-11T14:39:13.267682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1032,"log_dups_size":0,"ondisk_log_size":1032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1032,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"31'910","reported_seq":958,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:12.793223+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:39:12.793223+0000","last_peered":"2024-09-11T14:39:12.793223+0000","last_clean":"2024-09-11T14:39:12.793223+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:39:12.793223+0000","last_undegraded":"2024-09-11T14:39:12.793223+0000","last_fullsized":"2024-09-11T14:39:12.793223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":910,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.394736+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:38:24.394736+0000","last_peered":"2024-09-11T14:38:24.394736+0000","last_clean":"2024-09-11T14:38:24.394736+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:38:24.394736+0000","last_undegraded":"2024-09-11T14:38:24.394736+0000","last_fullsized":"2024-09-11T14:38:24.394736+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.364524+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:38:24.364524+0000","last_peered":"2024-09-11T14:38:24.364524+0000","last_clean":"2024-09-11T14:38:24.364524+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:38:24.364524+0000","last_undegraded":"2024-09-11T14:38:24.364524+0000","last_fullsized":"2024-09-11T14:38:24.364524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"31'1000","reported_seq":1048,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:12.657001+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:39:12.657001+0000","last_peered":"2024-09-11T14:39:12.657001+0000","last_clean":"2024-09-11T14:39:12.657001+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:39:12.657001+0000","last_undegraded":"2024-09-11T14:39:12.657001+0000","last_fullsized":"2024-09-11T14:39:12.657001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1000,"log_dups_size":0,"ondisk_log_size":1000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1000,"num_write_kb":34496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.554837+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:38:24.554837+0000","last_peered":"2024-09-11T14:38:24.554837+0000","last_clean":"2024-09-11T14:38:24.554837+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:38:24.554837+0000","last_undegraded":"2024-09-11T14:38:24.554837+0000","last_fullsized":"2024-09-11T14:38:24.554837+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"31'1126","reported_seq":1174,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:14.068736+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:39:14.068736+0000","last_peered":"2024-09-11T14:39:14.068736+0000","last_clean":"2024-09-11T14:39:14.068736+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:39:14.068736+0000","last_undegraded":"2024-09-11T14:39:14.068736+0000","last_fullsized":"2024-09-11T14:39:14.068736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1126,"log_dups_size":0,"ondisk_log_size":1126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1126,"num_write_kb":38336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.360270+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:38:24.360270+0000","last_peered":"2024-09-11T14:38:24.360270+0000","last_clean":"2024-09-11T14:38:24.360270+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:38:24.360270+0000","last_undegraded":"2024-09-11T14:38:24.360270+0000","last_fullsized":"2024-09-11T14:38:24.360270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'1006","reported_seq":1054,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:13.718656+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:39:13.718656+0000","last_peered":"2024-09-11T14:39:13.718656+0000","last_clean":"2024-09-11T14:39:13.718656+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:39:13.718656+0000","last_undegraded":"2024-09-11T14:39:13.718656+0000","last_fullsized":"2024-09-11T14:39:13.718656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1006,"log_dups_size":0,"ondisk_log_size":1006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1006,"num_write_kb":34176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.553754+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:38:24.553754+0000","last_peered":"2024-09-11T14:38:24.553754+0000","last_clean":"2024-09-11T14:38:24.553754+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:38:24.553754+0000","last_undegraded":"2024-09-11T14:38:24.553754+0000","last_fullsized":"2024-09-11T14:38:24.553754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"31'908","reported_seq":956,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:12.884995+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:39:12.884995+0000","last_peered":"2024-09-11T14:39:12.884995+0000","last_clean":"2024-09-11T14:39:12.884995+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:39:12.884995+0000","last_undegraded":"2024-09-11T14:39:12.884995+0000","last_fullsized":"2024-09-11T14:39:12.884995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"31'960","reported_seq":1008,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:12.955914+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:39:12.955914+0000","last_peered":"2024-09-11T14:39:12.955914+0000","last_clean":"2024-09-11T14:39:12.955914+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:39:12.955914+0000","last_undegraded":"2024-09-11T14:39:12.955914+0000","last_fullsized":"2024-09-11T14:39:12.955914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":960,"log_dups_size":0,"ondisk_log_size":960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":960,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.420843+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:38:24.420843+0000","last_peered":"2024-09-11T14:38:24.420843+0000","last_clean":"2024-09-11T14:38:24.420843+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:38:24.420843+0000","last_undegraded":"2024-09-11T14:38:24.420843+0000","last_fullsized":"2024-09-11T14:38:24.420843+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"31'934","reported_seq":982,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:13.129591+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:39:13.129591+0000","last_peered":"2024-09-11T14:39:13.129591+0000","last_clean":"2024-09-11T14:39:13.129591+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:39:13.129591+0000","last_undegraded":"2024-09-11T14:39:13.129591+0000","last_fullsized":"2024-09-11T14:39:13.129591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":934,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.401571+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:38:24.401571+0000","last_peered":"2024-09-11T14:38:24.401571+0000","last_clean":"2024-09-11T14:38:24.401571+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:38:24.401571+0000","last_undegraded":"2024-09-11T14:38:24.401571+0000","last_fullsized":"2024-09-11T14:38:24.401571+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"31'992","reported_seq":1040,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:13.793275+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:39:13.793275+0000","last_peered":"2024-09-11T14:39:13.793275+0000","last_clean":"2024-09-11T14:39:13.793275+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:39:13.793275+0000","last_undegraded":"2024-09-11T14:39:13.793275+0000","last_fullsized":"2024-09-11T14:39:13.793275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":992,"log_dups_size":0,"ondisk_log_size":992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":992,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.419106+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:38:24.419106+0000","last_peered":"2024-09-11T14:38:24.419106+0000","last_clean":"2024-09-11T14:38:24.419106+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:38:24.419106+0000","last_undegraded":"2024-09-11T14:38:24.419106+0000","last_fullsized":"2024-09-11T14:38:24.419106+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'1031","reported_seq":1079,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:13.277695+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:39:13.277695+0000","last_peered":"2024-09-11T14:39:13.277695+0000","last_clean":"2024-09-11T14:39:13.277695+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:39:13.277695+0000","last_undegraded":"2024-09-11T14:39:13.277695+0000","last_fullsized":"2024-09-11T14:39:13.277695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1031,"log_dups_size":0,"ondisk_log_size":1031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1031,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.367002+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:38:24.367002+0000","last_peered":"2024-09-11T14:38:24.367002+0000","last_clean":"2024-09-11T14:38:24.367002+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:38:24.367002+0000","last_undegraded":"2024-09-11T14:38:24.367002+0000","last_fullsized":"2024-09-11T14:38:24.367002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":75563032,"num_objects":1154,"num_object_clones":0,"num_object_copies":3462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15748,"num_write_kb":540801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213723656192,"internally_reserved":0,"allocated":487837696,"data_stored":487837696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15748,"ondisk_log_size":15748,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213723656192,"internally_reserved":0,"allocated":487837696,"data_stored":487837696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53415211008,"internally_reserved":0,"allocated":137662464,"data_stored":137662464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":140884,"kb_used_data":140884,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52156844,"statfs":{"total":53552873472,"available":53408608256,"internally_reserved":0,"allocated":144265216,"data_stored":144265216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":115580,"kb_used_data":115580,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52182148,"statfs":{"total":53552873472,"available":53434519552,"internally_reserved":0,"allocated":118353920,"data_stored":118353920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":116996,"kb_used_data":116996,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52180732,"statfs":{"total":53552873472,"available":53433069568,"internally_reserved":0,"allocated":119803904,"data_stored":119803904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":123628,"kb_used_data":123628,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52174100,"statfs":{"total":53552873472,"available":53426278400,"internally_reserved":0,"allocated":126595072,"data_stored":126595072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53415211008,"internally_reserved":0,"allocated":137662464,"data_stored":137662464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53437067264,"internally_reserved":0,"allocated":115806208,"data_stored":115806208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53431697408,"internally_reserved":0,"allocated":121176064,"data_stored":121176064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53439680512,"internally_reserved":0,"allocated":113192960,"data_stored":113192960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53415211008,"internally_reserved":0,"allocated":137662464,"data_stored":137662464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53437067264,"internally_reserved":0,"allocated":115806208,"data_stored":115806208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53431697408,"internally_reserved":0,"allocated":121176064,"data_stored":121176064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53439680512,"internally_reserved":0,"allocated":113192960,"data_stored":113192960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53415211008,"internally_reserved":0,"allocated":137662464,"data_stored":137662464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:39:19.384 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:39:19.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:19.514+0000 7fa43b893640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:19.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:19.523+0000 7fa43b893640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:22.135 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:39:22.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:22.249+0000 7fcc66791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:22.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:22.257+0000 7fcc66791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:23.343 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:39:23.344 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T14:39:23.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:23.484+0000 7f65170bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:23.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:23.497+0000 7f65170bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:24.620 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:39:24.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:24.756+0000 7f80e4351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:24.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:24.765+0000 7f80e4351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:24.841 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T14:39:24.860 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T14:39:25.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:25.001+0000 7fe5b8ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:25.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:25.022+0000 7fe5b8ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:25.847 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T14:39:25.869 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T14:39:26.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:26.008+0000 7f8e89b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:26.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:26.023+0000 7f8e89b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:26.851 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T14:39:26.875 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T14:39:27.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:26.994+0000 7f7088911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:27.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:27.006+0000 7f7088911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:27.221 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:39:27.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:27.350+0000 7f0ecd87d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:27.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:27.358+0000 7f0ecd87d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:27.855 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T14:39:27.879 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T14:39:27.879 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:39:28.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:28.015+0000 7f152df51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:28.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:28.025+0000 7f152df51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:28.406 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:39:28.407 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:39:28.424 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-09-11T14:39:27.855615+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28049995,"num_objects":424,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":16563,"num_write_kb":541909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16537,"ondisk_log_size":16537,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":219748,"kb_used_data":219748,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208971164,"statfs":{"total":214211493888,"available":213986471936,"internally_reserved":0,"allocated":225021952,"data_stored":225021952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-26345472,"num_objects":-402,"num_object_clones":0,"num_object_copies":-1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.595611"},"pg_stats":[{"pgid":"3.f","version":"31'1104","reported_seq":1152,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.329359+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:39:23.329359+0000","last_peered":"2024-09-11T14:39:23.329359+0000","last_clean":"2024-09-11T14:39:23.329359+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:39:23.329359+0000","last_undegraded":"2024-09-11T14:39:23.329359+0000","last_fullsized":"2024-09-11T14:39:23.329359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1104,"log_dups_size":0,"ondisk_log_size":1104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1104,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"31'926","reported_seq":974,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.162641+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:39:23.162641+0000","last_peered":"2024-09-11T14:39:23.162641+0000","last_clean":"2024-09-11T14:39:23.162641+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:39:23.162641+0000","last_undegraded":"2024-09-11T14:39:23.162641+0000","last_fullsized":"2024-09-11T14:39:23.162641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":926,"num_write_kb":30272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'970","reported_seq":1019,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.312516+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:39:23.312516+0000","last_peered":"2024-09-11T14:39:23.312516+0000","last_clean":"2024-09-11T14:39:23.312516+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:39:23.312516+0000","last_undegraded":"2024-09-11T14:39:23.312516+0000","last_fullsized":"2024-09-11T14:39:23.312516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":970,"log_dups_size":0,"ondisk_log_size":970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376280,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":970,"num_write_kb":31681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"31'1041","reported_seq":1089,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.076361+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:39:23.076361+0000","last_peered":"2024-09-11T14:39:23.076361+0000","last_clean":"2024-09-11T14:39:23.076361+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:39:23.076361+0000","last_undegraded":"2024-09-11T14:39:23.076361+0000","last_fullsized":"2024-09-11T14:39:23.076361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1041,"log_dups_size":0,"ondisk_log_size":1041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1041,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"31'1054","reported_seq":1102,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:24.111254+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:39:24.111254+0000","last_peered":"2024-09-11T14:39:24.111254+0000","last_clean":"2024-09-11T14:39:24.111254+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:39:24.111254+0000","last_undegraded":"2024-09-11T14:39:24.111254+0000","last_fullsized":"2024-09-11T14:39:24.111254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1054,"log_dups_size":0,"ondisk_log_size":1054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1054,"num_write_kb":34368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'1046","reported_seq":1094,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.099362+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:39:23.099362+0000","last_peered":"2024-09-11T14:39:23.099362+0000","last_clean":"2024-09-11T14:39:23.099362+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:39:23.099362+0000","last_undegraded":"2024-09-11T14:39:23.099362+0000","last_fullsized":"2024-09-11T14:39:23.099362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1046,"log_dups_size":0,"ondisk_log_size":1046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1046,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"31'1065","reported_seq":1113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.199516+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:39:23.199516+0000","last_peered":"2024-09-11T14:39:23.199516+0000","last_clean":"2024-09-11T14:39:23.199516+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:39:23.199516+0000","last_undegraded":"2024-09-11T14:39:23.199516+0000","last_fullsized":"2024-09-11T14:39:23.199516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1065,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"31'963","reported_seq":1011,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:22.996954+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:39:22.996954+0000","last_peered":"2024-09-11T14:39:22.996954+0000","last_clean":"2024-09-11T14:39:22.996954+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:39:22.996954+0000","last_undegraded":"2024-09-11T14:39:22.996954+0000","last_fullsized":"2024-09-11T14:39:22.996954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":963,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.394736+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:38:24.394736+0000","last_peered":"2024-09-11T14:38:24.394736+0000","last_clean":"2024-09-11T14:38:24.394736+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:38:24.394736+0000","last_undegraded":"2024-09-11T14:38:24.394736+0000","last_fullsized":"2024-09-11T14:38:24.394736+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.364524+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:38:24.364524+0000","last_peered":"2024-09-11T14:38:24.364524+0000","last_clean":"2024-09-11T14:38:24.364524+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:38:24.364524+0000","last_undegraded":"2024-09-11T14:38:24.364524+0000","last_fullsized":"2024-09-11T14:38:24.364524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"31'1051","reported_seq":1099,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.148959+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:39:23.148959+0000","last_peered":"2024-09-11T14:39:23.148959+0000","last_clean":"2024-09-11T14:39:23.148959+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:39:23.148959+0000","last_undegraded":"2024-09-11T14:39:23.148959+0000","last_fullsized":"2024-09-11T14:39:23.148959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1051,"log_dups_size":0,"ondisk_log_size":1051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1051,"num_write_kb":34496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.554837+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:38:24.554837+0000","last_peered":"2024-09-11T14:38:24.554837+0000","last_clean":"2024-09-11T14:38:24.554837+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:38:24.554837+0000","last_undegraded":"2024-09-11T14:38:24.554837+0000","last_fullsized":"2024-09-11T14:38:24.554837+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"31'1172","reported_seq":1220,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.669360+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:39:23.669360+0000","last_peered":"2024-09-11T14:39:23.669360+0000","last_clean":"2024-09-11T14:39:23.669360+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:39:23.669360+0000","last_undegraded":"2024-09-11T14:39:23.669360+0000","last_fullsized":"2024-09-11T14:39:23.669360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1172,"log_dups_size":0,"ondisk_log_size":1172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1172,"num_write_kb":38336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.360270+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:38:24.360270+0000","last_peered":"2024-09-11T14:38:24.360270+0000","last_clean":"2024-09-11T14:38:24.360270+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:38:24.360270+0000","last_undegraded":"2024-09-11T14:38:24.360270+0000","last_fullsized":"2024-09-11T14:38:24.360270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'1047","reported_seq":1095,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:24.148284+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:39:24.148284+0000","last_peered":"2024-09-11T14:39:24.148284+0000","last_clean":"2024-09-11T14:39:24.148284+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:39:24.148284+0000","last_undegraded":"2024-09-11T14:39:24.148284+0000","last_fullsized":"2024-09-11T14:39:24.148284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":34176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.553754+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:38:24.553754+0000","last_peered":"2024-09-11T14:38:24.553754+0000","last_clean":"2024-09-11T14:38:24.553754+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:38:24.553754+0000","last_undegraded":"2024-09-11T14:38:24.553754+0000","last_fullsized":"2024-09-11T14:38:24.553754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"31'946","reported_seq":994,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:22.935758+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:39:22.935758+0000","last_peered":"2024-09-11T14:39:22.935758+0000","last_clean":"2024-09-11T14:39:22.935758+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:39:22.935758+0000","last_undegraded":"2024-09-11T14:39:22.935758+0000","last_fullsized":"2024-09-11T14:39:22.935758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":946,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"31'1005","reported_seq":1053,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.164626+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:39:23.164626+0000","last_peered":"2024-09-11T14:39:23.164626+0000","last_clean":"2024-09-11T14:39:23.164626+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:39:23.164626+0000","last_undegraded":"2024-09-11T14:39:23.164626+0000","last_fullsized":"2024-09-11T14:39:23.164626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1005,"log_dups_size":0,"ondisk_log_size":1005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1005,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.420843+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:38:24.420843+0000","last_peered":"2024-09-11T14:38:24.420843+0000","last_clean":"2024-09-11T14:38:24.420843+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:38:24.420843+0000","last_undegraded":"2024-09-11T14:38:24.420843+0000","last_fullsized":"2024-09-11T14:38:24.420843+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"31'988","reported_seq":1036,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:22.855422+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:39:22.855422+0000","last_peered":"2024-09-11T14:39:22.855422+0000","last_clean":"2024-09-11T14:39:22.855422+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:39:22.855422+0000","last_undegraded":"2024-09-11T14:39:22.855422+0000","last_fullsized":"2024-09-11T14:39:22.855422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":988,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.401571+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:38:24.401571+0000","last_peered":"2024-09-11T14:38:24.401571+0000","last_clean":"2024-09-11T14:38:24.401571+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:38:24.401571+0000","last_undegraded":"2024-09-11T14:38:24.401571+0000","last_fullsized":"2024-09-11T14:38:24.401571+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"31'1032","reported_seq":1080,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.901572+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:39:23.901572+0000","last_peered":"2024-09-11T14:39:23.901572+0000","last_clean":"2024-09-11T14:39:23.901572+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:39:23.901572+0000","last_undegraded":"2024-09-11T14:39:23.901572+0000","last_fullsized":"2024-09-11T14:39:23.901572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1032,"log_dups_size":0,"ondisk_log_size":1032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1032,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.419106+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:38:24.419106+0000","last_peered":"2024-09-11T14:38:24.419106+0000","last_clean":"2024-09-11T14:38:24.419106+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:38:24.419106+0000","last_undegraded":"2024-09-11T14:38:24.419106+0000","last_fullsized":"2024-09-11T14:38:24.419106+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'1072","reported_seq":1120,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.000915+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:39:23.000915+0000","last_peered":"2024-09-11T14:39:23.000915+0000","last_clean":"2024-09-11T14:39:23.000915+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:39:23.000915+0000","last_undegraded":"2024-09-11T14:39:23.000915+0000","last_fullsized":"2024-09-11T14:39:23.000915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1072,"log_dups_size":0,"ondisk_log_size":1072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1072,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.367002+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:38:24.367002+0000","last_peered":"2024-09-11T14:38:24.367002+0000","last_clean":"2024-09-11T14:38:24.367002+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:38:24.367002+0000","last_undegraded":"2024-09-11T14:38:24.367002+0000","last_fullsized":"2024-09-11T14:38:24.367002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":27459608,"num_objects":420,"num_object_clones":0,"num_object_copies":1260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16482,"num_write_kb":540801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214012321792,"internally_reserved":0,"allocated":199172096,"data_stored":199172096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16482,"ondisk_log_size":16482,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214011928576,"internally_reserved":0,"allocated":199565312,"data_stored":199565312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53501042688,"internally_reserved":0,"allocated":51830784,"data_stored":51830784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":58056,"kb_used_data":58056,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52239672,"statfs":{"total":53552873472,"available":53493424128,"internally_reserved":0,"allocated":59449344,"data_stored":59449344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":53100,"kb_used_data":53100,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52244628,"statfs":{"total":53552873472,"available":53498499072,"internally_reserved":0,"allocated":54374400,"data_stored":54374400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":52432,"kb_used_data":52432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52245296,"statfs":{"total":53552873472,"available":53499183104,"internally_reserved":0,"allocated":53690368,"data_stored":53690368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":56160,"kb_used_data":56160,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52241568,"statfs":{"total":53552873472,"available":53495365632,"internally_reserved":0,"allocated":57507840,"data_stored":57507840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53501042688,"internally_reserved":0,"allocated":51830784,"data_stored":51830784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53504344064,"internally_reserved":0,"allocated":48529408,"data_stored":48529408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53502623744,"internally_reserved":0,"allocated":50249728,"data_stored":50249728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53503787008,"internally_reserved":0,"allocated":49086464,"data_stored":49086464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53501173760,"internally_reserved":0,"allocated":51699712,"data_stored":51699712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53504344064,"internally_reserved":0,"allocated":48529408,"data_stored":48529408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53502623744,"internally_reserved":0,"allocated":50249728,"data_stored":50249728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53504049152,"internally_reserved":0,"allocated":48824320,"data_stored":48824320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53501304832,"internally_reserved":0,"allocated":51568640,"data_stored":51568640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:39:28.425 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:39:28.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:28.564+0000 7fbf3f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:28.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:28.573+0000 7fbf3f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:28.897 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:39:28.898 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:39:28.910 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-09-11T14:39:27.855615+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28049995,"num_objects":424,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":16563,"num_write_kb":541909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16537,"ondisk_log_size":16537,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":219748,"kb_used_data":219748,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208971164,"statfs":{"total":214211493888,"available":213986471936,"internally_reserved":0,"allocated":225021952,"data_stored":225021952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-26345472,"num_objects":-402,"num_object_clones":0,"num_object_copies":-1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.595611"},"pg_stats":[{"pgid":"3.f","version":"31'1104","reported_seq":1152,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.329359+0000","last_change":"2024-09-11T14:36:18.597298+0000","last_active":"2024-09-11T14:39:23.329359+0000","last_peered":"2024-09-11T14:39:23.329359+0000","last_clean":"2024-09-11T14:39:23.329359+0000","last_became_active":"2024-09-11T14:36:18.553273+0000","last_became_peered":"2024-09-11T14:36:18.553273+0000","last_unstale":"2024-09-11T14:39:23.329359+0000","last_undegraded":"2024-09-11T14:39:23.329359+0000","last_fullsized":"2024-09-11T14:39:23.329359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1104,"log_dups_size":0,"ondisk_log_size":1104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1104,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"31'926","reported_seq":974,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.162641+0000","last_change":"2024-09-11T14:36:18.603822+0000","last_active":"2024-09-11T14:39:23.162641+0000","last_peered":"2024-09-11T14:39:23.162641+0000","last_clean":"2024-09-11T14:39:23.162641+0000","last_became_active":"2024-09-11T14:36:18.584199+0000","last_became_peered":"2024-09-11T14:36:18.584199+0000","last_unstale":"2024-09-11T14:39:23.162641+0000","last_undegraded":"2024-09-11T14:39:23.162641+0000","last_fullsized":"2024-09-11T14:39:23.162641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":926,"num_write_kb":30272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'970","reported_seq":1019,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.312516+0000","last_change":"2024-09-11T14:36:18.619828+0000","last_active":"2024-09-11T14:39:23.312516+0000","last_peered":"2024-09-11T14:39:23.312516+0000","last_clean":"2024-09-11T14:39:23.312516+0000","last_became_active":"2024-09-11T14:36:18.602095+0000","last_became_peered":"2024-09-11T14:36:18.602095+0000","last_unstale":"2024-09-11T14:39:23.312516+0000","last_undegraded":"2024-09-11T14:39:23.312516+0000","last_fullsized":"2024-09-11T14:39:23.312516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":970,"log_dups_size":0,"ondisk_log_size":970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376280,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":970,"num_write_kb":31681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"31'1041","reported_seq":1089,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.076361+0000","last_change":"2024-09-11T14:36:18.512851+0000","last_active":"2024-09-11T14:39:23.076361+0000","last_peered":"2024-09-11T14:39:23.076361+0000","last_clean":"2024-09-11T14:39:23.076361+0000","last_became_active":"2024-09-11T14:36:18.497557+0000","last_became_peered":"2024-09-11T14:36:18.497557+0000","last_unstale":"2024-09-11T14:39:23.076361+0000","last_undegraded":"2024-09-11T14:39:23.076361+0000","last_fullsized":"2024-09-11T14:39:23.076361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1041,"log_dups_size":0,"ondisk_log_size":1041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1041,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"31'1054","reported_seq":1102,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:24.111254+0000","last_change":"2024-09-11T14:36:18.541196+0000","last_active":"2024-09-11T14:39:24.111254+0000","last_peered":"2024-09-11T14:39:24.111254+0000","last_clean":"2024-09-11T14:39:24.111254+0000","last_became_active":"2024-09-11T14:36:18.524026+0000","last_became_peered":"2024-09-11T14:36:18.524026+0000","last_unstale":"2024-09-11T14:39:24.111254+0000","last_undegraded":"2024-09-11T14:39:24.111254+0000","last_fullsized":"2024-09-11T14:39:24.111254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1054,"log_dups_size":0,"ondisk_log_size":1054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1054,"num_write_kb":34368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'1046","reported_seq":1094,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.099362+0000","last_change":"2024-09-11T14:36:18.587999+0000","last_active":"2024-09-11T14:39:23.099362+0000","last_peered":"2024-09-11T14:39:23.099362+0000","last_clean":"2024-09-11T14:39:23.099362+0000","last_became_active":"2024-09-11T14:36:18.562409+0000","last_became_peered":"2024-09-11T14:36:18.562409+0000","last_unstale":"2024-09-11T14:39:23.099362+0000","last_undegraded":"2024-09-11T14:39:23.099362+0000","last_fullsized":"2024-09-11T14:39:23.099362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1046,"log_dups_size":0,"ondisk_log_size":1046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1046,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"31'1065","reported_seq":1113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.199516+0000","last_change":"2024-09-11T14:36:18.671475+0000","last_active":"2024-09-11T14:39:23.199516+0000","last_peered":"2024-09-11T14:39:23.199516+0000","last_clean":"2024-09-11T14:39:23.199516+0000","last_became_active":"2024-09-11T14:36:18.663051+0000","last_became_peered":"2024-09-11T14:36:18.663051+0000","last_unstale":"2024-09-11T14:39:23.199516+0000","last_undegraded":"2024-09-11T14:39:23.199516+0000","last_fullsized":"2024-09-11T14:39:23.199516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1065,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"31'963","reported_seq":1011,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:22.996954+0000","last_change":"2024-09-11T14:36:18.626941+0000","last_active":"2024-09-11T14:39:22.996954+0000","last_peered":"2024-09-11T14:39:22.996954+0000","last_clean":"2024-09-11T14:39:22.996954+0000","last_became_active":"2024-09-11T14:36:18.612227+0000","last_became_peered":"2024-09-11T14:36:18.612227+0000","last_unstale":"2024-09-11T14:39:22.996954+0000","last_undegraded":"2024-09-11T14:39:22.996954+0000","last_fullsized":"2024-09-11T14:39:22.996954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":963,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.394736+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:38:24.394736+0000","last_peered":"2024-09-11T14:38:24.394736+0000","last_clean":"2024-09-11T14:38:24.394736+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:38:24.394736+0000","last_undegraded":"2024-09-11T14:38:24.394736+0000","last_fullsized":"2024-09-11T14:38:24.394736+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.364524+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:38:24.364524+0000","last_peered":"2024-09-11T14:38:24.364524+0000","last_clean":"2024-09-11T14:38:24.364524+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:38:24.364524+0000","last_undegraded":"2024-09-11T14:38:24.364524+0000","last_fullsized":"2024-09-11T14:38:24.364524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"31'1051","reported_seq":1099,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.148959+0000","last_change":"2024-09-11T14:36:18.574125+0000","last_active":"2024-09-11T14:39:23.148959+0000","last_peered":"2024-09-11T14:39:23.148959+0000","last_clean":"2024-09-11T14:39:23.148959+0000","last_became_active":"2024-09-11T14:36:18.564670+0000","last_became_peered":"2024-09-11T14:36:18.564670+0000","last_unstale":"2024-09-11T14:39:23.148959+0000","last_undegraded":"2024-09-11T14:39:23.148959+0000","last_fullsized":"2024-09-11T14:39:23.148959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1051,"log_dups_size":0,"ondisk_log_size":1051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1051,"num_write_kb":34496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.554837+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:38:24.554837+0000","last_peered":"2024-09-11T14:38:24.554837+0000","last_clean":"2024-09-11T14:38:24.554837+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:38:24.554837+0000","last_undegraded":"2024-09-11T14:38:24.554837+0000","last_fullsized":"2024-09-11T14:38:24.554837+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"31'1172","reported_seq":1220,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.669360+0000","last_change":"2024-09-11T14:36:18.578238+0000","last_active":"2024-09-11T14:39:23.669360+0000","last_peered":"2024-09-11T14:39:23.669360+0000","last_clean":"2024-09-11T14:39:23.669360+0000","last_became_active":"2024-09-11T14:36:18.521178+0000","last_became_peered":"2024-09-11T14:36:18.521178+0000","last_unstale":"2024-09-11T14:39:23.669360+0000","last_undegraded":"2024-09-11T14:39:23.669360+0000","last_fullsized":"2024-09-11T14:39:23.669360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1172,"log_dups_size":0,"ondisk_log_size":1172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1172,"num_write_kb":38336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.360270+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:38:24.360270+0000","last_peered":"2024-09-11T14:38:24.360270+0000","last_clean":"2024-09-11T14:38:24.360270+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:38:24.360270+0000","last_undegraded":"2024-09-11T14:38:24.360270+0000","last_fullsized":"2024-09-11T14:38:24.360270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'1047","reported_seq":1095,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:24.148284+0000","last_change":"2024-09-11T14:36:18.648322+0000","last_active":"2024-09-11T14:39:24.148284+0000","last_peered":"2024-09-11T14:39:24.148284+0000","last_clean":"2024-09-11T14:39:24.148284+0000","last_became_active":"2024-09-11T14:36:18.631463+0000","last_became_peered":"2024-09-11T14:36:18.631463+0000","last_unstale":"2024-09-11T14:39:24.148284+0000","last_undegraded":"2024-09-11T14:39:24.148284+0000","last_fullsized":"2024-09-11T14:39:24.148284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":34176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.553754+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:38:24.553754+0000","last_peered":"2024-09-11T14:38:24.553754+0000","last_clean":"2024-09-11T14:38:24.553754+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:38:24.553754+0000","last_undegraded":"2024-09-11T14:38:24.553754+0000","last_fullsized":"2024-09-11T14:38:24.553754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"31'946","reported_seq":994,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:22.935758+0000","last_change":"2024-09-11T14:36:18.524146+0000","last_active":"2024-09-11T14:39:22.935758+0000","last_peered":"2024-09-11T14:39:22.935758+0000","last_clean":"2024-09-11T14:39:22.935758+0000","last_became_active":"2024-09-11T14:36:18.482384+0000","last_became_peered":"2024-09-11T14:36:18.482384+0000","last_unstale":"2024-09-11T14:39:22.935758+0000","last_undegraded":"2024-09-11T14:39:22.935758+0000","last_fullsized":"2024-09-11T14:39:22.935758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":946,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"31'1005","reported_seq":1053,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.164626+0000","last_change":"2024-09-11T14:36:18.651519+0000","last_active":"2024-09-11T14:39:23.164626+0000","last_peered":"2024-09-11T14:39:23.164626+0000","last_clean":"2024-09-11T14:39:23.164626+0000","last_became_active":"2024-09-11T14:36:18.642139+0000","last_became_peered":"2024-09-11T14:36:18.642139+0000","last_unstale":"2024-09-11T14:39:23.164626+0000","last_undegraded":"2024-09-11T14:39:23.164626+0000","last_fullsized":"2024-09-11T14:39:23.164626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1005,"log_dups_size":0,"ondisk_log_size":1005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1005,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.420843+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:38:24.420843+0000","last_peered":"2024-09-11T14:38:24.420843+0000","last_clean":"2024-09-11T14:38:24.420843+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:38:24.420843+0000","last_undegraded":"2024-09-11T14:38:24.420843+0000","last_fullsized":"2024-09-11T14:38:24.420843+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"31'988","reported_seq":1036,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:22.855422+0000","last_change":"2024-09-11T14:36:18.529744+0000","last_active":"2024-09-11T14:39:22.855422+0000","last_peered":"2024-09-11T14:39:22.855422+0000","last_clean":"2024-09-11T14:39:22.855422+0000","last_became_active":"2024-09-11T14:36:18.515292+0000","last_became_peered":"2024-09-11T14:36:18.515292+0000","last_unstale":"2024-09-11T14:39:22.855422+0000","last_undegraded":"2024-09-11T14:39:22.855422+0000","last_fullsized":"2024-09-11T14:39:22.855422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":988,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.401571+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:38:24.401571+0000","last_peered":"2024-09-11T14:38:24.401571+0000","last_clean":"2024-09-11T14:38:24.401571+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:38:24.401571+0000","last_undegraded":"2024-09-11T14:38:24.401571+0000","last_fullsized":"2024-09-11T14:38:24.401571+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"31'1032","reported_seq":1080,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.901572+0000","last_change":"2024-09-11T14:36:18.584969+0000","last_active":"2024-09-11T14:39:23.901572+0000","last_peered":"2024-09-11T14:39:23.901572+0000","last_clean":"2024-09-11T14:39:23.901572+0000","last_became_active":"2024-09-11T14:36:18.541880+0000","last_became_peered":"2024-09-11T14:36:18.541880+0000","last_unstale":"2024-09-11T14:39:23.901572+0000","last_undegraded":"2024-09-11T14:39:23.901572+0000","last_fullsized":"2024-09-11T14:39:23.901572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1032,"log_dups_size":0,"ondisk_log_size":1032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1032,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.419106+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:38:24.419106+0000","last_peered":"2024-09-11T14:38:24.419106+0000","last_clean":"2024-09-11T14:38:24.419106+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:38:24.419106+0000","last_undegraded":"2024-09-11T14:38:24.419106+0000","last_fullsized":"2024-09-11T14:38:24.419106+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'1072","reported_seq":1120,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:39:23.000915+0000","last_change":"2024-09-11T14:36:18.572084+0000","last_active":"2024-09-11T14:39:23.000915+0000","last_peered":"2024-09-11T14:39:23.000915+0000","last_clean":"2024-09-11T14:39:23.000915+0000","last_became_active":"2024-09-11T14:36:18.561609+0000","last_became_peered":"2024-09-11T14:36:18.561609+0000","last_unstale":"2024-09-11T14:39:23.000915+0000","last_undegraded":"2024-09-11T14:39:23.000915+0000","last_fullsized":"2024-09-11T14:39:23.000915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:17.348503+0000","last_clean_scrub_stamp":"2024-09-11T14:36:17.348503+0000","objects_scrubbed":0,"log_size":1072,"log_dups_size":0,"ondisk_log_size":1072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1072,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-11T14:38:24.367002+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:38:24.367002+0000","last_peered":"2024-09-11T14:38:24.367002+0000","last_clean":"2024-09-11T14:38:24.367002+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:38:24.367002+0000","last_undegraded":"2024-09-11T14:38:24.367002+0000","last_fullsized":"2024-09-11T14:38:24.367002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":27459608,"num_objects":420,"num_object_clones":0,"num_object_copies":1260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16482,"num_write_kb":540801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214012321792,"internally_reserved":0,"allocated":199172096,"data_stored":199172096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16482,"ondisk_log_size":16482,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214011928576,"internally_reserved":0,"allocated":199565312,"data_stored":199565312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53501042688,"internally_reserved":0,"allocated":51830784,"data_stored":51830784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":58056,"kb_used_data":58056,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52239672,"statfs":{"total":53552873472,"available":53493424128,"internally_reserved":0,"allocated":59449344,"data_stored":59449344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":53100,"kb_used_data":53100,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52244628,"statfs":{"total":53552873472,"available":53498499072,"internally_reserved":0,"allocated":54374400,"data_stored":54374400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":52432,"kb_used_data":52432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52245296,"statfs":{"total":53552873472,"available":53499183104,"internally_reserved":0,"allocated":53690368,"data_stored":53690368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":56160,"kb_used_data":56160,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52241568,"statfs":{"total":53552873472,"available":53495365632,"internally_reserved":0,"allocated":57507840,"data_stored":57507840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53501042688,"internally_reserved":0,"allocated":51830784,"data_stored":51830784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53504344064,"internally_reserved":0,"allocated":48529408,"data_stored":48529408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53502623744,"internally_reserved":0,"allocated":50249728,"data_stored":50249728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53503787008,"internally_reserved":0,"allocated":49086464,"data_stored":49086464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53501173760,"internally_reserved":0,"allocated":51699712,"data_stored":51699712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53504344064,"internally_reserved":0,"allocated":48529408,"data_stored":48529408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53502623744,"internally_reserved":0,"allocated":50249728,"data_stored":50249728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53504049152,"internally_reserved":0,"allocated":48824320,"data_stored":48824320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53501304832,"internally_reserved":0,"allocated":51568640,"data_stored":51568640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:39:28.912 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T14:39:28.912 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:39:28.912 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:39:28.912 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:39:29.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:29.015+0000 7f3700151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:29.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:29.024+0000 7f3700151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:29.040 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:39:29.040 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:39:29.040 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:39:29.040 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:39:29.040 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:39:29.040 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:39:29.040 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:39:29.040 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:39:29.041 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:39:29.041 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:39:29.041 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:39:29.041 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:39:29.043 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:39:29.044 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:39:29.044 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:39:29.116 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Removed 8450 objects 2024-09-11T14:39:29.116 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Clean up completed and total clean up time :98.627 2024-09-11T14:39:29.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:29.150+0000 7f50bd591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:29.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:29.162+0000 7f50bd591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:29.180 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:39:29.180 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:39:29.180 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:39:29.180 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:39:29.180 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:39:29.180 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:39:29.180 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:39:29.180 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:39:29.181 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:39:29.181 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:39:29.181 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:39:29.181 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:39:29.183 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:39:29.183 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:39:29.184 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:39:29.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:29.325+0000 7f3779791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:29.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:29.334+0000 7f3779791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:29.353 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:39:29.353 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:39:29.353 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:39:29.353 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:39:29.353 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:39:29.353 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:39:29.353 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:39:29.353 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:39:29.353 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:39:29.353 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:39:29.353 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:39:29.353 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:39:29.356 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:39:29.356 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:39:29.357 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:39:29.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:29.459+0000 7fcae5afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:29.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:29.468+0000 7fcae5afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:29.486 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:39:29.486 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:39:29.486 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:39:29.486 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:39:29.486 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:39:29.486 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:39:29.487 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:39:29.487 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:39:29.487 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:39:29.487 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:39:29.487 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:39:29.487 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:39:29.489 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:39:29.489 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:39:29.650 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:39:29.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:29.753+0000 7f13f2cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:29.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:29.758+0000 7f13f2cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:31.860 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:39:31.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:31.979+0000 7fc3334ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:31.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:31.984+0000 7fc3334ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:34.090 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:39:34.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:34.208+0000 7f4c95b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:34.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:34.213+0000 7f4c95b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:34.490 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:39:34.490 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:39:34.491 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:39:34.491 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:39:34.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:34.596+0000 7f0754111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:34.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:34.604+0000 7f0754111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:34.620 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:39:34.620 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:39:34.620 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:39:34.620 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:39:34.620 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:39:34.621 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:39:34.621 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:39:34.621 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:39:34.621 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:39:34.621 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:39:34.621 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:39:34.621 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:39:34.624 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-11T14:39:34.625 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-11T14:39:34.625 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:39:34.626 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:39:34.626 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:39:34.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:34.772+0000 7f5a25991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:34.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:34.781+0000 7f5a25991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:34.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:34.772+0000 7f3353d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:34.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:34.785+0000 7f3353d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:34.800 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:39:34.800 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:39:34.800 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:39:34.800 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:39:34.800 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:39:34.800 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:39:34.800 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:39:34.801 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:39:34.801 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:39:34.801 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:39:34.801 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:39:34.801 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:39:34.803 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:39:34.803 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:39:34.804 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:39:34.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:34.907+0000 7f6a46846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:34.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:34.916+0000 7f6a46846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:34.942 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:39:34.942 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:39:34.942 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:39:34.943 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:39:34.943 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:39:34.943 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:39:34.943 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:39:34.943 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:39:34.943 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:39:34.943 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:39:34.943 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:39:34.943 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:39:34.945 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:39:34.945 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:39:34.946 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:39:35.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:35.049+0000 7f8b42efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:35.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:35.058+0000 7f8b42efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:35.076 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:39:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:39:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:39:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:39:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:39:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:39:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:39:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:39:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:39:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:39:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:39:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:39:35.079 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:39:35.080 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:39:35.324 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_0' removed 2024-09-11T14:39:35.341 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-11T14:39:35.342 INFO:tasks.radosbench:Beginning radosbench... 2024-09-11T14:39:35.343 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_1 2024-09-11T14:39:35.343 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_1 16 2024-09-11T14:39:35.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:35.486+0000 7f72c42a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:35.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:35.499+0000 7f72c42a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:36.318 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:39:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_1' created 2024-09-11T14:39:36.345 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2024-09-11T14:39:36.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:36.455+0000 7fda7b311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:36.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:36.462+0000 7fda7b311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:36.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:36.533+0000 7f5ff3511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:36.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:36.552+0000 7f5ff3511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:37.334 INFO:teuthology.orchestra.run.smithi103.stderr:enabled application 'rados' on pool 'unique_pool_1' 2024-09-11T14:39:38.358 DEBUG:teuthology.orchestra.run.smithi103:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_1 bench 90 write' 2024-09-11T14:39:38.361 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-11T14:39:38.361 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-11T14:39:38.427 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:hints = 1 2024-09-11T14:39:38.428 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-11T14:39:38.428 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object prefix: benchmark_data_smithi103_37880 2024-09-11T14:39:38.428 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:39:38.428 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 0 0 0 0 0 0 - 0 2024-09-11T14:39:38.633 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:39:38.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:38.771+0000 7fc6c5c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:38.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:38.779+0000 7fc6c5c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:39.428 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 1 16 65 49 3.06221 3.0625 0.505447 0.236004 2024-09-11T14:39:40.081 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:39:40.081 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:39:40.081 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:39:40.081 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:39:40.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:40.229+0000 7f67818bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:40.243+0000 7f67818bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:40.396 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:39:40.397 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:39:40.397 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:39:40.397 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:39:40.397 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:39:40.397 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:39:40.397 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:39:40.397 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:39:40.397 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:39:40.397 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:39:40.397 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:39:40.397 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:39:40.400 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:39:40.400 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:39:40.400 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:39:40.427 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 2 16 132 116 3.62467 4.1875 0.297187 0.228536 2024-09-11T14:39:40.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:40.534+0000 7f38bdd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:40.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:40.552+0000 7f38bdd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:40.709 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:39:40.709 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:39:40.709 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:39:40.709 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:39:40.709 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:39:40.709 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:39:40.709 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:39:40.709 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:39:40.709 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:39:40.709 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:39:40.709 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:39:40.709 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:39:40.713 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:39:40.714 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:39:40.714 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:39:40.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:40.891+0000 7f1f26391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:40.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:40.904+0000 7f1f26391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:40.936 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:39:40.936 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:39:40.936 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:39:40.936 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:39:40.936 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:39:40.936 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:39:40.937 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:39:40.937 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:39:40.937 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:39:40.937 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:39:40.937 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:39:40.937 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:39:40.940 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:39:40.940 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:39:40.940 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:39:41.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:41.092+0000 7fdae40bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:41.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:41.111+0000 7fdae40bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:39:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:39:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:39:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:39:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:39:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:39:41.160 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:39:41.160 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:39:41.160 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:39:41.160 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:39:41.160 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:39:41.160 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:39:41.163 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:39:41.164 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:39:41.229 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:39:41.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:41.397+0000 7f154f24f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:41.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:41.406+0000 7f154f24f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:41.427 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 3 16 200 184 3.833 4.25 0.152849 0.242002 2024-09-11T14:39:42.428 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 4 16 263 247 3.859 3.9375 0.0722382 0.227883 2024-09-11T14:39:43.429 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 5 16 330 314 3.92463 4.1875 0.239172 0.21963 2024-09-11T14:39:43.975 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:39:44.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:44.135+0000 7f2888711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:44.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:44.143+0000 7f2888711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:44.428 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 6 16 400 384 3.99962 4.375 1.69745 0.227166 2024-09-11T14:39:45.428 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 7 16 478 462 4.12461 4.875 0.136686 0.236275 2024-09-11T14:39:46.165 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:39:46.165 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:39:46.165 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:39:46.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:46.316+0000 7fc3b209c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:46.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:46.328+0000 7fc3b209c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:46.428 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 8 16 565 549 4.28866 5.4375 0.202888 0.23045 2024-09-11T14:39:46.704 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:39:46.705 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:39:46.729 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-09-11T14:39:45.264772+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22348339,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":413,"num_write_kb":22356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":122536,"kb_used_data":122536,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209068376,"statfs":{"total":214211493888,"available":214086017024,"internally_reserved":0,"allocated":125476864,"data_stored":125476864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21757952,"num_objects":332,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":21248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001622"},"pg_stats":[{"pgid":"4.f","version":"39'20","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:42.856372+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:39:42.856372+0000","last_peered":"2024-09-11T14:39:42.856372+0000","last_clean":"2024-09-11T14:39:42.856372+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:39:42.856372+0000","last_undegraded":"2024-09-11T14:39:42.856372+0000","last_fullsized":"2024-09-11T14:39:42.856372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"39'26","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:42.974461+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:39:42.974461+0000","last_peered":"2024-09-11T14:39:42.974461+0000","last_clean":"2024-09-11T14:39:42.974461+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:39:42.974461+0000","last_undegraded":"2024-09-11T14:39:42.974461+0000","last_fullsized":"2024-09-11T14:39:42.974461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"39'23","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:42.542735+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:39:42.542735+0000","last_peered":"2024-09-11T14:39:42.542735+0000","last_clean":"2024-09-11T14:39:42.542735+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:39:42.542735+0000","last_undegraded":"2024-09-11T14:39:42.542735+0000","last_fullsized":"2024-09-11T14:39:42.542735+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"39'30","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:44.122805+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:39:44.122805+0000","last_peered":"2024-09-11T14:39:44.122805+0000","last_clean":"2024-09-11T14:39:44.122805+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:39:44.122805+0000","last_undegraded":"2024-09-11T14:39:44.122805+0000","last_fullsized":"2024-09-11T14:39:44.122805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"39'20","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:43.222895+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:39:43.222895+0000","last_peered":"2024-09-11T14:39:43.222895+0000","last_clean":"2024-09-11T14:39:43.222895+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:39:43.222895+0000","last_undegraded":"2024-09-11T14:39:43.222895+0000","last_fullsized":"2024-09-11T14:39:43.222895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"39'21","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:42.561331+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:39:42.561331+0000","last_peered":"2024-09-11T14:39:42.561331+0000","last_clean":"2024-09-11T14:39:42.561331+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:39:42.561331+0000","last_undegraded":"2024-09-11T14:39:42.561331+0000","last_fullsized":"2024-09-11T14:39:42.561331+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'16","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:42.991822+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:39:42.991822+0000","last_peered":"2024-09-11T14:39:42.991822+0000","last_clean":"2024-09-11T14:39:42.991822+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:39:42.991822+0000","last_undegraded":"2024-09-11T14:39:42.991822+0000","last_fullsized":"2024-09-11T14:39:42.991822+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"39'12","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:43.038266+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:39:43.038266+0000","last_peered":"2024-09-11T14:39:43.038266+0000","last_clean":"2024-09-11T14:39:43.038266+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:39:43.038266+0000","last_undegraded":"2024-09-11T14:39:43.038266+0000","last_fullsized":"2024-09-11T14:39:43.038266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"39'27","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:42.834477+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:39:42.834477+0000","last_peered":"2024-09-11T14:39:42.834477+0000","last_clean":"2024-09-11T14:39:42.834477+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:39:42.834477+0000","last_undegraded":"2024-09-11T14:39:42.834477+0000","last_fullsized":"2024-09-11T14:39:42.834477+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.371560+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:39:38.371560+0000","last_peered":"2024-09-11T14:39:38.371560+0000","last_clean":"2024-09-11T14:39:38.371560+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:39:38.371560+0000","last_undegraded":"2024-09-11T14:39:38.371560+0000","last_fullsized":"2024-09-11T14:39:38.371560+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.379160+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:39:38.379160+0000","last_peered":"2024-09-11T14:39:38.379160+0000","last_clean":"2024-09-11T14:39:38.379160+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:39:38.379160+0000","last_undegraded":"2024-09-11T14:39:38.379160+0000","last_fullsized":"2024-09-11T14:39:38.379160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"39'21","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:43.171489+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:39:43.171489+0000","last_peered":"2024-09-11T14:39:43.171489+0000","last_clean":"2024-09-11T14:39:43.171489+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:39:43.171489+0000","last_undegraded":"2024-09-11T14:39:43.171489+0000","last_fullsized":"2024-09-11T14:39:43.171489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.386770+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:39:38.386770+0000","last_peered":"2024-09-11T14:39:38.386770+0000","last_clean":"2024-09-11T14:39:38.386770+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:39:38.386770+0000","last_undegraded":"2024-09-11T14:39:38.386770+0000","last_fullsized":"2024-09-11T14:39:38.386770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"39'16","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:42.546385+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:39:42.546385+0000","last_peered":"2024-09-11T14:39:42.546385+0000","last_clean":"2024-09-11T14:39:42.546385+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:39:42.546385+0000","last_undegraded":"2024-09-11T14:39:42.546385+0000","last_fullsized":"2024-09-11T14:39:42.546385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.371236+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:39:38.371236+0000","last_peered":"2024-09-11T14:39:38.371236+0000","last_clean":"2024-09-11T14:39:38.371236+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:39:38.371236+0000","last_undegraded":"2024-09-11T14:39:38.371236+0000","last_fullsized":"2024-09-11T14:39:38.371236+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"39'18","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:42.900085+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:39:42.900085+0000","last_peered":"2024-09-11T14:39:42.900085+0000","last_clean":"2024-09-11T14:39:42.900085+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:39:42.900085+0000","last_undegraded":"2024-09-11T14:39:42.900085+0000","last_fullsized":"2024-09-11T14:39:42.900085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.382974+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:39:38.382974+0000","last_peered":"2024-09-11T14:39:38.382974+0000","last_clean":"2024-09-11T14:39:38.382974+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:39:38.382974+0000","last_undegraded":"2024-09-11T14:39:38.382974+0000","last_fullsized":"2024-09-11T14:39:38.382974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"39'20","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:43.064858+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:39:43.064858+0000","last_peered":"2024-09-11T14:39:43.064858+0000","last_clean":"2024-09-11T14:39:43.064858+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:39:43.064858+0000","last_undegraded":"2024-09-11T14:39:43.064858+0000","last_fullsized":"2024-09-11T14:39:43.064858+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.379609+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:39:38.379609+0000","last_peered":"2024-09-11T14:39:38.379609+0000","last_clean":"2024-09-11T14:39:38.379609+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:39:38.379609+0000","last_undegraded":"2024-09-11T14:39:38.379609+0000","last_fullsized":"2024-09-11T14:39:38.379609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'18","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:43.053044+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:39:43.053044+0000","last_peered":"2024-09-11T14:39:43.053044+0000","last_clean":"2024-09-11T14:39:43.053044+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:39:43.053044+0000","last_undegraded":"2024-09-11T14:39:43.053044+0000","last_fullsized":"2024-09-11T14:39:43.053044+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.377235+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:39:38.377235+0000","last_peered":"2024-09-11T14:39:38.377235+0000","last_clean":"2024-09-11T14:39:38.377235+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:39:38.377235+0000","last_undegraded":"2024-09-11T14:39:38.377235+0000","last_fullsized":"2024-09-11T14:39:38.377235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"39'18","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:43.262535+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:39:43.262535+0000","last_peered":"2024-09-11T14:39:43.262535+0000","last_clean":"2024-09-11T14:39:43.262535+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:39:43.262535+0000","last_undegraded":"2024-09-11T14:39:43.262535+0000","last_fullsized":"2024-09-11T14:39:43.262535+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.377734+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:39:38.377734+0000","last_peered":"2024-09-11T14:39:38.377734+0000","last_clean":"2024-09-11T14:39:38.377734+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:39:38.377734+0000","last_undegraded":"2024-09-11T14:39:38.377734+0000","last_fullsized":"2024-09-11T14:39:38.377734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"39'26","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:43.142622+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:39:43.142622+0000","last_peered":"2024-09-11T14:39:43.142622+0000","last_clean":"2024-09-11T14:39:43.142622+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:39:43.142622+0000","last_undegraded":"2024-09-11T14:39:43.142622+0000","last_fullsized":"2024-09-11T14:39:43.142622+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.378445+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:39:38.378445+0000","last_peered":"2024-09-11T14:39:38.378445+0000","last_clean":"2024-09-11T14:39:38.378445+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:39:38.378445+0000","last_undegraded":"2024-09-11T14:39:38.378445+0000","last_fullsized":"2024-09-11T14:39:38.378445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":21757952,"num_objects":332,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":21248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214067449856,"internally_reserved":0,"allocated":144044032,"data_stored":144044032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":332,"ondisk_log_size":332,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214067580928,"internally_reserved":0,"allocated":143912960,"data_stored":143912960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53508526080,"internally_reserved":0,"allocated":44347392,"data_stored":44347392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673179,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":38304,"kb_used_data":38304,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52259424,"statfs":{"total":53552873472,"available":53513650176,"internally_reserved":0,"allocated":39223296,"data_stored":39223296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":25908,"kb_used_data":25908,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52271820,"statfs":{"total":53552873472,"available":53526343680,"internally_reserved":0,"allocated":26529792,"data_stored":26529792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":29220,"kb_used_data":29220,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52268508,"statfs":{"total":53552873472,"available":53522952192,"internally_reserved":0,"allocated":29921280,"data_stored":29921280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":29104,"kb_used_data":29104,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52268624,"statfs":{"total":53552873472,"available":53523070976,"internally_reserved":0,"allocated":29802496,"data_stored":29802496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53508526080,"internally_reserved":0,"allocated":44347392,"data_stored":44347392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53518200832,"internally_reserved":0,"allocated":34672640,"data_stored":34672640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53517266944,"internally_reserved":0,"allocated":35606528,"data_stored":35606528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53523587072,"internally_reserved":0,"allocated":29286400,"data_stored":29286400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53508526080,"internally_reserved":0,"allocated":44347392,"data_stored":44347392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53518200832,"internally_reserved":0,"allocated":34672640,"data_stored":34672640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53517266944,"internally_reserved":0,"allocated":35606528,"data_stored":35606528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53523456000,"internally_reserved":0,"allocated":29417472,"data_stored":29417472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53508526080,"internally_reserved":0,"allocated":44347392,"data_stored":44347392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:39:47.014 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:39:47.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:47.177+0000 7fc5214fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:47.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:47.188+0000 7fc5214fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:47.428 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 9 16 647 631 4.38153 5.125 0.175282 0.224996 2024-09-11T14:39:48.428 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 10 16 729 713 4.45583 5.125 0.0863971 0.219625 2024-09-11T14:39:49.428 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 11 16 816 800 4.54502 5.4375 0.0869622 0.217902 2024-09-11T14:39:49.826 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:39:49.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:49.979+0000 7fbc2c6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:49.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:49.986+0000 7fbc2c6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:50.428 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 12 16 892 876 4.56206 4.75 0.0674361 0.216029 2024-09-11T14:39:51.429 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 13 16 975 959 4.61013 5.1875 0.0813212 0.214772 2024-09-11T14:39:51.732 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:39:51.732 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:39:51.732 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:39:51.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:51.893+0000 7fc277b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:51.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:51.909+0000 7fc277b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:52.217 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:39:52.217 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:39:52.241 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-09-11T14:39:51.266346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":48366131,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":810,"num_write_kb":47764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":784,"ondisk_log_size":784,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":272440,"kb_used_data":272440,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208918472,"statfs":{"total":214211493888,"available":213932515328,"internally_reserved":0,"allocated":278978560,"data_stored":278978560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":47775744,"num_objects":729,"num_object_clones":0,"num_object_copies":2187,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":46656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002835"},"pg_stats":[{"pgid":"4.f","version":"39'49","reported_seq":61,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:47.661295+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:39:47.661295+0000","last_peered":"2024-09-11T14:39:47.661295+0000","last_clean":"2024-09-11T14:39:47.661295+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:39:47.661295+0000","last_undegraded":"2024-09-11T14:39:47.661295+0000","last_fullsized":"2024-09-11T14:39:47.661295+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"39'50","reported_seq":62,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:47.936053+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:39:47.936053+0000","last_peered":"2024-09-11T14:39:47.936053+0000","last_clean":"2024-09-11T14:39:47.936053+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:39:47.936053+0000","last_undegraded":"2024-09-11T14:39:47.936053+0000","last_fullsized":"2024-09-11T14:39:47.936053+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"39'53","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:47.754176+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:39:47.754176+0000","last_peered":"2024-09-11T14:39:47.754176+0000","last_clean":"2024-09-11T14:39:47.754176+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:39:47.754176+0000","last_undegraded":"2024-09-11T14:39:47.754176+0000","last_fullsized":"2024-09-11T14:39:47.754176+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"39'53","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:49.099938+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:39:49.099938+0000","last_peered":"2024-09-11T14:39:49.099938+0000","last_clean":"2024-09-11T14:39:49.099938+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:39:49.099938+0000","last_undegraded":"2024-09-11T14:39:49.099938+0000","last_fullsized":"2024-09-11T14:39:49.099938+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"39'45","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:48.167218+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:39:48.167218+0000","last_peered":"2024-09-11T14:39:48.167218+0000","last_clean":"2024-09-11T14:39:48.167218+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:39:48.167218+0000","last_undegraded":"2024-09-11T14:39:48.167218+0000","last_fullsized":"2024-09-11T14:39:48.167218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"39'50","reported_seq":62,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:48.088214+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:39:48.088214+0000","last_peered":"2024-09-11T14:39:48.088214+0000","last_clean":"2024-09-11T14:39:48.088214+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:39:48.088214+0000","last_undegraded":"2024-09-11T14:39:48.088214+0000","last_fullsized":"2024-09-11T14:39:48.088214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'43","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:48.236211+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:39:48.236211+0000","last_peered":"2024-09-11T14:39:48.236211+0000","last_clean":"2024-09-11T14:39:48.236211+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:39:48.236211+0000","last_undegraded":"2024-09-11T14:39:48.236211+0000","last_fullsized":"2024-09-11T14:39:48.236211+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"39'29","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:48.021043+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:39:48.021043+0000","last_peered":"2024-09-11T14:39:48.021043+0000","last_clean":"2024-09-11T14:39:48.021043+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:39:48.021043+0000","last_undegraded":"2024-09-11T14:39:48.021043+0000","last_fullsized":"2024-09-11T14:39:48.021043+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"39'57","reported_seq":69,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:48.113461+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:39:48.113461+0000","last_peered":"2024-09-11T14:39:48.113461+0000","last_clean":"2024-09-11T14:39:48.113461+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:39:48.113461+0000","last_undegraded":"2024-09-11T14:39:48.113461+0000","last_fullsized":"2024-09-11T14:39:48.113461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.371560+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:39:38.371560+0000","last_peered":"2024-09-11T14:39:38.371560+0000","last_clean":"2024-09-11T14:39:38.371560+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:39:38.371560+0000","last_undegraded":"2024-09-11T14:39:38.371560+0000","last_fullsized":"2024-09-11T14:39:38.371560+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.379160+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:39:38.379160+0000","last_peered":"2024-09-11T14:39:38.379160+0000","last_clean":"2024-09-11T14:39:38.379160+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:39:38.379160+0000","last_undegraded":"2024-09-11T14:39:38.379160+0000","last_fullsized":"2024-09-11T14:39:38.379160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"39'44","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:48.204120+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:39:48.204120+0000","last_peered":"2024-09-11T14:39:48.204120+0000","last_clean":"2024-09-11T14:39:48.204120+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:39:48.204120+0000","last_undegraded":"2024-09-11T14:39:48.204120+0000","last_fullsized":"2024-09-11T14:39:48.204120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.386770+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:39:38.386770+0000","last_peered":"2024-09-11T14:39:38.386770+0000","last_clean":"2024-09-11T14:39:38.386770+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:39:38.386770+0000","last_undegraded":"2024-09-11T14:39:38.386770+0000","last_fullsized":"2024-09-11T14:39:38.386770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"39'41","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:47.949984+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:39:47.949984+0000","last_peered":"2024-09-11T14:39:47.949984+0000","last_clean":"2024-09-11T14:39:47.949984+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:39:47.949984+0000","last_undegraded":"2024-09-11T14:39:47.949984+0000","last_fullsized":"2024-09-11T14:39:47.949984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.371236+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:39:38.371236+0000","last_peered":"2024-09-11T14:39:38.371236+0000","last_clean":"2024-09-11T14:39:38.371236+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:39:38.371236+0000","last_undegraded":"2024-09-11T14:39:38.371236+0000","last_fullsized":"2024-09-11T14:39:38.371236+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"39'46","reported_seq":58,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:48.297065+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:39:48.297065+0000","last_peered":"2024-09-11T14:39:48.297065+0000","last_clean":"2024-09-11T14:39:48.297065+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:39:48.297065+0000","last_undegraded":"2024-09-11T14:39:48.297065+0000","last_fullsized":"2024-09-11T14:39:48.297065+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.382974+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:39:38.382974+0000","last_peered":"2024-09-11T14:39:38.382974+0000","last_clean":"2024-09-11T14:39:38.382974+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:39:38.382974+0000","last_undegraded":"2024-09-11T14:39:38.382974+0000","last_fullsized":"2024-09-11T14:39:38.382974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"39'39","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:47.650609+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:39:47.650609+0000","last_peered":"2024-09-11T14:39:47.650609+0000","last_clean":"2024-09-11T14:39:47.650609+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:39:47.650609+0000","last_undegraded":"2024-09-11T14:39:47.650609+0000","last_fullsized":"2024-09-11T14:39:47.650609+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.379609+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:39:38.379609+0000","last_peered":"2024-09-11T14:39:38.379609+0000","last_clean":"2024-09-11T14:39:38.379609+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:39:38.379609+0000","last_undegraded":"2024-09-11T14:39:38.379609+0000","last_fullsized":"2024-09-11T14:39:38.379609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'38","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:48.064424+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:39:48.064424+0000","last_peered":"2024-09-11T14:39:48.064424+0000","last_clean":"2024-09-11T14:39:48.064424+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:39:48.064424+0000","last_undegraded":"2024-09-11T14:39:48.064424+0000","last_fullsized":"2024-09-11T14:39:48.064424+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.377235+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:39:38.377235+0000","last_peered":"2024-09-11T14:39:38.377235+0000","last_clean":"2024-09-11T14:39:38.377235+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:39:38.377235+0000","last_undegraded":"2024-09-11T14:39:38.377235+0000","last_fullsized":"2024-09-11T14:39:38.377235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"39'40","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:47.765681+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:39:47.765681+0000","last_peered":"2024-09-11T14:39:47.765681+0000","last_clean":"2024-09-11T14:39:47.765681+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:39:47.765681+0000","last_undegraded":"2024-09-11T14:39:47.765681+0000","last_fullsized":"2024-09-11T14:39:47.765681+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.377734+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:39:38.377734+0000","last_peered":"2024-09-11T14:39:38.377734+0000","last_clean":"2024-09-11T14:39:38.377734+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:39:38.377734+0000","last_undegraded":"2024-09-11T14:39:38.377734+0000","last_fullsized":"2024-09-11T14:39:38.377734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"39'52","reported_seq":64,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:48.061284+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:39:48.061284+0000","last_peered":"2024-09-11T14:39:48.061284+0000","last_clean":"2024-09-11T14:39:48.061284+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:39:48.061284+0000","last_undegraded":"2024-09-11T14:39:48.061284+0000","last_fullsized":"2024-09-11T14:39:48.061284+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.378445+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:39:38.378445+0000","last_peered":"2024-09-11T14:39:38.378445+0000","last_clean":"2024-09-11T14:39:38.378445+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:39:38.378445+0000","last_undegraded":"2024-09-11T14:39:38.378445+0000","last_fullsized":"2024-09-11T14:39:38.378445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":47775744,"num_objects":729,"num_object_clones":0,"num_object_copies":2187,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":46656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213907845120,"internally_reserved":0,"allocated":303648768,"data_stored":303648768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":729,"ondisk_log_size":729,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213907976192,"internally_reserved":0,"allocated":303517696,"data_stored":303517696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53463273472,"internally_reserved":0,"allocated":89600000,"data_stored":89600000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673184,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":79796,"kb_used_data":79796,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52217932,"statfs":{"total":53552873472,"available":53471162368,"internally_reserved":0,"allocated":81711104,"data_stored":81711104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":56444,"kb_used_data":56444,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52241284,"statfs":{"total":53552873472,"available":53495074816,"internally_reserved":0,"allocated":57798656,"data_stored":57798656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":66172,"kb_used_data":66172,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52231556,"statfs":{"total":53552873472,"available":53485113344,"internally_reserved":0,"allocated":67760128,"data_stored":67760128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":70028,"kb_used_data":70028,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52227700,"statfs":{"total":53552873472,"available":53481164800,"internally_reserved":0,"allocated":71708672,"data_stored":71708672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53463273472,"internally_reserved":0,"allocated":89600000,"data_stored":89600000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53479694336,"internally_reserved":0,"allocated":73179136,"data_stored":73179136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53474557952,"internally_reserved":0,"allocated":78315520,"data_stored":78315520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53490450432,"internally_reserved":0,"allocated":62423040,"data_stored":62423040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53463273472,"internally_reserved":0,"allocated":89600000,"data_stored":89600000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53479563264,"internally_reserved":0,"allocated":73310208,"data_stored":73310208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53474557952,"internally_reserved":0,"allocated":78315520,"data_stored":78315520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53490450432,"internally_reserved":0,"allocated":62423040,"data_stored":62423040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53463273472,"internally_reserved":0,"allocated":89600000,"data_stored":89600000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:39:52.429 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 14 16 1063 1047 4.67366 5.5 0.366236 0.212202 2024-09-11T14:39:52.636 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:39:52.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:52.772+0000 7f3d3f8b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:52.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:52.780+0000 7f3d3f8b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:53.429 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 15 16 1144 1128 4.69955 5.0625 0.0674712 0.209625 2024-09-11T14:39:54.429 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 16 16 1217 1201 4.69096 4.5625 0.257689 0.20928 2024-09-11T14:39:55.326 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:39:55.429 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 17 16 1301 1285 4.72382 5.25 0.446479 0.209933 2024-09-11T14:39:55.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:55.505+0000 7fb8b4cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:55.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:55.516+0000 7fb8b4cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:56.429 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 18 16 1394 1378 4.78427 5.8125 0.16027 0.207878 2024-09-11T14:39:57.244 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:39:57.244 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:39:57.244 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:39:57.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:57.406+0000 7f948b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:57.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:57.418+0000 7f948b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:57.429 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 19 16 1481 1465 4.81862 5.4375 0.173203 0.205802 2024-09-11T14:39:57.784 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:39:57.784 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:39:57.802 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-11T14:39:57.267514+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75498035,"num_objects":1147,"num_object_clones":0,"num_object_copies":3441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1224,"num_write_kb":74260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1198,"ondisk_log_size":1198,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":432304,"kb_used_data":432304,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208758608,"statfs":{"total":214211493888,"available":213768814592,"internally_reserved":0,"allocated":442679296,"data_stored":442679296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":53149696,"num_objects":811,"num_object_clones":0,"num_object_copies":2433,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":51904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002742"},"pg_stats":[{"pgid":"4.f","version":"39'80","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:53.178982+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:39:53.178982+0000","last_peered":"2024-09-11T14:39:53.178982+0000","last_clean":"2024-09-11T14:39:53.178982+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:39:53.178982+0000","last_undegraded":"2024-09-11T14:39:53.178982+0000","last_fullsized":"2024-09-11T14:39:53.178982+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"39'74","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:53.146725+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:39:53.146725+0000","last_peered":"2024-09-11T14:39:53.146725+0000","last_clean":"2024-09-11T14:39:53.146725+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:39:53.146725+0000","last_undegraded":"2024-09-11T14:39:53.146725+0000","last_fullsized":"2024-09-11T14:39:53.146725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"39'76","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:52.538305+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:39:52.538305+0000","last_peered":"2024-09-11T14:39:52.538305+0000","last_clean":"2024-09-11T14:39:52.538305+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:39:52.538305+0000","last_undegraded":"2024-09-11T14:39:52.538305+0000","last_fullsized":"2024-09-11T14:39:52.538305+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"39'74","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:54.209697+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:39:54.209697+0000","last_peered":"2024-09-11T14:39:54.209697+0000","last_clean":"2024-09-11T14:39:54.209697+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:39:54.209697+0000","last_undegraded":"2024-09-11T14:39:54.209697+0000","last_fullsized":"2024-09-11T14:39:54.209697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"39'69","reported_seq":81,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:53.369882+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:39:53.369882+0000","last_peered":"2024-09-11T14:39:53.369882+0000","last_clean":"2024-09-11T14:39:53.369882+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:39:53.369882+0000","last_undegraded":"2024-09-11T14:39:53.369882+0000","last_fullsized":"2024-09-11T14:39:53.369882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"39'83","reported_seq":95,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:52.927783+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:39:52.927783+0000","last_peered":"2024-09-11T14:39:52.927783+0000","last_clean":"2024-09-11T14:39:52.927783+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:39:52.927783+0000","last_undegraded":"2024-09-11T14:39:52.927783+0000","last_fullsized":"2024-09-11T14:39:52.927783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'79","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:53.075738+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:39:53.075738+0000","last_peered":"2024-09-11T14:39:53.075738+0000","last_clean":"2024-09-11T14:39:53.075738+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:39:53.075738+0000","last_undegraded":"2024-09-11T14:39:53.075738+0000","last_fullsized":"2024-09-11T14:39:53.075738+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"39'55","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:52.558771+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:39:52.558771+0000","last_peered":"2024-09-11T14:39:52.558771+0000","last_clean":"2024-09-11T14:39:52.558771+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:39:52.558771+0000","last_undegraded":"2024-09-11T14:39:52.558771+0000","last_fullsized":"2024-09-11T14:39:52.558771+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"39'81","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:52.934914+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:39:52.934914+0000","last_peered":"2024-09-11T14:39:52.934914+0000","last_clean":"2024-09-11T14:39:52.934914+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:39:52.934914+0000","last_undegraded":"2024-09-11T14:39:52.934914+0000","last_fullsized":"2024-09-11T14:39:52.934914+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.371560+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:39:38.371560+0000","last_peered":"2024-09-11T14:39:38.371560+0000","last_clean":"2024-09-11T14:39:38.371560+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:39:38.371560+0000","last_undegraded":"2024-09-11T14:39:38.371560+0000","last_fullsized":"2024-09-11T14:39:38.371560+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.379160+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:39:38.379160+0000","last_peered":"2024-09-11T14:39:38.379160+0000","last_clean":"2024-09-11T14:39:38.379160+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:39:38.379160+0000","last_undegraded":"2024-09-11T14:39:38.379160+0000","last_fullsized":"2024-09-11T14:39:38.379160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"39'65","reported_seq":77,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:52.508893+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:39:52.508893+0000","last_peered":"2024-09-11T14:39:52.508893+0000","last_clean":"2024-09-11T14:39:52.508893+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:39:52.508893+0000","last_undegraded":"2024-09-11T14:39:52.508893+0000","last_fullsized":"2024-09-11T14:39:52.508893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.386770+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:39:38.386770+0000","last_peered":"2024-09-11T14:39:38.386770+0000","last_clean":"2024-09-11T14:39:38.386770+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:39:38.386770+0000","last_undegraded":"2024-09-11T14:39:38.386770+0000","last_fullsized":"2024-09-11T14:39:38.386770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"39'69","reported_seq":81,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:53.169163+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:39:53.169163+0000","last_peered":"2024-09-11T14:39:53.169163+0000","last_clean":"2024-09-11T14:39:53.169163+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:39:53.169163+0000","last_undegraded":"2024-09-11T14:39:53.169163+0000","last_fullsized":"2024-09-11T14:39:53.169163+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.371236+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:39:38.371236+0000","last_peered":"2024-09-11T14:39:38.371236+0000","last_clean":"2024-09-11T14:39:38.371236+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:39:38.371236+0000","last_undegraded":"2024-09-11T14:39:38.371236+0000","last_fullsized":"2024-09-11T14:39:38.371236+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"39'70","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:52.824184+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:39:52.824184+0000","last_peered":"2024-09-11T14:39:52.824184+0000","last_clean":"2024-09-11T14:39:52.824184+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:39:52.824184+0000","last_undegraded":"2024-09-11T14:39:52.824184+0000","last_fullsized":"2024-09-11T14:39:52.824184+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.382974+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:39:38.382974+0000","last_peered":"2024-09-11T14:39:38.382974+0000","last_clean":"2024-09-11T14:39:38.382974+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:39:38.382974+0000","last_undegraded":"2024-09-11T14:39:38.382974+0000","last_fullsized":"2024-09-11T14:39:38.382974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"39'69","reported_seq":81,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:53.155200+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:39:53.155200+0000","last_peered":"2024-09-11T14:39:53.155200+0000","last_clean":"2024-09-11T14:39:53.155200+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:39:53.155200+0000","last_undegraded":"2024-09-11T14:39:53.155200+0000","last_fullsized":"2024-09-11T14:39:53.155200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.379609+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:39:38.379609+0000","last_peered":"2024-09-11T14:39:38.379609+0000","last_clean":"2024-09-11T14:39:38.379609+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:39:38.379609+0000","last_undegraded":"2024-09-11T14:39:38.379609+0000","last_fullsized":"2024-09-11T14:39:38.379609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'56","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:52.830376+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:39:52.830376+0000","last_peered":"2024-09-11T14:39:52.830376+0000","last_clean":"2024-09-11T14:39:52.830376+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:39:52.830376+0000","last_undegraded":"2024-09-11T14:39:52.830376+0000","last_fullsized":"2024-09-11T14:39:52.830376+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.377235+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:39:38.377235+0000","last_peered":"2024-09-11T14:39:38.377235+0000","last_clean":"2024-09-11T14:39:38.377235+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:39:38.377235+0000","last_undegraded":"2024-09-11T14:39:38.377235+0000","last_fullsized":"2024-09-11T14:39:38.377235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"39'67","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:52.806857+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:39:52.806857+0000","last_peered":"2024-09-11T14:39:52.806857+0000","last_clean":"2024-09-11T14:39:52.806857+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:39:52.806857+0000","last_undegraded":"2024-09-11T14:39:52.806857+0000","last_fullsized":"2024-09-11T14:39:52.806857+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.377734+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:39:38.377734+0000","last_peered":"2024-09-11T14:39:38.377734+0000","last_clean":"2024-09-11T14:39:38.377734+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:39:38.377734+0000","last_undegraded":"2024-09-11T14:39:38.377734+0000","last_fullsized":"2024-09-11T14:39:38.377734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"39'76","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:52.297060+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:39:52.297060+0000","last_peered":"2024-09-11T14:39:52.297060+0000","last_clean":"2024-09-11T14:39:52.297060+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:39:52.297060+0000","last_undegraded":"2024-09-11T14:39:52.297060+0000","last_fullsized":"2024-09-11T14:39:52.297060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.378445+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:39:38.378445+0000","last_peered":"2024-09-11T14:39:38.378445+0000","last_clean":"2024-09-11T14:39:38.378445+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:39:38.378445+0000","last_undegraded":"2024-09-11T14:39:38.378445+0000","last_fullsized":"2024-09-11T14:39:38.378445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":74907648,"num_objects":1143,"num_object_clones":0,"num_object_copies":3429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1143,"num_write_kb":73152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213745741824,"internally_reserved":0,"allocated":465752064,"data_stored":465752064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1143,"ondisk_log_size":1143,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213745741824,"internally_reserved":0,"allocated":465752064,"data_stored":465752064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53419208704,"internally_reserved":0,"allocated":133664768,"data_stored":133664768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":124720,"kb_used_data":124720,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52173008,"statfs":{"total":53552873472,"available":53425160192,"internally_reserved":0,"allocated":127713280,"data_stored":127713280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":88388,"kb_used_data":88388,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52209340,"statfs":{"total":53552873472,"available":53462364160,"internally_reserved":0,"allocated":90509312,"data_stored":90509312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":106380,"kb_used_data":106380,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52191348,"statfs":{"total":53552873472,"available":53443940352,"internally_reserved":0,"allocated":108933120,"data_stored":108933120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":112816,"kb_used_data":112816,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52184912,"statfs":{"total":53552873472,"available":53437349888,"internally_reserved":0,"allocated":115523584,"data_stored":115523584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53419208704,"internally_reserved":0,"allocated":133664768,"data_stored":133664768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53439082496,"internally_reserved":0,"allocated":113790976,"data_stored":113790976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53430607872,"internally_reserved":0,"allocated":122265600,"data_stored":122265600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53456842752,"internally_reserved":0,"allocated":96030720,"data_stored":96030720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53419208704,"internally_reserved":0,"allocated":133664768,"data_stored":133664768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53439082496,"internally_reserved":0,"allocated":113790976,"data_stored":113790976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53430607872,"internally_reserved":0,"allocated":122265600,"data_stored":122265600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53456842752,"internally_reserved":0,"allocated":96030720,"data_stored":96030720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53419208704,"internally_reserved":0,"allocated":133664768,"data_stored":133664768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:39:58.093 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:39:58.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:58.274+0000 7f6038791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:58.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:39:58.284+0000 7f6038791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:58.429 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:39:58.429138+0000 min lat: 0.0281091 max lat: 2.13574 avg lat: 0.20532 2024-09-11T14:39:58.429 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:39:58.429 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 20 16 1566 1550 4.8433 5.3125 0.096675 0.20532 2024-09-11T14:39:59.429 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 21 16 1642 1626 4.83883 4.75 0.089655 0.204756 2024-09-11T14:40:00.429 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 22 16 1727 1711 4.86034 5.3125 0.150625 0.204817 2024-09-11T14:40:00.726 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:40:00.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:00.893+0000 7fbfd90ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:00.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:00.901+0000 7fbfd90ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:01.429 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 23 16 1808 1792 4.86911 5.0625 0.161229 0.203413 2024-09-11T14:40:02.430 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 24 16 1873 1857 4.83548 4.0625 0.129826 0.2043 2024-09-11T14:40:02.805 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:40:02.805 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T14:40:02.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:02.927+0000 7f4201191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:02.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:02.939+0000 7f4201191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:03.430 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 25 16 1949 1933 4.83205 4.75 0.083055 0.204834 2024-09-11T14:40:03.480 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:40:03.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:03.649+0000 7f65c2b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:03.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:03.658+0000 7f65c2b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:03.856 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T14:40:03.877 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T14:40:04.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:04.025+0000 7f0216591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:04.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:04.041+0000 7f0216591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:04.430 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 26 16 2029 2013 4.83849 5 0.0481292 0.205621 2024-09-11T14:40:04.857 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T14:40:04.883 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T14:40:05.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:05.077+0000 7f8c5e088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:05.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:05.091+0000 7f8c5e088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:05.430 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 27 16 2103 2087 4.83057 4.625 0.156908 0.205689 2024-09-11T14:40:05.863 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T14:40:05.880 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T14:40:06.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:06.029+0000 7efcfdf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:06.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:06.043+0000 7efcfdf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:06.401 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:40:06.430 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 28 16 2150 2134 4.76294 2.9375 0.0378144 0.206398 2024-09-11T14:40:06.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:06.538+0000 7ff119591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:06.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:06.548+0000 7ff119591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:06.868 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T14:40:06.896 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T14:40:06.896 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:40:07.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:07.100+0000 7f87bf391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:07.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:07.110+0000 7f87bf391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:07.392 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:40:07.392 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:40:07.409 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-11T14:40:07.269794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128320051,"num_objects":1953,"num_object_clones":0,"num_object_copies":5859,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2030,"num_write_kb":125844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2004,"ondisk_log_size":2004,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":744952,"kb_used_data":744952,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208445960,"statfs":{"total":214211493888,"available":213448663040,"internally_reserved":0,"allocated":762830848,"data_stored":762830848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25165824,"num_objects":384,"num_object_clones":0,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000866"},"pg_stats":[{"pgid":"4.f","version":"39'136","reported_seq":148,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:03.119969+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:40:03.119969+0000","last_peered":"2024-09-11T14:40:03.119969+0000","last_clean":"2024-09-11T14:40:03.119969+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:40:03.119969+0000","last_undegraded":"2024-09-11T14:40:03.119969+0000","last_fullsized":"2024-09-11T14:40:03.119969+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8912896,"num_objects":136,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":8704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"39'109","reported_seq":121,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:02.231613+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:40:02.231613+0000","last_peered":"2024-09-11T14:40:02.231613+0000","last_clean":"2024-09-11T14:40:02.231613+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:40:02.231613+0000","last_undegraded":"2024-09-11T14:40:02.231613+0000","last_fullsized":"2024-09-11T14:40:02.231613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":6976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"39'121","reported_seq":133,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:02.851660+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:40:02.851660+0000","last_peered":"2024-09-11T14:40:02.851660+0000","last_clean":"2024-09-11T14:40:02.851660+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:40:02.851660+0000","last_undegraded":"2024-09-11T14:40:02.851660+0000","last_fullsized":"2024-09-11T14:40:02.851660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"40'124","reported_seq":139,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-11T14:40:04.210312+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:40:04.210312+0000","last_peered":"2024-09-11T14:40:04.210312+0000","last_clean":"2024-09-11T14:40:04.210312+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:40:04.210312+0000","last_undegraded":"2024-09-11T14:40:04.210312+0000","last_fullsized":"2024-09-11T14:40:04.210312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"39'128","reported_seq":140,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:03.314378+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:40:03.314378+0000","last_peered":"2024-09-11T14:40:03.314378+0000","last_clean":"2024-09-11T14:40:03.314378+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:40:03.314378+0000","last_undegraded":"2024-09-11T14:40:03.314378+0000","last_fullsized":"2024-09-11T14:40:03.314378+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"39'129","reported_seq":141,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:02.613593+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:40:02.613593+0000","last_peered":"2024-09-11T14:40:02.613593+0000","last_clean":"2024-09-11T14:40:02.613593+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:40:02.613593+0000","last_undegraded":"2024-09-11T14:40:02.613593+0000","last_fullsized":"2024-09-11T14:40:02.613593+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'121","reported_seq":133,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:02.935292+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:40:02.935292+0000","last_peered":"2024-09-11T14:40:02.935292+0000","last_clean":"2024-09-11T14:40:02.935292+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:40:02.935292+0000","last_undegraded":"2024-09-11T14:40:02.935292+0000","last_fullsized":"2024-09-11T14:40:02.935292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"39'105","reported_seq":117,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:03.104675+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:40:03.104675+0000","last_peered":"2024-09-11T14:40:03.104675+0000","last_clean":"2024-09-11T14:40:03.104675+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:40:03.104675+0000","last_undegraded":"2024-09-11T14:40:03.104675+0000","last_fullsized":"2024-09-11T14:40:03.104675+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"39'132","reported_seq":144,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:02.601902+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:40:02.601902+0000","last_peered":"2024-09-11T14:40:02.601902+0000","last_clean":"2024-09-11T14:40:02.601902+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:40:02.601902+0000","last_undegraded":"2024-09-11T14:40:02.601902+0000","last_fullsized":"2024-09-11T14:40:02.601902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-11T14:40:03.894748+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:40:03.894748+0000","last_peered":"2024-09-11T14:40:03.894748+0000","last_clean":"2024-09-11T14:40:03.894748+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:40:03.894748+0000","last_undegraded":"2024-09-11T14:40:03.894748+0000","last_fullsized":"2024-09-11T14:40:03.894748+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.379160+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:39:38.379160+0000","last_peered":"2024-09-11T14:39:38.379160+0000","last_clean":"2024-09-11T14:39:38.379160+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:39:38.379160+0000","last_undegraded":"2024-09-11T14:39:38.379160+0000","last_fullsized":"2024-09-11T14:39:38.379160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"39'118","reported_seq":130,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:03.225826+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:40:03.225826+0000","last_peered":"2024-09-11T14:40:03.225826+0000","last_clean":"2024-09-11T14:40:03.225826+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:40:03.225826+0000","last_undegraded":"2024-09-11T14:40:03.225826+0000","last_fullsized":"2024-09-11T14:40:03.225826+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.386770+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:39:38.386770+0000","last_peered":"2024-09-11T14:39:38.386770+0000","last_clean":"2024-09-11T14:39:38.386770+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:39:38.386770+0000","last_undegraded":"2024-09-11T14:39:38.386770+0000","last_fullsized":"2024-09-11T14:39:38.386770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"39'128","reported_seq":140,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:02.939650+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:40:02.939650+0000","last_peered":"2024-09-11T14:40:02.939650+0000","last_clean":"2024-09-11T14:40:02.939650+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:40:02.939650+0000","last_undegraded":"2024-09-11T14:40:02.939650+0000","last_fullsized":"2024-09-11T14:40:02.939650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.371236+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:39:38.371236+0000","last_peered":"2024-09-11T14:39:38.371236+0000","last_clean":"2024-09-11T14:39:38.371236+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:39:38.371236+0000","last_undegraded":"2024-09-11T14:39:38.371236+0000","last_fullsized":"2024-09-11T14:39:38.371236+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"39'118","reported_seq":130,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:03.008197+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:40:03.008197+0000","last_peered":"2024-09-11T14:40:03.008197+0000","last_clean":"2024-09-11T14:40:03.008197+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:40:03.008197+0000","last_undegraded":"2024-09-11T14:40:03.008197+0000","last_fullsized":"2024-09-11T14:40:03.008197+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.382974+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:39:38.382974+0000","last_peered":"2024-09-11T14:39:38.382974+0000","last_clean":"2024-09-11T14:39:38.382974+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:39:38.382974+0000","last_undegraded":"2024-09-11T14:39:38.382974+0000","last_fullsized":"2024-09-11T14:39:38.382974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"39'119","reported_seq":131,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:02.750523+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:40:02.750523+0000","last_peered":"2024-09-11T14:40:02.750523+0000","last_clean":"2024-09-11T14:40:02.750523+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:40:02.750523+0000","last_undegraded":"2024-09-11T14:40:02.750523+0000","last_fullsized":"2024-09-11T14:40:02.750523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.379609+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:39:38.379609+0000","last_peered":"2024-09-11T14:39:38.379609+0000","last_clean":"2024-09-11T14:39:38.379609+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:39:38.379609+0000","last_undegraded":"2024-09-11T14:39:38.379609+0000","last_fullsized":"2024-09-11T14:39:38.379609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'111","reported_seq":123,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:03.142411+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:40:03.142411+0000","last_peered":"2024-09-11T14:40:03.142411+0000","last_clean":"2024-09-11T14:40:03.142411+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:40:03.142411+0000","last_undegraded":"2024-09-11T14:40:03.142411+0000","last_fullsized":"2024-09-11T14:40:03.142411+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-11T14:40:03.902254+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:03.902254+0000","last_peered":"2024-09-11T14:40:03.902254+0000","last_clean":"2024-09-11T14:40:03.902254+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:40:03.902254+0000","last_undegraded":"2024-09-11T14:40:03.902254+0000","last_fullsized":"2024-09-11T14:40:03.902254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"39'124","reported_seq":136,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:03.117153+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:40:03.117153+0000","last_peered":"2024-09-11T14:40:03.117153+0000","last_clean":"2024-09-11T14:40:03.117153+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:40:03.117153+0000","last_undegraded":"2024-09-11T14:40:03.117153+0000","last_fullsized":"2024-09-11T14:40:03.117153+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.377734+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:39:38.377734+0000","last_peered":"2024-09-11T14:39:38.377734+0000","last_clean":"2024-09-11T14:39:38.377734+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:39:38.377734+0000","last_undegraded":"2024-09-11T14:39:38.377734+0000","last_fullsized":"2024-09-11T14:39:38.377734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"39'126","reported_seq":138,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:02.865487+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:40:02.865487+0000","last_peered":"2024-09-11T14:40:02.865487+0000","last_clean":"2024-09-11T14:40:02.865487+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:40:02.865487+0000","last_undegraded":"2024-09-11T14:40:02.865487+0000","last_fullsized":"2024-09-11T14:40:02.865487+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.378445+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:39:38.378445+0000","last_peered":"2024-09-11T14:39:38.378445+0000","last_clean":"2024-09-11T14:39:38.378445+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:39:38.378445+0000","last_undegraded":"2024-09-11T14:39:38.378445+0000","last_fullsized":"2024-09-11T14:39:38.378445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":127729664,"num_objects":1949,"num_object_clones":0,"num_object_copies":5847,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1949,"num_write_kb":124736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213425741824,"internally_reserved":0,"allocated":785752064,"data_stored":785752064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1949,"ondisk_log_size":1949,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213426003968,"internally_reserved":0,"allocated":785489920,"data_stored":785489920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53333483520,"internally_reserved":0,"allocated":219389952,"data_stored":219389952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":208208,"kb_used_data":208208,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52089520,"statfs":{"total":53552873472,"available":53339668480,"internally_reserved":0,"allocated":213204992,"data_stored":213204992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":155004,"kb_used_data":155004,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52142724,"statfs":{"total":53552873472,"available":53394149376,"internally_reserved":0,"allocated":158724096,"data_stored":158724096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":185332,"kb_used_data":185332,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52112396,"statfs":{"total":53552873472,"available":53363093504,"internally_reserved":0,"allocated":189779968,"data_stored":189779968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":196408,"kb_used_data":196408,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52101320,"statfs":{"total":53552873472,"available":53351751680,"internally_reserved":0,"allocated":201121792,"data_stored":201121792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53333483520,"internally_reserved":0,"allocated":219389952,"data_stored":219389952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53357973504,"internally_reserved":0,"allocated":194899968,"data_stored":194899968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53345128448,"internally_reserved":0,"allocated":207745024,"data_stored":207745024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53389680640,"internally_reserved":0,"allocated":163192832,"data_stored":163192832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53333221376,"internally_reserved":0,"allocated":219652096,"data_stored":219652096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53357842432,"internally_reserved":0,"allocated":195031040,"data_stored":195031040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53345128448,"internally_reserved":0,"allocated":207745024,"data_stored":207745024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53389549568,"internally_reserved":0,"allocated":163323904,"data_stored":163323904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53333221376,"internally_reserved":0,"allocated":219652096,"data_stored":219652096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:40:07.410 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:40:07.430 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 29 16 2216 2200 4.74093 4.125 0.220566 0.209538 2024-09-11T14:40:07.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:07.585+0000 7f4a87ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:07.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:07.600+0000 7f4a87ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:07.983 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:40:07.983 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:40:08.007 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-11T14:40:07.269794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128320051,"num_objects":1953,"num_object_clones":0,"num_object_copies":5859,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2030,"num_write_kb":125844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2004,"ondisk_log_size":2004,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":744952,"kb_used_data":744952,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208445960,"statfs":{"total":214211493888,"available":213448663040,"internally_reserved":0,"allocated":762830848,"data_stored":762830848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25165824,"num_objects":384,"num_object_clones":0,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000866"},"pg_stats":[{"pgid":"4.f","version":"39'136","reported_seq":148,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:03.119969+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:40:03.119969+0000","last_peered":"2024-09-11T14:40:03.119969+0000","last_clean":"2024-09-11T14:40:03.119969+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:40:03.119969+0000","last_undegraded":"2024-09-11T14:40:03.119969+0000","last_fullsized":"2024-09-11T14:40:03.119969+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8912896,"num_objects":136,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":8704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"39'109","reported_seq":121,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:02.231613+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:40:02.231613+0000","last_peered":"2024-09-11T14:40:02.231613+0000","last_clean":"2024-09-11T14:40:02.231613+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:40:02.231613+0000","last_undegraded":"2024-09-11T14:40:02.231613+0000","last_fullsized":"2024-09-11T14:40:02.231613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":6976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"39'121","reported_seq":133,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:02.851660+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:40:02.851660+0000","last_peered":"2024-09-11T14:40:02.851660+0000","last_clean":"2024-09-11T14:40:02.851660+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:40:02.851660+0000","last_undegraded":"2024-09-11T14:40:02.851660+0000","last_fullsized":"2024-09-11T14:40:02.851660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"40'124","reported_seq":139,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-11T14:40:04.210312+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:40:04.210312+0000","last_peered":"2024-09-11T14:40:04.210312+0000","last_clean":"2024-09-11T14:40:04.210312+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:40:04.210312+0000","last_undegraded":"2024-09-11T14:40:04.210312+0000","last_fullsized":"2024-09-11T14:40:04.210312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"39'128","reported_seq":140,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:03.314378+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:40:03.314378+0000","last_peered":"2024-09-11T14:40:03.314378+0000","last_clean":"2024-09-11T14:40:03.314378+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:40:03.314378+0000","last_undegraded":"2024-09-11T14:40:03.314378+0000","last_fullsized":"2024-09-11T14:40:03.314378+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"39'129","reported_seq":141,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:02.613593+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:40:02.613593+0000","last_peered":"2024-09-11T14:40:02.613593+0000","last_clean":"2024-09-11T14:40:02.613593+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:40:02.613593+0000","last_undegraded":"2024-09-11T14:40:02.613593+0000","last_fullsized":"2024-09-11T14:40:02.613593+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'121","reported_seq":133,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:02.935292+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:40:02.935292+0000","last_peered":"2024-09-11T14:40:02.935292+0000","last_clean":"2024-09-11T14:40:02.935292+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:40:02.935292+0000","last_undegraded":"2024-09-11T14:40:02.935292+0000","last_fullsized":"2024-09-11T14:40:02.935292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"39'105","reported_seq":117,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:03.104675+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:40:03.104675+0000","last_peered":"2024-09-11T14:40:03.104675+0000","last_clean":"2024-09-11T14:40:03.104675+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:40:03.104675+0000","last_undegraded":"2024-09-11T14:40:03.104675+0000","last_fullsized":"2024-09-11T14:40:03.104675+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"39'132","reported_seq":144,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:02.601902+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:40:02.601902+0000","last_peered":"2024-09-11T14:40:02.601902+0000","last_clean":"2024-09-11T14:40:02.601902+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:40:02.601902+0000","last_undegraded":"2024-09-11T14:40:02.601902+0000","last_fullsized":"2024-09-11T14:40:02.601902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-11T14:40:03.894748+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:40:03.894748+0000","last_peered":"2024-09-11T14:40:03.894748+0000","last_clean":"2024-09-11T14:40:03.894748+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:40:03.894748+0000","last_undegraded":"2024-09-11T14:40:03.894748+0000","last_fullsized":"2024-09-11T14:40:03.894748+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.379160+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:39:38.379160+0000","last_peered":"2024-09-11T14:39:38.379160+0000","last_clean":"2024-09-11T14:39:38.379160+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:39:38.379160+0000","last_undegraded":"2024-09-11T14:39:38.379160+0000","last_fullsized":"2024-09-11T14:39:38.379160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"39'118","reported_seq":130,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:03.225826+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:40:03.225826+0000","last_peered":"2024-09-11T14:40:03.225826+0000","last_clean":"2024-09-11T14:40:03.225826+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:40:03.225826+0000","last_undegraded":"2024-09-11T14:40:03.225826+0000","last_fullsized":"2024-09-11T14:40:03.225826+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.386770+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:39:38.386770+0000","last_peered":"2024-09-11T14:39:38.386770+0000","last_clean":"2024-09-11T14:39:38.386770+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:39:38.386770+0000","last_undegraded":"2024-09-11T14:39:38.386770+0000","last_fullsized":"2024-09-11T14:39:38.386770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"39'128","reported_seq":140,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:02.939650+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:40:02.939650+0000","last_peered":"2024-09-11T14:40:02.939650+0000","last_clean":"2024-09-11T14:40:02.939650+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:40:02.939650+0000","last_undegraded":"2024-09-11T14:40:02.939650+0000","last_fullsized":"2024-09-11T14:40:02.939650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.371236+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:39:38.371236+0000","last_peered":"2024-09-11T14:39:38.371236+0000","last_clean":"2024-09-11T14:39:38.371236+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:39:38.371236+0000","last_undegraded":"2024-09-11T14:39:38.371236+0000","last_fullsized":"2024-09-11T14:39:38.371236+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"39'118","reported_seq":130,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:03.008197+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:40:03.008197+0000","last_peered":"2024-09-11T14:40:03.008197+0000","last_clean":"2024-09-11T14:40:03.008197+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:40:03.008197+0000","last_undegraded":"2024-09-11T14:40:03.008197+0000","last_fullsized":"2024-09-11T14:40:03.008197+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.382974+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:39:38.382974+0000","last_peered":"2024-09-11T14:39:38.382974+0000","last_clean":"2024-09-11T14:39:38.382974+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:39:38.382974+0000","last_undegraded":"2024-09-11T14:39:38.382974+0000","last_fullsized":"2024-09-11T14:39:38.382974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"39'119","reported_seq":131,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:02.750523+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:40:02.750523+0000","last_peered":"2024-09-11T14:40:02.750523+0000","last_clean":"2024-09-11T14:40:02.750523+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:40:02.750523+0000","last_undegraded":"2024-09-11T14:40:02.750523+0000","last_fullsized":"2024-09-11T14:40:02.750523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.379609+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:39:38.379609+0000","last_peered":"2024-09-11T14:39:38.379609+0000","last_clean":"2024-09-11T14:39:38.379609+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:39:38.379609+0000","last_undegraded":"2024-09-11T14:39:38.379609+0000","last_fullsized":"2024-09-11T14:39:38.379609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'111","reported_seq":123,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:03.142411+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:40:03.142411+0000","last_peered":"2024-09-11T14:40:03.142411+0000","last_clean":"2024-09-11T14:40:03.142411+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:40:03.142411+0000","last_undegraded":"2024-09-11T14:40:03.142411+0000","last_fullsized":"2024-09-11T14:40:03.142411+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-11T14:40:03.902254+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:03.902254+0000","last_peered":"2024-09-11T14:40:03.902254+0000","last_clean":"2024-09-11T14:40:03.902254+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:40:03.902254+0000","last_undegraded":"2024-09-11T14:40:03.902254+0000","last_fullsized":"2024-09-11T14:40:03.902254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"39'124","reported_seq":136,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:03.117153+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:40:03.117153+0000","last_peered":"2024-09-11T14:40:03.117153+0000","last_clean":"2024-09-11T14:40:03.117153+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:40:03.117153+0000","last_undegraded":"2024-09-11T14:40:03.117153+0000","last_fullsized":"2024-09-11T14:40:03.117153+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.377734+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:39:38.377734+0000","last_peered":"2024-09-11T14:39:38.377734+0000","last_clean":"2024-09-11T14:39:38.377734+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:39:38.377734+0000","last_undegraded":"2024-09-11T14:39:38.377734+0000","last_fullsized":"2024-09-11T14:39:38.377734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"39'126","reported_seq":138,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:40:02.865487+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:40:02.865487+0000","last_peered":"2024-09-11T14:40:02.865487+0000","last_clean":"2024-09-11T14:40:02.865487+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:40:02.865487+0000","last_undegraded":"2024-09-11T14:40:02.865487+0000","last_fullsized":"2024-09-11T14:40:02.865487+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.378445+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:39:38.378445+0000","last_peered":"2024-09-11T14:39:38.378445+0000","last_clean":"2024-09-11T14:39:38.378445+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:39:38.378445+0000","last_undegraded":"2024-09-11T14:39:38.378445+0000","last_fullsized":"2024-09-11T14:39:38.378445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":127729664,"num_objects":1949,"num_object_clones":0,"num_object_copies":5847,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1949,"num_write_kb":124736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213425741824,"internally_reserved":0,"allocated":785752064,"data_stored":785752064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1949,"ondisk_log_size":1949,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213426003968,"internally_reserved":0,"allocated":785489920,"data_stored":785489920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53333483520,"internally_reserved":0,"allocated":219389952,"data_stored":219389952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":208208,"kb_used_data":208208,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52089520,"statfs":{"total":53552873472,"available":53339668480,"internally_reserved":0,"allocated":213204992,"data_stored":213204992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":155004,"kb_used_data":155004,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52142724,"statfs":{"total":53552873472,"available":53394149376,"internally_reserved":0,"allocated":158724096,"data_stored":158724096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":185332,"kb_used_data":185332,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52112396,"statfs":{"total":53552873472,"available":53363093504,"internally_reserved":0,"allocated":189779968,"data_stored":189779968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":196408,"kb_used_data":196408,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52101320,"statfs":{"total":53552873472,"available":53351751680,"internally_reserved":0,"allocated":201121792,"data_stored":201121792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53333483520,"internally_reserved":0,"allocated":219389952,"data_stored":219389952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53357973504,"internally_reserved":0,"allocated":194899968,"data_stored":194899968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53345128448,"internally_reserved":0,"allocated":207745024,"data_stored":207745024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53389680640,"internally_reserved":0,"allocated":163192832,"data_stored":163192832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53333221376,"internally_reserved":0,"allocated":219652096,"data_stored":219652096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53357842432,"internally_reserved":0,"allocated":195031040,"data_stored":195031040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53345128448,"internally_reserved":0,"allocated":207745024,"data_stored":207745024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53389549568,"internally_reserved":0,"allocated":163323904,"data_stored":163323904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53333221376,"internally_reserved":0,"allocated":219652096,"data_stored":219652096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:40:08.009 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T14:40:08.010 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:40:08.010 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:40:08.010 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:40:08.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:08.190+0000 7fc406151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:08.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:08.201+0000 7fc406151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:08.430 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 30 16 2291 2275 4.73914 4.6875 0.474901 0.210064 2024-09-11T14:40:08.445 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:40:08.445 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:40:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:40:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:40:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:40:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:40:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:40:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:40:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:40:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:40:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:40:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:40:08.450 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:40:08.451 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:40:08.451 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:40:08.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:08.612+0000 7f25a929c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:08.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:08.630+0000 7f25a929c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:08.816 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:40:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:40:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:40:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:40:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:40:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:40:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:40:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:40:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:40:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:40:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:40:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:40:08.821 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:40:08.821 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:40:08.821 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:40:09.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:08.998+0000 7f4878f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:09.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:09.013+0000 7f4878f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:09.075 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:40:09.075 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:40:09.075 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:40:09.075 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:40:09.075 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:40:09.075 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:40:09.076 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:40:09.076 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:40:09.076 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:40:09.076 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:40:09.076 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:40:09.076 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:40:09.080 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:40:09.080 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:40:09.081 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:40:09.209 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:40:09.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:09.208+0000 7fd5f4751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:09.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:09.220+0000 7fd5f4751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:09.253 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:40:09.253 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:40:09.253 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:40:09.254 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:40:09.254 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:40:09.254 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:40:09.254 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:40:09.254 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:40:09.254 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:40:09.254 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:40:09.254 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:40:09.254 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:40:09.258 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:40:09.258 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:40:09.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:09.357+0000 7f5e0ae9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:09.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:09.365+0000 7f5e0ae9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:09.430 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 31 16 2366 2350 4.73746 4.6875 0.154885 0.210109 2024-09-11T14:40:10.430 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 32 16 2448 2432 4.74955 5.125 0.474553 0.209697 2024-09-11T14:40:11.430 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 33 16 2504 2488 4.71167 3.5 0.0989093 0.210147 2024-09-11T14:40:12.154 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:40:12.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:12.319+0000 7fbbf0cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:12.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:12.327+0000 7fbbf0cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:12.430 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 34 16 2572 2556 4.69808 4.25 0.510961 0.211705 2024-09-11T14:40:13.431 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 35 16 2637 2621 4.67991 4.0625 0.758629 0.212681 2024-09-11T14:40:14.260 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:40:14.260 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:40:14.260 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:40:14.260 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:40:14.431 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 36 16 2708 2692 4.67317 4.4375 0.127462 0.213234 2024-09-11T14:40:14.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:14.439+0000 7f556a311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:14.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:14.457+0000 7f556a311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:14.721 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:40:14.721 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:40:14.722 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:40:14.722 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:40:14.722 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:40:14.722 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:40:14.722 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:40:14.722 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:40:14.722 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:40:14.722 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:40:14.722 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:40:14.722 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:40:14.725 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:40:14.725 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:40:14.725 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:40:14.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:14.860+0000 7fa327791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:14.872+0000 7fa327791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:14.885 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:40:15.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:15.063+0000 7f4482a88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:15.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:15.071+0000 7f4482a88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:15.085 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:40:15.085 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:40:15.085 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:40:15.085 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:40:15.085 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:40:15.085 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:40:15.085 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:40:15.085 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:40:15.085 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:40:15.085 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:40:15.086 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:40:15.086 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:40:15.090 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:40:15.090 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:40:15.091 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:40:15.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:15.223+0000 7fc0ba711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:15.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:15.235+0000 7fc0ba711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:40:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:40:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:40:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:40:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:40:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:40:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:40:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:40:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:40:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:40:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:40:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:40:15.306 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:40:15.307 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:40:15.307 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:40:15.431 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 37 16 2773 2757 4.65665 4.0625 0.119962 0.21354 2024-09-11T14:40:15.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:15.450+0000 7f10a42d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:15.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:15.464+0000 7f10a42d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:15.532 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:40:15.532 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:40:15.532 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:40:15.532 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:40:15.532 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:40:15.532 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:40:15.532 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:40:15.532 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:40:15.532 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:40:15.533 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:40:15.533 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:40:15.533 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:40:15.535 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:40:15.536 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:40:16.431 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 38 16 2828 2812 4.62456 3.4375 0.471077 0.214695 2024-09-11T14:40:17.431 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 39 16 2887 2871 4.60052 3.6875 0.333159 0.216341 2024-09-11T14:40:17.689 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:40:17.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:17.867+0000 7fb7ba2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:17.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:17.877+0000 7fb7ba2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:18.431 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:40:18.431053+0000 min lat: 0.0281091 max lat: 2.13574 avg lat: 0.216915 2024-09-11T14:40:18.431 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:40:18.431 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 40 16 2947 2931 4.57925 3.75 0.26019 0.216915 2024-09-11T14:40:19.431 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 41 16 3001 2985 4.54987 3.375 0.42044 0.21871 2024-09-11T14:40:20.432 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 42 16 3059 3043 4.52784 3.625 0.242876 0.220026 2024-09-11T14:40:20.475 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:40:20.537 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:40:20.537 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:40:20.537 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:40:20.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:20.659+0000 7facaa6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:20.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:20.668+0000 7faca946f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:20.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:20.720+0000 7f7619246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:20.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:20.731+0000 7f7619246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:21.116 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:40:21.116 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:40:21.147 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-09-11T14:40:19.272792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":192217651,"num_objects":2928,"num_object_clones":0,"num_object_copies":8784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3005,"num_write_kb":188244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2979,"ondisk_log_size":2979,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1103240,"kb_used_data":1103240,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208087672,"statfs":{"total":214211493888,"available":213081776128,"internally_reserved":0,"allocated":1129717760,"data_stored":1129717760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":63897600,"num_objects":975,"num_object_clones":0,"num_object_copies":2925,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":975,"num_write_kb":62400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002998"},"pg_stats":[{"pgid":"4.f","version":"43'197","reported_seq":221,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:17.930586+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:40:17.930586+0000","last_peered":"2024-09-11T14:40:17.930586+0000","last_clean":"2024-09-11T14:40:17.930586+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:40:17.930586+0000","last_undegraded":"2024-09-11T14:40:17.930586+0000","last_fullsized":"2024-09-11T14:40:17.930586+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12910592,"num_objects":197,"num_object_clones":0,"num_object_copies":591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":12608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"43'170","reported_seq":194,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:17.761835+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:40:17.761835+0000","last_peered":"2024-09-11T14:40:17.761835+0000","last_clean":"2024-09-11T14:40:17.761835+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:40:17.761835+0000","last_undegraded":"2024-09-11T14:40:17.761835+0000","last_fullsized":"2024-09-11T14:40:17.761835+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11141120,"num_objects":170,"num_object_clones":0,"num_object_copies":510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"43'183","reported_seq":207,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:17.046617+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:40:17.046617+0000","last_peered":"2024-09-11T14:40:17.046617+0000","last_clean":"2024-09-11T14:40:17.046617+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:40:17.046617+0000","last_undegraded":"2024-09-11T14:40:17.046617+0000","last_fullsized":"2024-09-11T14:40:17.046617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":11712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"43'153","reported_seq":177,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:14.313694+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:40:14.313694+0000","last_peered":"2024-09-11T14:40:14.313694+0000","last_clean":"2024-09-11T14:40:14.313694+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:40:14.313694+0000","last_undegraded":"2024-09-11T14:40:14.313694+0000","last_fullsized":"2024-09-11T14:40:14.313694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"43'193","reported_seq":217,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:17.818696+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:40:17.818696+0000","last_peered":"2024-09-11T14:40:17.818696+0000","last_clean":"2024-09-11T14:40:17.818696+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:40:17.818696+0000","last_undegraded":"2024-09-11T14:40:17.818696+0000","last_fullsized":"2024-09-11T14:40:17.818696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12648448,"num_objects":193,"num_object_clones":0,"num_object_copies":579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":12352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"43'182","reported_seq":206,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:17.727820+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:40:17.727820+0000","last_peered":"2024-09-11T14:40:17.727820+0000","last_clean":"2024-09-11T14:40:17.727820+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:40:17.727820+0000","last_undegraded":"2024-09-11T14:40:17.727820+0000","last_fullsized":"2024-09-11T14:40:17.727820+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927552,"num_objects":182,"num_object_clones":0,"num_object_copies":546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":11648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"43'187","reported_seq":211,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:18.119241+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:40:18.119241+0000","last_peered":"2024-09-11T14:40:18.119241+0000","last_clean":"2024-09-11T14:40:18.119241+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:40:18.119241+0000","last_undegraded":"2024-09-11T14:40:18.119241+0000","last_fullsized":"2024-09-11T14:40:18.119241+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12255232,"num_objects":187,"num_object_clones":0,"num_object_copies":561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":11968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"43'163","reported_seq":187,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:17.655292+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:40:17.655292+0000","last_peered":"2024-09-11T14:40:17.655292+0000","last_clean":"2024-09-11T14:40:17.655292+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:40:17.655292+0000","last_undegraded":"2024-09-11T14:40:17.655292+0000","last_fullsized":"2024-09-11T14:40:17.655292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":10432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"43'192","reported_seq":216,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:17.911614+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:40:17.911614+0000","last_peered":"2024-09-11T14:40:17.911614+0000","last_clean":"2024-09-11T14:40:17.911614+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:40:17.911614+0000","last_undegraded":"2024-09-11T14:40:17.911614+0000","last_fullsized":"2024-09-11T14:40:17.911614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":169,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:06.895833+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:40:06.895833+0000","last_peered":"2024-09-11T14:40:06.895833+0000","last_clean":"2024-09-11T14:40:06.895833+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:40:06.895833+0000","last_undegraded":"2024-09-11T14:40:06.895833+0000","last_fullsized":"2024-09-11T14:40:06.895833+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:06.967869+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:40:06.967869+0000","last_peered":"2024-09-11T14:40:06.967869+0000","last_clean":"2024-09-11T14:40:06.967869+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:40:06.967869+0000","last_undegraded":"2024-09-11T14:40:06.967869+0000","last_fullsized":"2024-09-11T14:40:06.967869+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"43'190","reported_seq":214,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:18.334954+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:40:18.334954+0000","last_peered":"2024-09-11T14:40:18.334954+0000","last_clean":"2024-09-11T14:40:18.334954+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:40:18.334954+0000","last_undegraded":"2024-09-11T14:40:18.334954+0000","last_fullsized":"2024-09-11T14:40:18.334954+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12451840,"num_objects":190,"num_object_clones":0,"num_object_copies":570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":12160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:06.934302+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:40:06.934302+0000","last_peered":"2024-09-11T14:40:06.934302+0000","last_clean":"2024-09-11T14:40:06.934302+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:40:06.934302+0000","last_undegraded":"2024-09-11T14:40:06.934302+0000","last_fullsized":"2024-09-11T14:40:06.934302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"43'195","reported_seq":219,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:18.118018+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:40:18.118018+0000","last_peered":"2024-09-11T14:40:18.118018+0000","last_clean":"2024-09-11T14:40:18.118018+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:40:18.118018+0000","last_undegraded":"2024-09-11T14:40:18.118018+0000","last_fullsized":"2024-09-11T14:40:18.118018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12779520,"num_objects":195,"num_object_clones":0,"num_object_copies":585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":195,"num_write_kb":12480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:06.961279+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:40:06.961279+0000","last_peered":"2024-09-11T14:40:06.961279+0000","last_clean":"2024-09-11T14:40:06.961279+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:40:06.961279+0000","last_undegraded":"2024-09-11T14:40:06.961279+0000","last_fullsized":"2024-09-11T14:40:06.961279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"43'181","reported_seq":205,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:17.715030+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:40:17.715030+0000","last_peered":"2024-09-11T14:40:17.715030+0000","last_clean":"2024-09-11T14:40:17.715030+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:40:17.715030+0000","last_undegraded":"2024-09-11T14:40:17.715030+0000","last_fullsized":"2024-09-11T14:40:17.715030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11862016,"num_objects":181,"num_object_clones":0,"num_object_copies":543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":11584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:06.923355+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:40:06.923355+0000","last_peered":"2024-09-11T14:40:06.923355+0000","last_clean":"2024-09-11T14:40:06.923355+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:40:06.923355+0000","last_undegraded":"2024-09-11T14:40:06.923355+0000","last_fullsized":"2024-09-11T14:40:06.923355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"43'179","reported_seq":203,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:17.424354+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:40:17.424354+0000","last_peered":"2024-09-11T14:40:17.424354+0000","last_clean":"2024-09-11T14:40:17.424354+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:40:17.424354+0000","last_undegraded":"2024-09-11T14:40:17.424354+0000","last_fullsized":"2024-09-11T14:40:17.424354+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11730944,"num_objects":179,"num_object_clones":0,"num_object_copies":537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":11456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:06.907931+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:40:06.907931+0000","last_peered":"2024-09-11T14:40:06.907931+0000","last_clean":"2024-09-11T14:40:06.907931+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:40:06.907931+0000","last_undegraded":"2024-09-11T14:40:06.907931+0000","last_fullsized":"2024-09-11T14:40:06.907931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"43'182","reported_seq":206,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:17.841064+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:40:17.841064+0000","last_peered":"2024-09-11T14:40:17.841064+0000","last_clean":"2024-09-11T14:40:17.841064+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:40:17.841064+0000","last_undegraded":"2024-09-11T14:40:17.841064+0000","last_fullsized":"2024-09-11T14:40:17.841064+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927552,"num_objects":182,"num_object_clones":0,"num_object_copies":546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":11648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:06.902466+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:06.902466+0000","last_peered":"2024-09-11T14:40:06.902466+0000","last_clean":"2024-09-11T14:40:06.902466+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:40:06.902466+0000","last_undegraded":"2024-09-11T14:40:06.902466+0000","last_fullsized":"2024-09-11T14:40:06.902466+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"43'188","reported_seq":212,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:18.034525+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:40:18.034525+0000","last_peered":"2024-09-11T14:40:18.034525+0000","last_clean":"2024-09-11T14:40:18.034525+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:40:18.034525+0000","last_undegraded":"2024-09-11T14:40:18.034525+0000","last_fullsized":"2024-09-11T14:40:18.034525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12320768,"num_objects":188,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":12032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:06.907613+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:06.907613+0000","last_peered":"2024-09-11T14:40:06.907613+0000","last_clean":"2024-09-11T14:40:06.907613+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:40:06.907613+0000","last_undegraded":"2024-09-11T14:40:06.907613+0000","last_fullsized":"2024-09-11T14:40:06.907613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"43'189","reported_seq":213,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:18.213763+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:40:18.213763+0000","last_peered":"2024-09-11T14:40:18.213763+0000","last_clean":"2024-09-11T14:40:18.213763+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:40:18.213763+0000","last_undegraded":"2024-09-11T14:40:18.213763+0000","last_fullsized":"2024-09-11T14:40:18.213763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12386304,"num_objects":189,"num_object_clones":0,"num_object_copies":567,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":12096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T14:40:06.967947+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:40:06.967947+0000","last_peered":"2024-09-11T14:40:06.967947+0000","last_clean":"2024-09-11T14:40:06.967947+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:40:06.967947+0000","last_undegraded":"2024-09-11T14:40:06.967947+0000","last_fullsized":"2024-09-11T14:40:06.967947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":191627264,"num_objects":2924,"num_object_clones":0,"num_object_copies":8772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2924,"num_write_kb":187136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213065228288,"internally_reserved":0,"allocated":1146265600,"data_stored":1146265600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2924,"ondisk_log_size":2924,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213065359360,"internally_reserved":0,"allocated":1146134528,"data_stored":1146134528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53261766656,"internally_reserved":0,"allocated":291106816,"data_stored":291106816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":278776,"kb_used_data":278776,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52018952,"statfs":{"total":53552873472,"available":53267406848,"internally_reserved":0,"allocated":285466624,"data_stored":285466624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":238536,"kb_used_data":238536,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52059192,"statfs":{"total":53552873472,"available":53308612608,"internally_reserved":0,"allocated":244260864,"data_stored":244260864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":285960,"kb_used_data":285960,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52011768,"statfs":{"total":53552873472,"available":53260050432,"internally_reserved":0,"allocated":292823040,"data_stored":292823040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":299968,"kb_used_data":299968,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51997760,"statfs":{"total":53552873472,"available":53245706240,"internally_reserved":0,"allocated":307167232,"data_stored":307167232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53261766656,"internally_reserved":0,"allocated":291106816,"data_stored":291106816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53256773632,"internally_reserved":0,"allocated":296099840,"data_stored":296099840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53240832000,"internally_reserved":0,"allocated":312041472,"data_stored":312041472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53305987072,"internally_reserved":0,"allocated":246886400,"data_stored":246886400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53261766656,"internally_reserved":0,"allocated":291106816,"data_stored":291106816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53256773632,"internally_reserved":0,"allocated":296099840,"data_stored":296099840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53240700928,"internally_reserved":0,"allocated":312172544,"data_stored":312172544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53305987072,"internally_reserved":0,"allocated":246886400,"data_stored":246886400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53261766656,"internally_reserved":0,"allocated":291106816,"data_stored":291106816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:40:21.431 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 43 15 3116 3101 4.50684 3.625 0.231432 0.220917 2024-09-11T14:40:22.431 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 44 16 3180 3164 4.49389 3.9375 0.383451 0.22187 2024-09-11T14:40:23.362 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:40:23.432 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 45 16 3240 3224 4.47734 3.75 0.118468 0.222409 2024-09-11T14:40:23.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:23.545+0000 7fd98e2a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:23.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:23.553+0000 7fd98e2a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:24.432 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 46 15 3291 3276 4.45066 3.25 0.320862 0.223062 2024-09-11T14:40:25.433 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 47 16 3342 3326 4.42244 3.125 0.102314 0.225025 2024-09-11T14:40:26.150 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:40:26.150 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T14:40:26.182 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:40:26.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:26.338+0000 7f32fbb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:26.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:26.359+0000 7f32fbb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:26.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:26.378+0000 7ffa88991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:26.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:26.392+0000 7ffa8359e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:26.432 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 48 16 3401 3385 4.40713 3.6875 0.427612 0.225854 2024-09-11T14:40:27.347 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T14:40:27.367 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T14:40:27.432 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 49 16 3447 3431 4.37585 2.875 0.473977 0.22764 2024-09-11T14:40:27.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:27.506+0000 7f8fa26bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:27.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:27.525+0000 7f8fa26bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:28.432 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 50 16 3486 3470 4.33708 2.4375 0.804661 0.229126 2024-09-11T14:40:28.831 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T14:40:28.858 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T14:40:29.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:29.000+0000 7f6dc2191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:29.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:29.021+0000 7f6dc2191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:29.133 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:40:29.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:29.321+0000 7f6318151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:29.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:29.330+0000 7f6318151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:29.432 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 51 16 3539 3523 4.31698 3.3125 0.387258 0.23082 2024-09-11T14:40:29.832 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T14:40:29.851 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T14:40:29.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:29.973+0000 7f1614791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:29.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:29.992+0000 7f1614791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:30.432 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 52 16 3601 3585 4.30848 3.875 0.157477 0.231186 2024-09-11T14:40:30.839 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T14:40:30.856 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T14:40:30.856 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:40:31.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:31.026+0000 7f14a9ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:31.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:31.037+0000 7f14a9ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:31.421 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:40:31.422 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:40:31.432 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 53 16 3657 3641 4.29321 3.5 0.959972 0.231986 2024-09-11T14:40:31.446 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-09-11T14:40:31.275318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":229114419,"num_objects":3491,"num_object_clones":0,"num_object_copies":10473,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3568,"num_write_kb":224276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3542,"ondisk_log_size":3542,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1347692,"kb_used_data":1347692,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207843220,"statfs":{"total":214211493888,"available":212831457280,"internally_reserved":0,"allocated":1380036608,"data_stored":1380036608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16449536,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":16064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000709"},"pg_stats":[{"pgid":"4.f","version":"44'219","reported_seq":246,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.385592+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:40:27.385592+0000","last_peered":"2024-09-11T14:40:27.385592+0000","last_clean":"2024-09-11T14:40:27.385592+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:40:27.385592+0000","last_undegraded":"2024-09-11T14:40:27.385592+0000","last_fullsized":"2024-09-11T14:40:27.385592+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14352384,"num_objects":219,"num_object_clones":0,"num_object_copies":657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":14016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"44'203","reported_seq":230,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.383368+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:40:27.383368+0000","last_peered":"2024-09-11T14:40:27.383368+0000","last_clean":"2024-09-11T14:40:27.383368+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:40:27.383368+0000","last_undegraded":"2024-09-11T14:40:27.383368+0000","last_fullsized":"2024-09-11T14:40:27.383368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"44'220","reported_seq":247,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.591887+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:40:27.591887+0000","last_peered":"2024-09-11T14:40:27.591887+0000","last_clean":"2024-09-11T14:40:27.591887+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:40:27.591887+0000","last_undegraded":"2024-09-11T14:40:27.591887+0000","last_fullsized":"2024-09-11T14:40:27.591887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14417920,"num_objects":220,"num_object_clones":0,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":14080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"45'226","reported_seq":256,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T14:40:28.940950+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:40:28.940950+0000","last_peered":"2024-09-11T14:40:28.940950+0000","last_clean":"2024-09-11T14:40:28.940950+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:40:28.940950+0000","last_undegraded":"2024-09-11T14:40:28.940950+0000","last_fullsized":"2024-09-11T14:40:28.940950+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":14464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"44'233","reported_seq":260,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.621605+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:40:27.621605+0000","last_peered":"2024-09-11T14:40:27.621605+0000","last_clean":"2024-09-11T14:40:27.621605+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:40:27.621605+0000","last_undegraded":"2024-09-11T14:40:27.621605+0000","last_fullsized":"2024-09-11T14:40:27.621605+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15269888,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":14912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"44'208","reported_seq":235,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.581544+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:40:27.581544+0000","last_peered":"2024-09-11T14:40:27.581544+0000","last_clean":"2024-09-11T14:40:27.581544+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:40:27.581544+0000","last_undegraded":"2024-09-11T14:40:27.581544+0000","last_fullsized":"2024-09-11T14:40:27.581544+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":208,"num_object_clones":0,"num_object_copies":624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"44'217","reported_seq":244,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.585700+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:40:27.585700+0000","last_peered":"2024-09-11T14:40:27.585700+0000","last_clean":"2024-09-11T14:40:27.585700+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:40:27.585700+0000","last_undegraded":"2024-09-11T14:40:27.585700+0000","last_fullsized":"2024-09-11T14:40:27.585700+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14221312,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":13888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"44'203","reported_seq":230,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.585654+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:40:27.585654+0000","last_peered":"2024-09-11T14:40:27.585654+0000","last_clean":"2024-09-11T14:40:27.585654+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:40:27.585654+0000","last_undegraded":"2024-09-11T14:40:27.585654+0000","last_fullsized":"2024-09-11T14:40:27.585654+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"44'225","reported_seq":252,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.766437+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:40:27.766437+0000","last_peered":"2024-09-11T14:40:27.766437+0000","last_clean":"2024-09-11T14:40:27.766437+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:40:27.766437+0000","last_undegraded":"2024-09-11T14:40:27.766437+0000","last_fullsized":"2024-09-11T14:40:27.766437+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":14400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":175,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T14:40:28.872392+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:40:28.872392+0000","last_peered":"2024-09-11T14:40:28.872392+0000","last_clean":"2024-09-11T14:40:28.872392+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:40:28.872392+0000","last_undegraded":"2024-09-11T14:40:28.872392+0000","last_fullsized":"2024-09-11T14:40:28.872392+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":101,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.586170+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:40:27.586170+0000","last_peered":"2024-09-11T14:40:27.586170+0000","last_clean":"2024-09-11T14:40:27.586170+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:40:27.586170+0000","last_undegraded":"2024-09-11T14:40:27.586170+0000","last_fullsized":"2024-09-11T14:40:27.586170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"44'227","reported_seq":254,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:28.187345+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:40:28.187345+0000","last_peered":"2024-09-11T14:40:28.187345+0000","last_clean":"2024-09-11T14:40:28.187345+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:40:28.187345+0000","last_undegraded":"2024-09-11T14:40:28.187345+0000","last_fullsized":"2024-09-11T14:40:28.187345+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14876672,"num_objects":227,"num_object_clones":0,"num_object_copies":681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":14528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.618634+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:40:27.618634+0000","last_peered":"2024-09-11T14:40:27.618634+0000","last_clean":"2024-09-11T14:40:27.618634+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:40:27.618634+0000","last_undegraded":"2024-09-11T14:40:27.618634+0000","last_fullsized":"2024-09-11T14:40:27.618634+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"43'217","reported_seq":244,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.383957+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:40:27.383957+0000","last_peered":"2024-09-11T14:40:27.383957+0000","last_clean":"2024-09-11T14:40:27.383957+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:40:27.383957+0000","last_undegraded":"2024-09-11T14:40:27.383957+0000","last_fullsized":"2024-09-11T14:40:27.383957+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14221312,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":13888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.574904+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:40:27.574904+0000","last_peered":"2024-09-11T14:40:27.574904+0000","last_clean":"2024-09-11T14:40:27.574904+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:40:27.574904+0000","last_undegraded":"2024-09-11T14:40:27.574904+0000","last_fullsized":"2024-09-11T14:40:27.574904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"44'211","reported_seq":238,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.376247+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:40:27.376247+0000","last_peered":"2024-09-11T14:40:27.376247+0000","last_clean":"2024-09-11T14:40:27.376247+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:40:27.376247+0000","last_undegraded":"2024-09-11T14:40:27.376247+0000","last_fullsized":"2024-09-11T14:40:27.376247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13828096,"num_objects":211,"num_object_clones":0,"num_object_copies":633,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":13504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":102,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.605474+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:40:27.605474+0000","last_peered":"2024-09-11T14:40:27.605474+0000","last_clean":"2024-09-11T14:40:27.605474+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:40:27.605474+0000","last_undegraded":"2024-09-11T14:40:27.605474+0000","last_fullsized":"2024-09-11T14:40:27.605474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"44'205","reported_seq":232,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.585441+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:40:27.585441+0000","last_peered":"2024-09-11T14:40:27.585441+0000","last_clean":"2024-09-11T14:40:27.585441+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:40:27.585441+0000","last_undegraded":"2024-09-11T14:40:27.585441+0000","last_fullsized":"2024-09-11T14:40:27.585441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13434880,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":13120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.384542+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:40:27.384542+0000","last_peered":"2024-09-11T14:40:27.384542+0000","last_clean":"2024-09-11T14:40:27.384542+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:40:27.384542+0000","last_undegraded":"2024-09-11T14:40:27.384542+0000","last_fullsized":"2024-09-11T14:40:27.384542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"44'222","reported_seq":249,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:28.190433+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:40:28.190433+0000","last_peered":"2024-09-11T14:40:28.190433+0000","last_clean":"2024-09-11T14:40:28.190433+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:40:28.190433+0000","last_undegraded":"2024-09-11T14:40:28.190433+0000","last_fullsized":"2024-09-11T14:40:28.190433+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14548992,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":14208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T14:40:28.875340+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:28.875340+0000","last_peered":"2024-09-11T14:40:28.875340+0000","last_clean":"2024-09-11T14:40:28.875340+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:40:28.875340+0000","last_undegraded":"2024-09-11T14:40:28.875340+0000","last_fullsized":"2024-09-11T14:40:28.875340+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"44'225","reported_seq":252,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.614175+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:40:27.614175+0000","last_peered":"2024-09-11T14:40:27.614175+0000","last_clean":"2024-09-11T14:40:27.614175+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:40:27.614175+0000","last_undegraded":"2024-09-11T14:40:27.614175+0000","last_fullsized":"2024-09-11T14:40:27.614175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":14400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.382915+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:27.382915+0000","last_peered":"2024-09-11T14:40:27.382915+0000","last_clean":"2024-09-11T14:40:27.382915+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:40:27.382915+0000","last_undegraded":"2024-09-11T14:40:27.382915+0000","last_fullsized":"2024-09-11T14:40:27.382915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"44'226","reported_seq":253,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.615409+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:40:27.615409+0000","last_peered":"2024-09-11T14:40:27.615409+0000","last_clean":"2024-09-11T14:40:27.615409+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:40:27.615409+0000","last_undegraded":"2024-09-11T14:40:27.615409+0000","last_fullsized":"2024-09-11T14:40:27.615409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":14464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.589389+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:40:27.589389+0000","last_peered":"2024-09-11T14:40:27.589389+0000","last_clean":"2024-09-11T14:40:27.589389+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:40:27.589389+0000","last_undegraded":"2024-09-11T14:40:27.589389+0000","last_fullsized":"2024-09-11T14:40:27.589389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":228524032,"num_objects":3487,"num_object_clones":0,"num_object_copies":10461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3487,"num_write_kb":223168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212819566592,"internally_reserved":0,"allocated":1391927296,"data_stored":1391927296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3487,"ondisk_log_size":3487,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212819697664,"internally_reserved":0,"allocated":1391796224,"data_stored":1391796224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53174640640,"internally_reserved":0,"allocated":378232832,"data_stored":378232832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673224,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":365768,"kb_used_data":365768,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51931960,"statfs":{"total":53552873472,"available":53178327040,"internally_reserved":0,"allocated":374546432,"data_stored":374546432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":279624,"kb_used_data":279624,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52018104,"statfs":{"total":53552873472,"available":53266538496,"internally_reserved":0,"allocated":286334976,"data_stored":286334976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":340912,"kb_used_data":340912,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51956816,"statfs":{"total":53552873472,"available":53203779584,"internally_reserved":0,"allocated":349093888,"data_stored":349093888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":361388,"kb_used_data":361388,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51936340,"statfs":{"total":53552873472,"available":53182812160,"internally_reserved":0,"allocated":370061312,"data_stored":370061312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53174640640,"internally_reserved":0,"allocated":378232832,"data_stored":378232832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53200740352,"internally_reserved":0,"allocated":352133120,"data_stored":352133120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53179637760,"internally_reserved":0,"allocated":373235712,"data_stored":373235712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53264678912,"internally_reserved":0,"allocated":288194560,"data_stored":288194560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53174640640,"internally_reserved":0,"allocated":378232832,"data_stored":378232832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53200740352,"internally_reserved":0,"allocated":352133120,"data_stored":352133120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53179506688,"internally_reserved":0,"allocated":373366784,"data_stored":373366784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53264678912,"internally_reserved":0,"allocated":288194560,"data_stored":288194560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53174640640,"internally_reserved":0,"allocated":378232832,"data_stored":378232832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:40:31.448 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:40:31.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:31.606+0000 7fa98fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:31.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:31.618+0000 7fa98fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:31.872 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:40:31.872 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:40:31.899 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-09-11T14:40:31.275318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":229114419,"num_objects":3491,"num_object_clones":0,"num_object_copies":10473,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3568,"num_write_kb":224276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3542,"ondisk_log_size":3542,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1347692,"kb_used_data":1347692,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207843220,"statfs":{"total":214211493888,"available":212831457280,"internally_reserved":0,"allocated":1380036608,"data_stored":1380036608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16449536,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":16064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000709"},"pg_stats":[{"pgid":"4.f","version":"44'219","reported_seq":246,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.385592+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:40:27.385592+0000","last_peered":"2024-09-11T14:40:27.385592+0000","last_clean":"2024-09-11T14:40:27.385592+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:40:27.385592+0000","last_undegraded":"2024-09-11T14:40:27.385592+0000","last_fullsized":"2024-09-11T14:40:27.385592+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14352384,"num_objects":219,"num_object_clones":0,"num_object_copies":657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":14016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"44'203","reported_seq":230,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.383368+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:40:27.383368+0000","last_peered":"2024-09-11T14:40:27.383368+0000","last_clean":"2024-09-11T14:40:27.383368+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:40:27.383368+0000","last_undegraded":"2024-09-11T14:40:27.383368+0000","last_fullsized":"2024-09-11T14:40:27.383368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"44'220","reported_seq":247,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.591887+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:40:27.591887+0000","last_peered":"2024-09-11T14:40:27.591887+0000","last_clean":"2024-09-11T14:40:27.591887+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:40:27.591887+0000","last_undegraded":"2024-09-11T14:40:27.591887+0000","last_fullsized":"2024-09-11T14:40:27.591887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14417920,"num_objects":220,"num_object_clones":0,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":14080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"45'226","reported_seq":256,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T14:40:28.940950+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:40:28.940950+0000","last_peered":"2024-09-11T14:40:28.940950+0000","last_clean":"2024-09-11T14:40:28.940950+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:40:28.940950+0000","last_undegraded":"2024-09-11T14:40:28.940950+0000","last_fullsized":"2024-09-11T14:40:28.940950+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":14464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"44'233","reported_seq":260,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.621605+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:40:27.621605+0000","last_peered":"2024-09-11T14:40:27.621605+0000","last_clean":"2024-09-11T14:40:27.621605+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:40:27.621605+0000","last_undegraded":"2024-09-11T14:40:27.621605+0000","last_fullsized":"2024-09-11T14:40:27.621605+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15269888,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":14912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"44'208","reported_seq":235,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.581544+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:40:27.581544+0000","last_peered":"2024-09-11T14:40:27.581544+0000","last_clean":"2024-09-11T14:40:27.581544+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:40:27.581544+0000","last_undegraded":"2024-09-11T14:40:27.581544+0000","last_fullsized":"2024-09-11T14:40:27.581544+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":208,"num_object_clones":0,"num_object_copies":624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"44'217","reported_seq":244,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.585700+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:40:27.585700+0000","last_peered":"2024-09-11T14:40:27.585700+0000","last_clean":"2024-09-11T14:40:27.585700+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:40:27.585700+0000","last_undegraded":"2024-09-11T14:40:27.585700+0000","last_fullsized":"2024-09-11T14:40:27.585700+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14221312,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":13888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"44'203","reported_seq":230,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.585654+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:40:27.585654+0000","last_peered":"2024-09-11T14:40:27.585654+0000","last_clean":"2024-09-11T14:40:27.585654+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:40:27.585654+0000","last_undegraded":"2024-09-11T14:40:27.585654+0000","last_fullsized":"2024-09-11T14:40:27.585654+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"44'225","reported_seq":252,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.766437+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:40:27.766437+0000","last_peered":"2024-09-11T14:40:27.766437+0000","last_clean":"2024-09-11T14:40:27.766437+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:40:27.766437+0000","last_undegraded":"2024-09-11T14:40:27.766437+0000","last_fullsized":"2024-09-11T14:40:27.766437+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":14400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":175,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T14:40:28.872392+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:40:28.872392+0000","last_peered":"2024-09-11T14:40:28.872392+0000","last_clean":"2024-09-11T14:40:28.872392+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:40:28.872392+0000","last_undegraded":"2024-09-11T14:40:28.872392+0000","last_fullsized":"2024-09-11T14:40:28.872392+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":101,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.586170+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:40:27.586170+0000","last_peered":"2024-09-11T14:40:27.586170+0000","last_clean":"2024-09-11T14:40:27.586170+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:40:27.586170+0000","last_undegraded":"2024-09-11T14:40:27.586170+0000","last_fullsized":"2024-09-11T14:40:27.586170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"44'227","reported_seq":254,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:28.187345+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:40:28.187345+0000","last_peered":"2024-09-11T14:40:28.187345+0000","last_clean":"2024-09-11T14:40:28.187345+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:40:28.187345+0000","last_undegraded":"2024-09-11T14:40:28.187345+0000","last_fullsized":"2024-09-11T14:40:28.187345+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14876672,"num_objects":227,"num_object_clones":0,"num_object_copies":681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":14528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.618634+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:40:27.618634+0000","last_peered":"2024-09-11T14:40:27.618634+0000","last_clean":"2024-09-11T14:40:27.618634+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:40:27.618634+0000","last_undegraded":"2024-09-11T14:40:27.618634+0000","last_fullsized":"2024-09-11T14:40:27.618634+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"43'217","reported_seq":244,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.383957+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:40:27.383957+0000","last_peered":"2024-09-11T14:40:27.383957+0000","last_clean":"2024-09-11T14:40:27.383957+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:40:27.383957+0000","last_undegraded":"2024-09-11T14:40:27.383957+0000","last_fullsized":"2024-09-11T14:40:27.383957+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14221312,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":13888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.574904+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:40:27.574904+0000","last_peered":"2024-09-11T14:40:27.574904+0000","last_clean":"2024-09-11T14:40:27.574904+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:40:27.574904+0000","last_undegraded":"2024-09-11T14:40:27.574904+0000","last_fullsized":"2024-09-11T14:40:27.574904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"44'211","reported_seq":238,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.376247+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:40:27.376247+0000","last_peered":"2024-09-11T14:40:27.376247+0000","last_clean":"2024-09-11T14:40:27.376247+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:40:27.376247+0000","last_undegraded":"2024-09-11T14:40:27.376247+0000","last_fullsized":"2024-09-11T14:40:27.376247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13828096,"num_objects":211,"num_object_clones":0,"num_object_copies":633,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":13504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":102,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.605474+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:40:27.605474+0000","last_peered":"2024-09-11T14:40:27.605474+0000","last_clean":"2024-09-11T14:40:27.605474+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:40:27.605474+0000","last_undegraded":"2024-09-11T14:40:27.605474+0000","last_fullsized":"2024-09-11T14:40:27.605474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"44'205","reported_seq":232,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.585441+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:40:27.585441+0000","last_peered":"2024-09-11T14:40:27.585441+0000","last_clean":"2024-09-11T14:40:27.585441+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:40:27.585441+0000","last_undegraded":"2024-09-11T14:40:27.585441+0000","last_fullsized":"2024-09-11T14:40:27.585441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13434880,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":13120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.384542+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:40:27.384542+0000","last_peered":"2024-09-11T14:40:27.384542+0000","last_clean":"2024-09-11T14:40:27.384542+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:40:27.384542+0000","last_undegraded":"2024-09-11T14:40:27.384542+0000","last_fullsized":"2024-09-11T14:40:27.384542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"44'222","reported_seq":249,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:28.190433+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:40:28.190433+0000","last_peered":"2024-09-11T14:40:28.190433+0000","last_clean":"2024-09-11T14:40:28.190433+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:40:28.190433+0000","last_undegraded":"2024-09-11T14:40:28.190433+0000","last_fullsized":"2024-09-11T14:40:28.190433+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14548992,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":14208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T14:40:28.875340+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:28.875340+0000","last_peered":"2024-09-11T14:40:28.875340+0000","last_clean":"2024-09-11T14:40:28.875340+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:40:28.875340+0000","last_undegraded":"2024-09-11T14:40:28.875340+0000","last_fullsized":"2024-09-11T14:40:28.875340+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"44'225","reported_seq":252,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.614175+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:40:27.614175+0000","last_peered":"2024-09-11T14:40:27.614175+0000","last_clean":"2024-09-11T14:40:27.614175+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:40:27.614175+0000","last_undegraded":"2024-09-11T14:40:27.614175+0000","last_fullsized":"2024-09-11T14:40:27.614175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":14400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.382915+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:27.382915+0000","last_peered":"2024-09-11T14:40:27.382915+0000","last_clean":"2024-09-11T14:40:27.382915+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:40:27.382915+0000","last_undegraded":"2024-09-11T14:40:27.382915+0000","last_fullsized":"2024-09-11T14:40:27.382915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"44'226","reported_seq":253,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.615409+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:40:27.615409+0000","last_peered":"2024-09-11T14:40:27.615409+0000","last_clean":"2024-09-11T14:40:27.615409+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:40:27.615409+0000","last_undegraded":"2024-09-11T14:40:27.615409+0000","last_fullsized":"2024-09-11T14:40:27.615409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":14464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.589389+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:40:27.589389+0000","last_peered":"2024-09-11T14:40:27.589389+0000","last_clean":"2024-09-11T14:40:27.589389+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:40:27.589389+0000","last_undegraded":"2024-09-11T14:40:27.589389+0000","last_fullsized":"2024-09-11T14:40:27.589389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":228524032,"num_objects":3487,"num_object_clones":0,"num_object_copies":10461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3487,"num_write_kb":223168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212819566592,"internally_reserved":0,"allocated":1391927296,"data_stored":1391927296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3487,"ondisk_log_size":3487,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212819697664,"internally_reserved":0,"allocated":1391796224,"data_stored":1391796224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53174640640,"internally_reserved":0,"allocated":378232832,"data_stored":378232832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673224,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":365768,"kb_used_data":365768,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51931960,"statfs":{"total":53552873472,"available":53178327040,"internally_reserved":0,"allocated":374546432,"data_stored":374546432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":279624,"kb_used_data":279624,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52018104,"statfs":{"total":53552873472,"available":53266538496,"internally_reserved":0,"allocated":286334976,"data_stored":286334976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":340912,"kb_used_data":340912,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51956816,"statfs":{"total":53552873472,"available":53203779584,"internally_reserved":0,"allocated":349093888,"data_stored":349093888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":361388,"kb_used_data":361388,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51936340,"statfs":{"total":53552873472,"available":53182812160,"internally_reserved":0,"allocated":370061312,"data_stored":370061312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53174640640,"internally_reserved":0,"allocated":378232832,"data_stored":378232832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53200740352,"internally_reserved":0,"allocated":352133120,"data_stored":352133120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53179637760,"internally_reserved":0,"allocated":373235712,"data_stored":373235712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53264678912,"internally_reserved":0,"allocated":288194560,"data_stored":288194560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53174640640,"internally_reserved":0,"allocated":378232832,"data_stored":378232832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53200740352,"internally_reserved":0,"allocated":352133120,"data_stored":352133120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53179506688,"internally_reserved":0,"allocated":373366784,"data_stored":373366784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53264678912,"internally_reserved":0,"allocated":288194560,"data_stored":288194560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53174640640,"internally_reserved":0,"allocated":378232832,"data_stored":378232832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:40:31.900 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T14:40:31.900 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:40:31.900 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:40:32.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:32.054+0000 7f3c95aec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:32.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:32.065+0000 7f3c95aec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:32.132 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:40:32.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:32.319+0000 7fca74351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:32.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:32.332+0000 7fca74351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:32.350 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:40:32.350 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:40:32.376 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-09-11T14:40:31.275318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":229114419,"num_objects":3491,"num_object_clones":0,"num_object_copies":10473,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3568,"num_write_kb":224276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3542,"ondisk_log_size":3542,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1347692,"kb_used_data":1347692,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207843220,"statfs":{"total":214211493888,"available":212831457280,"internally_reserved":0,"allocated":1380036608,"data_stored":1380036608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16449536,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":16064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000709"},"pg_stats":[{"pgid":"4.f","version":"44'219","reported_seq":246,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.385592+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:40:27.385592+0000","last_peered":"2024-09-11T14:40:27.385592+0000","last_clean":"2024-09-11T14:40:27.385592+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:40:27.385592+0000","last_undegraded":"2024-09-11T14:40:27.385592+0000","last_fullsized":"2024-09-11T14:40:27.385592+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14352384,"num_objects":219,"num_object_clones":0,"num_object_copies":657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":14016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"44'203","reported_seq":230,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.383368+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:40:27.383368+0000","last_peered":"2024-09-11T14:40:27.383368+0000","last_clean":"2024-09-11T14:40:27.383368+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:40:27.383368+0000","last_undegraded":"2024-09-11T14:40:27.383368+0000","last_fullsized":"2024-09-11T14:40:27.383368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"44'220","reported_seq":247,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.591887+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:40:27.591887+0000","last_peered":"2024-09-11T14:40:27.591887+0000","last_clean":"2024-09-11T14:40:27.591887+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:40:27.591887+0000","last_undegraded":"2024-09-11T14:40:27.591887+0000","last_fullsized":"2024-09-11T14:40:27.591887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14417920,"num_objects":220,"num_object_clones":0,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":14080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"45'226","reported_seq":256,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T14:40:28.940950+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:40:28.940950+0000","last_peered":"2024-09-11T14:40:28.940950+0000","last_clean":"2024-09-11T14:40:28.940950+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:40:28.940950+0000","last_undegraded":"2024-09-11T14:40:28.940950+0000","last_fullsized":"2024-09-11T14:40:28.940950+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":14464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"44'233","reported_seq":260,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.621605+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:40:27.621605+0000","last_peered":"2024-09-11T14:40:27.621605+0000","last_clean":"2024-09-11T14:40:27.621605+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:40:27.621605+0000","last_undegraded":"2024-09-11T14:40:27.621605+0000","last_fullsized":"2024-09-11T14:40:27.621605+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15269888,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":14912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"44'208","reported_seq":235,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.581544+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:40:27.581544+0000","last_peered":"2024-09-11T14:40:27.581544+0000","last_clean":"2024-09-11T14:40:27.581544+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:40:27.581544+0000","last_undegraded":"2024-09-11T14:40:27.581544+0000","last_fullsized":"2024-09-11T14:40:27.581544+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":208,"num_object_clones":0,"num_object_copies":624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"44'217","reported_seq":244,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.585700+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:40:27.585700+0000","last_peered":"2024-09-11T14:40:27.585700+0000","last_clean":"2024-09-11T14:40:27.585700+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:40:27.585700+0000","last_undegraded":"2024-09-11T14:40:27.585700+0000","last_fullsized":"2024-09-11T14:40:27.585700+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14221312,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":13888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"44'203","reported_seq":230,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.585654+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:40:27.585654+0000","last_peered":"2024-09-11T14:40:27.585654+0000","last_clean":"2024-09-11T14:40:27.585654+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:40:27.585654+0000","last_undegraded":"2024-09-11T14:40:27.585654+0000","last_fullsized":"2024-09-11T14:40:27.585654+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"44'225","reported_seq":252,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.766437+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:40:27.766437+0000","last_peered":"2024-09-11T14:40:27.766437+0000","last_clean":"2024-09-11T14:40:27.766437+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:40:27.766437+0000","last_undegraded":"2024-09-11T14:40:27.766437+0000","last_fullsized":"2024-09-11T14:40:27.766437+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":14400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":175,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T14:40:28.872392+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:40:28.872392+0000","last_peered":"2024-09-11T14:40:28.872392+0000","last_clean":"2024-09-11T14:40:28.872392+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:40:28.872392+0000","last_undegraded":"2024-09-11T14:40:28.872392+0000","last_fullsized":"2024-09-11T14:40:28.872392+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":101,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.586170+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:40:27.586170+0000","last_peered":"2024-09-11T14:40:27.586170+0000","last_clean":"2024-09-11T14:40:27.586170+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:40:27.586170+0000","last_undegraded":"2024-09-11T14:40:27.586170+0000","last_fullsized":"2024-09-11T14:40:27.586170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"44'227","reported_seq":254,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:28.187345+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:40:28.187345+0000","last_peered":"2024-09-11T14:40:28.187345+0000","last_clean":"2024-09-11T14:40:28.187345+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:40:28.187345+0000","last_undegraded":"2024-09-11T14:40:28.187345+0000","last_fullsized":"2024-09-11T14:40:28.187345+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14876672,"num_objects":227,"num_object_clones":0,"num_object_copies":681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":14528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.618634+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:40:27.618634+0000","last_peered":"2024-09-11T14:40:27.618634+0000","last_clean":"2024-09-11T14:40:27.618634+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:40:27.618634+0000","last_undegraded":"2024-09-11T14:40:27.618634+0000","last_fullsized":"2024-09-11T14:40:27.618634+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"43'217","reported_seq":244,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.383957+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:40:27.383957+0000","last_peered":"2024-09-11T14:40:27.383957+0000","last_clean":"2024-09-11T14:40:27.383957+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:40:27.383957+0000","last_undegraded":"2024-09-11T14:40:27.383957+0000","last_fullsized":"2024-09-11T14:40:27.383957+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14221312,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":13888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.574904+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:40:27.574904+0000","last_peered":"2024-09-11T14:40:27.574904+0000","last_clean":"2024-09-11T14:40:27.574904+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:40:27.574904+0000","last_undegraded":"2024-09-11T14:40:27.574904+0000","last_fullsized":"2024-09-11T14:40:27.574904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"44'211","reported_seq":238,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.376247+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:40:27.376247+0000","last_peered":"2024-09-11T14:40:27.376247+0000","last_clean":"2024-09-11T14:40:27.376247+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:40:27.376247+0000","last_undegraded":"2024-09-11T14:40:27.376247+0000","last_fullsized":"2024-09-11T14:40:27.376247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13828096,"num_objects":211,"num_object_clones":0,"num_object_copies":633,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":13504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":102,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.605474+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:40:27.605474+0000","last_peered":"2024-09-11T14:40:27.605474+0000","last_clean":"2024-09-11T14:40:27.605474+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:40:27.605474+0000","last_undegraded":"2024-09-11T14:40:27.605474+0000","last_fullsized":"2024-09-11T14:40:27.605474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"44'205","reported_seq":232,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.585441+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:40:27.585441+0000","last_peered":"2024-09-11T14:40:27.585441+0000","last_clean":"2024-09-11T14:40:27.585441+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:40:27.585441+0000","last_undegraded":"2024-09-11T14:40:27.585441+0000","last_fullsized":"2024-09-11T14:40:27.585441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13434880,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":13120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.384542+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:40:27.384542+0000","last_peered":"2024-09-11T14:40:27.384542+0000","last_clean":"2024-09-11T14:40:27.384542+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:40:27.384542+0000","last_undegraded":"2024-09-11T14:40:27.384542+0000","last_fullsized":"2024-09-11T14:40:27.384542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"44'222","reported_seq":249,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:28.190433+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:40:28.190433+0000","last_peered":"2024-09-11T14:40:28.190433+0000","last_clean":"2024-09-11T14:40:28.190433+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:40:28.190433+0000","last_undegraded":"2024-09-11T14:40:28.190433+0000","last_fullsized":"2024-09-11T14:40:28.190433+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14548992,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":14208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T14:40:28.875340+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:28.875340+0000","last_peered":"2024-09-11T14:40:28.875340+0000","last_clean":"2024-09-11T14:40:28.875340+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:40:28.875340+0000","last_undegraded":"2024-09-11T14:40:28.875340+0000","last_fullsized":"2024-09-11T14:40:28.875340+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"44'225","reported_seq":252,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.614175+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:40:27.614175+0000","last_peered":"2024-09-11T14:40:27.614175+0000","last_clean":"2024-09-11T14:40:27.614175+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:40:27.614175+0000","last_undegraded":"2024-09-11T14:40:27.614175+0000","last_fullsized":"2024-09-11T14:40:27.614175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":14400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.382915+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:27.382915+0000","last_peered":"2024-09-11T14:40:27.382915+0000","last_clean":"2024-09-11T14:40:27.382915+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:40:27.382915+0000","last_undegraded":"2024-09-11T14:40:27.382915+0000","last_fullsized":"2024-09-11T14:40:27.382915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"44'226","reported_seq":253,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.615409+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:40:27.615409+0000","last_peered":"2024-09-11T14:40:27.615409+0000","last_clean":"2024-09-11T14:40:27.615409+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:40:27.615409+0000","last_undegraded":"2024-09-11T14:40:27.615409+0000","last_fullsized":"2024-09-11T14:40:27.615409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":14464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-11T14:40:27.589389+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:40:27.589389+0000","last_peered":"2024-09-11T14:40:27.589389+0000","last_clean":"2024-09-11T14:40:27.589389+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:40:27.589389+0000","last_undegraded":"2024-09-11T14:40:27.589389+0000","last_fullsized":"2024-09-11T14:40:27.589389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":228524032,"num_objects":3487,"num_object_clones":0,"num_object_copies":10461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3487,"num_write_kb":223168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212819566592,"internally_reserved":0,"allocated":1391927296,"data_stored":1391927296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3487,"ondisk_log_size":3487,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212819697664,"internally_reserved":0,"allocated":1391796224,"data_stored":1391796224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53174640640,"internally_reserved":0,"allocated":378232832,"data_stored":378232832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673224,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":365768,"kb_used_data":365768,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51931960,"statfs":{"total":53552873472,"available":53178327040,"internally_reserved":0,"allocated":374546432,"data_stored":374546432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":279624,"kb_used_data":279624,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52018104,"statfs":{"total":53552873472,"available":53266538496,"internally_reserved":0,"allocated":286334976,"data_stored":286334976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":340912,"kb_used_data":340912,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51956816,"statfs":{"total":53552873472,"available":53203779584,"internally_reserved":0,"allocated":349093888,"data_stored":349093888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":361388,"kb_used_data":361388,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51936340,"statfs":{"total":53552873472,"available":53182812160,"internally_reserved":0,"allocated":370061312,"data_stored":370061312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53174640640,"internally_reserved":0,"allocated":378232832,"data_stored":378232832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53200740352,"internally_reserved":0,"allocated":352133120,"data_stored":352133120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53179637760,"internally_reserved":0,"allocated":373235712,"data_stored":373235712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53264678912,"internally_reserved":0,"allocated":288194560,"data_stored":288194560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53174640640,"internally_reserved":0,"allocated":378232832,"data_stored":378232832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53200740352,"internally_reserved":0,"allocated":352133120,"data_stored":352133120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53179506688,"internally_reserved":0,"allocated":373366784,"data_stored":373366784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53264678912,"internally_reserved":0,"allocated":288194560,"data_stored":288194560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53174640640,"internally_reserved":0,"allocated":378232832,"data_stored":378232832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:40:32.433 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 54 16 3718 3702 4.2843 3.8125 0.395393 0.232832 2024-09-11T14:40:33.433 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 55 16 3790 3774 4.28822 4.5 0.167012 0.232471 2024-09-11T14:40:34.433 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 56 16 3871 3855 4.30204 5.0625 0.163706 0.232062 2024-09-11T14:40:35.044 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:40:35.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:35.210+0000 7f00d2d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:35.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:35.220+0000 7f00d2d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:35.433 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 57 16 3941 3925 4.30331 4.375 0.124279 0.231885 2024-09-11T14:40:36.433 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 58 16 4024 4008 4.31855 5.1875 0.469274 0.231144 2024-09-11T14:40:37.378 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:40:37.378 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:40:37.378 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:40:37.433 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 59 16 4107 4091 4.33327 5.1875 0.252175 0.230135 2024-09-11T14:40:37.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:37.516+0000 7f2c95591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:37.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:37.529+0000 7f2c95591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:37.884 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:40:37.885 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:40:37.906 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-11T14:40:37.276704+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":248840755,"num_objects":3792,"num_object_clones":0,"num_object_copies":11376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3869,"num_write_kb":243540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3843,"ondisk_log_size":3843,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1457504,"kb_used_data":1457504,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207733408,"statfs":{"total":214211493888,"available":212719009792,"internally_reserved":0,"allocated":1492484096,"data_stored":1492484096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21299200,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":325,"num_write_kb":20800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001723"},"pg_stats":[{"pgid":"4.f","version":"47'240","reported_seq":276,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:32.949461+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:40:32.949461+0000","last_peered":"2024-09-11T14:40:32.949461+0000","last_clean":"2024-09-11T14:40:32.949461+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:40:32.949461+0000","last_undegraded":"2024-09-11T14:40:32.949461+0000","last_fullsized":"2024-09-11T14:40:32.949461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"47'219","reported_seq":255,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:32.846970+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:40:32.846970+0000","last_peered":"2024-09-11T14:40:32.846970+0000","last_clean":"2024-09-11T14:40:32.846970+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:40:32.846970+0000","last_undegraded":"2024-09-11T14:40:32.846970+0000","last_fullsized":"2024-09-11T14:40:32.846970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14352384,"num_objects":219,"num_object_clones":0,"num_object_copies":657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":14016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"47'235","reported_seq":271,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:32.969333+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:40:32.969333+0000","last_peered":"2024-09-11T14:40:32.969333+0000","last_clean":"2024-09-11T14:40:32.969333+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:40:32.969333+0000","last_undegraded":"2024-09-11T14:40:32.969333+0000","last_fullsized":"2024-09-11T14:40:32.969333+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":15040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"47'245","reported_seq":281,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:34.190602+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:40:34.190602+0000","last_peered":"2024-09-11T14:40:34.190602+0000","last_clean":"2024-09-11T14:40:34.190602+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:40:34.190602+0000","last_undegraded":"2024-09-11T14:40:34.190602+0000","last_fullsized":"2024-09-11T14:40:34.190602+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056320,"num_objects":245,"num_object_clones":0,"num_object_copies":735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":245,"num_write_kb":15680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"47'251","reported_seq":287,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:33.128200+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:40:33.128200+0000","last_peered":"2024-09-11T14:40:33.128200+0000","last_clean":"2024-09-11T14:40:33.128200+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:40:33.128200+0000","last_undegraded":"2024-09-11T14:40:33.128200+0000","last_fullsized":"2024-09-11T14:40:33.128200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16449536,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":16064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"47'231","reported_seq":267,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:33.195244+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:40:33.195244+0000","last_peered":"2024-09-11T14:40:33.195244+0000","last_clean":"2024-09-11T14:40:33.195244+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:40:33.195244+0000","last_undegraded":"2024-09-11T14:40:33.195244+0000","last_fullsized":"2024-09-11T14:40:33.195244+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15138816,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":14784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"47'231","reported_seq":267,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:32.331687+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:40:32.331687+0000","last_peered":"2024-09-11T14:40:32.331687+0000","last_clean":"2024-09-11T14:40:32.331687+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:40:32.331687+0000","last_undegraded":"2024-09-11T14:40:32.331687+0000","last_fullsized":"2024-09-11T14:40:32.331687+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15138816,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":14784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"47'222","reported_seq":258,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:32.753684+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:40:32.753684+0000","last_peered":"2024-09-11T14:40:32.753684+0000","last_clean":"2024-09-11T14:40:32.753684+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:40:32.753684+0000","last_undegraded":"2024-09-11T14:40:32.753684+0000","last_fullsized":"2024-09-11T14:40:32.753684+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14548992,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":14208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"47'247","reported_seq":283,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:32.893976+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:40:32.893976+0000","last_peered":"2024-09-11T14:40:32.893976+0000","last_clean":"2024-09-11T14:40:32.893976+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:40:32.893976+0000","last_undegraded":"2024-09-11T14:40:32.893976+0000","last_fullsized":"2024-09-11T14:40:32.893976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16187392,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":15808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":181,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.902063+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:40:30.902063+0000","last_peered":"2024-09-11T14:40:30.902063+0000","last_clean":"2024-09-11T14:40:30.902063+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:40:30.902063+0000","last_undegraded":"2024-09-11T14:40:30.902063+0000","last_fullsized":"2024-09-11T14:40:30.902063+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":110,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.228134+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:40:31.228134+0000","last_peered":"2024-09-11T14:40:31.228134+0000","last_clean":"2024-09-11T14:40:31.228134+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:40:31.228134+0000","last_undegraded":"2024-09-11T14:40:31.228134+0000","last_fullsized":"2024-09-11T14:40:31.228134+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"47'251","reported_seq":287,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:33.034820+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:40:33.034820+0000","last_peered":"2024-09-11T14:40:33.034820+0000","last_clean":"2024-09-11T14:40:33.034820+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:40:33.034820+0000","last_undegraded":"2024-09-11T14:40:33.034820+0000","last_fullsized":"2024-09-11T14:40:33.034820+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16449536,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":16064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.124463+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:40:31.124463+0000","last_peered":"2024-09-11T14:40:31.124463+0000","last_clean":"2024-09-11T14:40:31.124463+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:40:31.124463+0000","last_undegraded":"2024-09-11T14:40:31.124463+0000","last_fullsized":"2024-09-11T14:40:31.124463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"47'237","reported_seq":273,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:32.875312+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:40:32.875312+0000","last_peered":"2024-09-11T14:40:32.875312+0000","last_clean":"2024-09-11T14:40:32.875312+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:40:32.875312+0000","last_undegraded":"2024-09-11T14:40:32.875312+0000","last_fullsized":"2024-09-11T14:40:32.875312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15532032,"num_objects":237,"num_object_clones":0,"num_object_copies":711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":15168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.217608+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:40:31.217608+0000","last_peered":"2024-09-11T14:40:31.217608+0000","last_clean":"2024-09-11T14:40:31.217608+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:40:31.217608+0000","last_undegraded":"2024-09-11T14:40:31.217608+0000","last_fullsized":"2024-09-11T14:40:31.217608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"47'231","reported_seq":267,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:32.607227+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:40:32.607227+0000","last_peered":"2024-09-11T14:40:32.607227+0000","last_clean":"2024-09-11T14:40:32.607227+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:40:32.607227+0000","last_undegraded":"2024-09-11T14:40:32.607227+0000","last_fullsized":"2024-09-11T14:40:32.607227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15138816,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":14784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":111,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.113990+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:40:31.113990+0000","last_peered":"2024-09-11T14:40:31.113990+0000","last_clean":"2024-09-11T14:40:31.113990+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:40:31.113990+0000","last_undegraded":"2024-09-11T14:40:31.113990+0000","last_fullsized":"2024-09-11T14:40:31.113990+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"47'221","reported_seq":257,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:32.888087+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:40:32.888087+0000","last_peered":"2024-09-11T14:40:32.888087+0000","last_clean":"2024-09-11T14:40:32.888087+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:40:32.888087+0000","last_undegraded":"2024-09-11T14:40:32.888087+0000","last_fullsized":"2024-09-11T14:40:32.888087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14483456,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":14144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.890413+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:40:30.890413+0000","last_peered":"2024-09-11T14:40:30.890413+0000","last_clean":"2024-09-11T14:40:30.890413+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:40:30.890413+0000","last_undegraded":"2024-09-11T14:40:30.890413+0000","last_fullsized":"2024-09-11T14:40:30.890413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"47'242","reported_seq":278,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:33.234435+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:40:33.234435+0000","last_peered":"2024-09-11T14:40:33.234435+0000","last_clean":"2024-09-11T14:40:33.234435+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:40:33.234435+0000","last_undegraded":"2024-09-11T14:40:33.234435+0000","last_fullsized":"2024-09-11T14:40:33.234435+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859712,"num_objects":242,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":15488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.909268+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:30.909268+0000","last_peered":"2024-09-11T14:40:30.909268+0000","last_clean":"2024-09-11T14:40:30.909268+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:40:30.909268+0000","last_undegraded":"2024-09-11T14:40:30.909268+0000","last_fullsized":"2024-09-11T14:40:30.909268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"47'242","reported_seq":278,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:33.130599+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:40:33.130599+0000","last_peered":"2024-09-11T14:40:33.130599+0000","last_clean":"2024-09-11T14:40:33.130599+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:40:33.130599+0000","last_undegraded":"2024-09-11T14:40:33.130599+0000","last_fullsized":"2024-09-11T14:40:33.130599+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859712,"num_objects":242,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":15488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.878614+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:30.878614+0000","last_peered":"2024-09-11T14:40:30.878614+0000","last_clean":"2024-09-11T14:40:30.878614+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:40:30.878614+0000","last_undegraded":"2024-09-11T14:40:30.878614+0000","last_fullsized":"2024-09-11T14:40:30.878614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"47'243","reported_seq":279,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:33.304474+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:40:33.304474+0000","last_peered":"2024-09-11T14:40:33.304474+0000","last_clean":"2024-09-11T14:40:33.304474+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:40:33.304474+0000","last_undegraded":"2024-09-11T14:40:33.304474+0000","last_fullsized":"2024-09-11T14:40:33.304474+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925248,"num_objects":243,"num_object_clones":0,"num_object_copies":729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":15552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.239377+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:40:31.239377+0000","last_peered":"2024-09-11T14:40:31.239377+0000","last_clean":"2024-09-11T14:40:31.239377+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:40:31.239377+0000","last_undegraded":"2024-09-11T14:40:31.239377+0000","last_fullsized":"2024-09-11T14:40:31.239377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":248250368,"num_objects":3788,"num_object_clones":0,"num_object_copies":11364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3788,"num_write_kb":242432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212697063424,"internally_reserved":0,"allocated":1514430464,"data_stored":1514430464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3788,"ondisk_log_size":3788,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212697194496,"internally_reserved":0,"allocated":1514299392,"data_stored":1514299392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53138743296,"internally_reserved":0,"allocated":414130176,"data_stored":414130176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":397556,"kb_used_data":397556,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51900172,"statfs":{"total":53552873472,"available":53145776128,"internally_reserved":0,"allocated":407097344,"data_stored":407097344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":301944,"kb_used_data":301944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51995784,"statfs":{"total":53552873472,"available":53243682816,"internally_reserved":0,"allocated":309190656,"data_stored":309190656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":369428,"kb_used_data":369428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51928300,"statfs":{"total":53552873472,"available":53174579200,"internally_reserved":0,"allocated":378294272,"data_stored":378294272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":388576,"kb_used_data":388576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51909152,"statfs":{"total":53552873472,"available":53154971648,"internally_reserved":0,"allocated":397901824,"data_stored":397901824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53138743296,"internally_reserved":0,"allocated":414130176,"data_stored":414130176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53170425856,"internally_reserved":0,"allocated":382447616,"data_stored":382447616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53148819456,"internally_reserved":0,"allocated":404054016,"data_stored":404054016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53239205888,"internally_reserved":0,"allocated":313667584,"data_stored":313667584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53138743296,"internally_reserved":0,"allocated":414130176,"data_stored":414130176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53170294784,"internally_reserved":0,"allocated":382578688,"data_stored":382578688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53148819456,"internally_reserved":0,"allocated":404054016,"data_stored":404054016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53239205888,"internally_reserved":0,"allocated":313667584,"data_stored":313667584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53138743296,"internally_reserved":0,"allocated":414130176,"data_stored":414130176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:40:38.064 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:40:38.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:38.218+0000 7fccc4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:38.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:38.225+0000 7fccc4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:38.433 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:40:38.433082+0000 min lat: 0.0281091 max lat: 2.13574 avg lat: 0.229899 2024-09-11T14:40:38.433 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:40:38.433 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 60 16 4180 4164 4.33708 4.5625 0.0859943 0.229899 2024-09-11T14:40:39.433 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 61 16 4251 4235 4.33872 4.4375 0.0807202 0.229739 2024-09-11T14:40:40.433 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 62 16 4326 4310 4.34434 4.6875 0.232689 0.229447 2024-09-11T14:40:40.929 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:40:41.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:41.073+0000 7fd47f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:41.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:41.083+0000 7fd47f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:41.433 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 63 16 4390 4374 4.33886 4 0.409858 0.229803 2024-09-11T14:40:42.433 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 64 16 4460 4444 4.33942 4.375 0.27528 0.229845 2024-09-11T14:40:42.908 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:40:42.909 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:40:42.909 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:40:42.909 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:40:43.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:43.061+0000 7f75faf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:43.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:43.074+0000 7f75faf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:43.205 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:40:43.205 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:40:43.205 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:40:43.206 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:40:43.206 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:40:43.206 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:40:43.206 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:40:43.206 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:40:43.206 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:40:43.206 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:40:43.206 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:40:43.206 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:40:43.210 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:40:43.210 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:40:43.210 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:40:43.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:43.376+0000 7ff00c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:43.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:43.387+0000 7ff00c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:43.434 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 65 16 4532 4516 4.34189 4.5 0.35295 0.229716 2024-09-11T14:40:43.530 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:40:43.531 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:40:43.531 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:40:43.531 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:40:43.531 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:40:43.531 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:40:43.531 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:40:43.531 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:40:43.531 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:40:43.531 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:40:43.531 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:40:43.531 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:40:43.535 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:40:43.535 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:40:43.535 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:40:43.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:43.698+0000 7fd245311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:43.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:43.715+0000 7fd245311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:43.815 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:40:43.909 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:40:43.909 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:40:43.909 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:40:43.909 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:40:43.909 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:40:43.909 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:40:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:40:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:40:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:40:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:40:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:40:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:40:43.913 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:40:43.913 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:40:43.913 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:40:43.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:43.942+0000 7f48c24fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:43.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:43.951+0000 7f48c24fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:44.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:44.060+0000 7f299f85c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:44.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:44.077+0000 7f299f85c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:44.256 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:40:44.256 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:40:44.256 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:40:44.256 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:40:44.256 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:40:44.256 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:40:44.256 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:40:44.256 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:40:44.256 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:40:44.256 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:40:44.257 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:40:44.257 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:40:44.260 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:40:44.261 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:40:44.434 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 66 16 4608 4592 4.34806 4.75 0.273538 0.229495 2024-09-11T14:40:45.434 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 67 16 4688 4672 4.35779 5 0.18742 0.229045 2024-09-11T14:40:46.434 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 68 16 4765 4749 4.36447 4.8125 0.256801 0.228645 2024-09-11T14:40:46.596 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:40:46.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:46.748+0000 7fba2f25c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:46.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:46.757+0000 7fba2f25c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:47.434 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 69 16 4835 4819 4.36461 4.375 0.105836 0.228503 2024-09-11T14:40:48.434 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 70 16 4914 4898 4.37279 4.9375 0.255794 0.228216 2024-09-11T14:40:49.261 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:40:49.261 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:40:49.261 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:40:49.262 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:40:49.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:49.425+0000 7fb227f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:49.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:49.429+0000 7f8568e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:49.434 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 71 16 4971 4955 4.36137 3.5625 0.112694 0.228402 2024-09-11T14:40:49.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:49.434+0000 7fb226caf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:49.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:49.437+0000 7f8568e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:49.767 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:40:49.767 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:40:49.783 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-09-11T14:40:49.279234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":321192499,"num_objects":4896,"num_object_clones":0,"num_object_copies":14688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4973,"num_write_kb":314196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4947,"ondisk_log_size":4947,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1854288,"kb_used_data":1854288,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207336624,"statfs":{"total":214211493888,"available":212312702976,"internally_reserved":0,"allocated":1898790912,"data_stored":1898790912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":72351744,"num_objects":1104,"num_object_clones":0,"num_object_copies":3312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1104,"num_write_kb":70656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002529"},"pg_stats":[{"pgid":"4.f","version":"47'313","reported_seq":349,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.091717+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:40:48.091717+0000","last_peered":"2024-09-11T14:40:48.091717+0000","last_clean":"2024-09-11T14:40:48.091717+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:40:48.091717+0000","last_undegraded":"2024-09-11T14:40:48.091717+0000","last_fullsized":"2024-09-11T14:40:48.091717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20512768,"num_objects":313,"num_object_clones":0,"num_object_copies":939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":20032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"47'283","reported_seq":319,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:47.818765+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:40:47.818765+0000","last_peered":"2024-09-11T14:40:47.818765+0000","last_clean":"2024-09-11T14:40:47.818765+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:40:47.818765+0000","last_undegraded":"2024-09-11T14:40:47.818765+0000","last_fullsized":"2024-09-11T14:40:47.818765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"47'297","reported_seq":333,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.165570+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:40:48.165570+0000","last_peered":"2024-09-11T14:40:48.165570+0000","last_clean":"2024-09-11T14:40:48.165570+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:40:48.165570+0000","last_undegraded":"2024-09-11T14:40:48.165570+0000","last_fullsized":"2024-09-11T14:40:48.165570+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":19008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"47'307","reported_seq":343,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:44.036238+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:40:44.036238+0000","last_peered":"2024-09-11T14:40:44.036238+0000","last_clean":"2024-09-11T14:40:44.036238+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:40:44.036238+0000","last_undegraded":"2024-09-11T14:40:44.036238+0000","last_fullsized":"2024-09-11T14:40:44.036238+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20119552,"num_objects":307,"num_object_clones":0,"num_object_copies":921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":19648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"47'326","reported_seq":362,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.176921+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:40:48.176921+0000","last_peered":"2024-09-11T14:40:48.176921+0000","last_clean":"2024-09-11T14:40:48.176921+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:40:48.176921+0000","last_undegraded":"2024-09-11T14:40:48.176921+0000","last_fullsized":"2024-09-11T14:40:48.176921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21364736,"num_objects":326,"num_object_clones":0,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"47'299","reported_seq":335,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:47.505835+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:40:47.505835+0000","last_peered":"2024-09-11T14:40:47.505835+0000","last_clean":"2024-09-11T14:40:47.505835+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:40:47.505835+0000","last_undegraded":"2024-09-11T14:40:47.505835+0000","last_fullsized":"2024-09-11T14:40:47.505835+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":19136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"47'293","reported_seq":329,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.028558+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:40:48.028558+0000","last_peered":"2024-09-11T14:40:48.028558+0000","last_clean":"2024-09-11T14:40:48.028558+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:40:48.028558+0000","last_undegraded":"2024-09-11T14:40:48.028558+0000","last_fullsized":"2024-09-11T14:40:48.028558+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":18752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"47'287","reported_seq":323,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.193720+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:40:48.193720+0000","last_peered":"2024-09-11T14:40:48.193720+0000","last_clean":"2024-09-11T14:40:48.193720+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:40:48.193720+0000","last_undegraded":"2024-09-11T14:40:48.193720+0000","last_fullsized":"2024-09-11T14:40:48.193720+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18808832,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287,"num_write_kb":18368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"47'311","reported_seq":347,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:47.961998+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:40:47.961998+0000","last_peered":"2024-09-11T14:40:47.961998+0000","last_clean":"2024-09-11T14:40:47.961998+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:40:47.961998+0000","last_undegraded":"2024-09-11T14:40:47.961998+0000","last_fullsized":"2024-09-11T14:40:47.961998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20381696,"num_objects":311,"num_object_clones":0,"num_object_copies":933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":19904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":181,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.902063+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:40:30.902063+0000","last_peered":"2024-09-11T14:40:30.902063+0000","last_clean":"2024-09-11T14:40:30.902063+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:40:30.902063+0000","last_undegraded":"2024-09-11T14:40:30.902063+0000","last_fullsized":"2024-09-11T14:40:30.902063+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":110,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.228134+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:40:31.228134+0000","last_peered":"2024-09-11T14:40:31.228134+0000","last_clean":"2024-09-11T14:40:31.228134+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:40:31.228134+0000","last_undegraded":"2024-09-11T14:40:31.228134+0000","last_fullsized":"2024-09-11T14:40:31.228134+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"47'323","reported_seq":359,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.132836+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:40:48.132836+0000","last_peered":"2024-09-11T14:40:48.132836+0000","last_clean":"2024-09-11T14:40:48.132836+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:40:48.132836+0000","last_undegraded":"2024-09-11T14:40:48.132836+0000","last_fullsized":"2024-09-11T14:40:48.132836+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.124463+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:40:31.124463+0000","last_peered":"2024-09-11T14:40:31.124463+0000","last_clean":"2024-09-11T14:40:31.124463+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:40:31.124463+0000","last_undegraded":"2024-09-11T14:40:31.124463+0000","last_fullsized":"2024-09-11T14:40:31.124463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"47'326","reported_seq":362,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.056544+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:40:48.056544+0000","last_peered":"2024-09-11T14:40:48.056544+0000","last_clean":"2024-09-11T14:40:48.056544+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:40:48.056544+0000","last_undegraded":"2024-09-11T14:40:48.056544+0000","last_fullsized":"2024-09-11T14:40:48.056544+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21364736,"num_objects":326,"num_object_clones":0,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.217608+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:40:31.217608+0000","last_peered":"2024-09-11T14:40:31.217608+0000","last_clean":"2024-09-11T14:40:31.217608+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:40:31.217608+0000","last_undegraded":"2024-09-11T14:40:31.217608+0000","last_fullsized":"2024-09-11T14:40:31.217608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"47'304","reported_seq":340,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.016442+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:40:48.016442+0000","last_peered":"2024-09-11T14:40:48.016442+0000","last_clean":"2024-09-11T14:40:48.016442+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:40:48.016442+0000","last_undegraded":"2024-09-11T14:40:48.016442+0000","last_fullsized":"2024-09-11T14:40:48.016442+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19922944,"num_objects":304,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":111,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.113990+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:40:31.113990+0000","last_peered":"2024-09-11T14:40:31.113990+0000","last_clean":"2024-09-11T14:40:31.113990+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:40:31.113990+0000","last_undegraded":"2024-09-11T14:40:31.113990+0000","last_fullsized":"2024-09-11T14:40:31.113990+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"47'275","reported_seq":311,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:47.647193+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:40:47.647193+0000","last_peered":"2024-09-11T14:40:47.647193+0000","last_clean":"2024-09-11T14:40:47.647193+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:40:47.647193+0000","last_undegraded":"2024-09-11T14:40:47.647193+0000","last_fullsized":"2024-09-11T14:40:47.647193+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18022400,"num_objects":275,"num_object_clones":0,"num_object_copies":825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":17600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.890413+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:40:30.890413+0000","last_peered":"2024-09-11T14:40:30.890413+0000","last_clean":"2024-09-11T14:40:30.890413+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:40:30.890413+0000","last_undegraded":"2024-09-11T14:40:30.890413+0000","last_fullsized":"2024-09-11T14:40:30.890413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"47'315","reported_seq":351,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.247254+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:40:48.247254+0000","last_peered":"2024-09-11T14:40:48.247254+0000","last_clean":"2024-09-11T14:40:48.247254+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:40:48.247254+0000","last_undegraded":"2024-09-11T14:40:48.247254+0000","last_fullsized":"2024-09-11T14:40:48.247254+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20643840,"num_objects":315,"num_object_clones":0,"num_object_copies":945,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":20160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.909268+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:30.909268+0000","last_peered":"2024-09-11T14:40:30.909268+0000","last_clean":"2024-09-11T14:40:30.909268+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:40:30.909268+0000","last_undegraded":"2024-09-11T14:40:30.909268+0000","last_fullsized":"2024-09-11T14:40:30.909268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"47'311","reported_seq":347,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:47.936267+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:40:47.936267+0000","last_peered":"2024-09-11T14:40:47.936267+0000","last_clean":"2024-09-11T14:40:47.936267+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:40:47.936267+0000","last_undegraded":"2024-09-11T14:40:47.936267+0000","last_fullsized":"2024-09-11T14:40:47.936267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20381696,"num_objects":311,"num_object_clones":0,"num_object_copies":933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":19904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.878614+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:30.878614+0000","last_peered":"2024-09-11T14:40:30.878614+0000","last_clean":"2024-09-11T14:40:30.878614+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:40:30.878614+0000","last_undegraded":"2024-09-11T14:40:30.878614+0000","last_fullsized":"2024-09-11T14:40:30.878614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"47'322","reported_seq":358,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.159459+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:40:48.159459+0000","last_peered":"2024-09-11T14:40:48.159459+0000","last_clean":"2024-09-11T14:40:48.159459+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:40:48.159459+0000","last_undegraded":"2024-09-11T14:40:48.159459+0000","last_fullsized":"2024-09-11T14:40:48.159459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21102592,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":20608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.239377+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:40:31.239377+0000","last_peered":"2024-09-11T14:40:31.239377+0000","last_clean":"2024-09-11T14:40:31.239377+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:40:31.239377+0000","last_undegraded":"2024-09-11T14:40:31.239377+0000","last_fullsized":"2024-09-11T14:40:31.239377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":320602112,"num_objects":4892,"num_object_clones":0,"num_object_copies":14676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4892,"num_write_kb":313088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212291088384,"internally_reserved":0,"allocated":1920405504,"data_stored":1920405504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4892,"ondisk_log_size":4892,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212291219456,"internally_reserved":0,"allocated":1920274432,"data_stored":1920274432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53058756608,"internally_reserved":0,"allocated":494116864,"data_stored":494116864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673239,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":476220,"kb_used_data":476220,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51821508,"statfs":{"total":53552873472,"available":53065224192,"internally_reserved":0,"allocated":487649280,"data_stored":487649280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":393332,"kb_used_data":393332,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51904396,"statfs":{"total":53552873472,"available":53150101504,"internally_reserved":0,"allocated":402771968,"data_stored":402771968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":480488,"kb_used_data":480488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51817240,"statfs":{"total":53552873472,"available":53060853760,"internally_reserved":0,"allocated":492019712,"data_stored":492019712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":504248,"kb_used_data":504248,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51793480,"statfs":{"total":53552873472,"available":53036523520,"internally_reserved":0,"allocated":516349952,"data_stored":516349952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53058756608,"internally_reserved":0,"allocated":494116864,"data_stored":494116864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53055324160,"internally_reserved":0,"allocated":497549312,"data_stored":497549312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53030858752,"internally_reserved":0,"allocated":522014720,"data_stored":522014720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53146279936,"internally_reserved":0,"allocated":406593536,"data_stored":406593536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53058756608,"internally_reserved":0,"allocated":494116864,"data_stored":494116864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53055324160,"internally_reserved":0,"allocated":497549312,"data_stored":497549312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53030858752,"internally_reserved":0,"allocated":522014720,"data_stored":522014720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53146148864,"internally_reserved":0,"allocated":406724608,"data_stored":406724608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53058756608,"internally_reserved":0,"allocated":494116864,"data_stored":494116864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:40:50.434 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 72 16 5050 5034 4.36937 4.9375 0.311031 0.228439 2024-09-11T14:40:51.434 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 73 16 5126 5110 4.37457 4.75 0.204645 0.228126 2024-09-11T14:40:52.386 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:40:52.435 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 74 16 5202 5186 4.37964 4.75 0.127437 0.227936 2024-09-11T14:40:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:52.527+0000 7f883564f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:52.535+0000 7f883564f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:53.434 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 75 16 5281 5265 4.38708 4.9375 0.218948 0.227619 2024-09-11T14:40:54.435 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 76 16 5361 5345 4.39513 5 0.334398 0.227095 2024-09-11T14:40:54.786 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:40:54.786 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:40:54.786 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:40:54.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:54.914+0000 7f7708646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:54.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:54.927+0000 7f7708646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:40:55.284 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:40:55.305 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2024-09-11T14:40:53.280056+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":322437683,"num_objects":4915,"num_object_clones":0,"num_object_copies":14745,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4992,"num_write_kb":315412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4966,"ondisk_log_size":4966,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1893920,"kb_used_data":1893920,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207296992,"statfs":{"total":214211493888,"available":212272119808,"internally_reserved":0,"allocated":1939374080,"data_stored":1939374080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":47841280,"num_objects":730,"num_object_clones":0,"num_object_copies":2190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":46720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002498"},"pg_stats":[{"pgid":"4.f","version":"47'313","reported_seq":349,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.091717+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:40:48.091717+0000","last_peered":"2024-09-11T14:40:48.091717+0000","last_clean":"2024-09-11T14:40:48.091717+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:40:48.091717+0000","last_undegraded":"2024-09-11T14:40:48.091717+0000","last_fullsized":"2024-09-11T14:40:48.091717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20512768,"num_objects":313,"num_object_clones":0,"num_object_copies":939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":20032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"47'283","reported_seq":319,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:47.818765+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:40:47.818765+0000","last_peered":"2024-09-11T14:40:47.818765+0000","last_clean":"2024-09-11T14:40:47.818765+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:40:47.818765+0000","last_undegraded":"2024-09-11T14:40:47.818765+0000","last_fullsized":"2024-09-11T14:40:47.818765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"47'297","reported_seq":333,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.165570+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:40:48.165570+0000","last_peered":"2024-09-11T14:40:48.165570+0000","last_clean":"2024-09-11T14:40:48.165570+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:40:48.165570+0000","last_undegraded":"2024-09-11T14:40:48.165570+0000","last_fullsized":"2024-09-11T14:40:48.165570+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":19008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"47'326","reported_seq":362,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.907450+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:40:48.907450+0000","last_peered":"2024-09-11T14:40:48.907450+0000","last_clean":"2024-09-11T14:40:48.907450+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:40:48.907450+0000","last_undegraded":"2024-09-11T14:40:48.907450+0000","last_fullsized":"2024-09-11T14:40:48.907450+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21364736,"num_objects":326,"num_object_clones":0,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"47'326","reported_seq":362,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.176921+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:40:48.176921+0000","last_peered":"2024-09-11T14:40:48.176921+0000","last_clean":"2024-09-11T14:40:48.176921+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:40:48.176921+0000","last_undegraded":"2024-09-11T14:40:48.176921+0000","last_fullsized":"2024-09-11T14:40:48.176921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21364736,"num_objects":326,"num_object_clones":0,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"47'299","reported_seq":335,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:47.505835+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:40:47.505835+0000","last_peered":"2024-09-11T14:40:47.505835+0000","last_clean":"2024-09-11T14:40:47.505835+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:40:47.505835+0000","last_undegraded":"2024-09-11T14:40:47.505835+0000","last_fullsized":"2024-09-11T14:40:47.505835+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":19136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"47'293","reported_seq":329,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.028558+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:40:48.028558+0000","last_peered":"2024-09-11T14:40:48.028558+0000","last_clean":"2024-09-11T14:40:48.028558+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:40:48.028558+0000","last_undegraded":"2024-09-11T14:40:48.028558+0000","last_fullsized":"2024-09-11T14:40:48.028558+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":18752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"47'287","reported_seq":323,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.193720+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:40:48.193720+0000","last_peered":"2024-09-11T14:40:48.193720+0000","last_clean":"2024-09-11T14:40:48.193720+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:40:48.193720+0000","last_undegraded":"2024-09-11T14:40:48.193720+0000","last_fullsized":"2024-09-11T14:40:48.193720+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18808832,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287,"num_write_kb":18368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"47'311","reported_seq":347,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:47.961998+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:40:47.961998+0000","last_peered":"2024-09-11T14:40:47.961998+0000","last_clean":"2024-09-11T14:40:47.961998+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:40:47.961998+0000","last_undegraded":"2024-09-11T14:40:47.961998+0000","last_fullsized":"2024-09-11T14:40:47.961998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20381696,"num_objects":311,"num_object_clones":0,"num_object_copies":933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":19904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":181,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.902063+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:40:30.902063+0000","last_peered":"2024-09-11T14:40:30.902063+0000","last_clean":"2024-09-11T14:40:30.902063+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:40:30.902063+0000","last_undegraded":"2024-09-11T14:40:30.902063+0000","last_fullsized":"2024-09-11T14:40:30.902063+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":110,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.228134+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:40:31.228134+0000","last_peered":"2024-09-11T14:40:31.228134+0000","last_clean":"2024-09-11T14:40:31.228134+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:40:31.228134+0000","last_undegraded":"2024-09-11T14:40:31.228134+0000","last_fullsized":"2024-09-11T14:40:31.228134+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"47'323","reported_seq":359,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.132836+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:40:48.132836+0000","last_peered":"2024-09-11T14:40:48.132836+0000","last_clean":"2024-09-11T14:40:48.132836+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:40:48.132836+0000","last_undegraded":"2024-09-11T14:40:48.132836+0000","last_fullsized":"2024-09-11T14:40:48.132836+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.124463+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:40:31.124463+0000","last_peered":"2024-09-11T14:40:31.124463+0000","last_clean":"2024-09-11T14:40:31.124463+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:40:31.124463+0000","last_undegraded":"2024-09-11T14:40:31.124463+0000","last_fullsized":"2024-09-11T14:40:31.124463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"47'326","reported_seq":362,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.056544+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:40:48.056544+0000","last_peered":"2024-09-11T14:40:48.056544+0000","last_clean":"2024-09-11T14:40:48.056544+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:40:48.056544+0000","last_undegraded":"2024-09-11T14:40:48.056544+0000","last_fullsized":"2024-09-11T14:40:48.056544+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21364736,"num_objects":326,"num_object_clones":0,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.217608+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:40:31.217608+0000","last_peered":"2024-09-11T14:40:31.217608+0000","last_clean":"2024-09-11T14:40:31.217608+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:40:31.217608+0000","last_undegraded":"2024-09-11T14:40:31.217608+0000","last_fullsized":"2024-09-11T14:40:31.217608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"47'304","reported_seq":340,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.016442+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:40:48.016442+0000","last_peered":"2024-09-11T14:40:48.016442+0000","last_clean":"2024-09-11T14:40:48.016442+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:40:48.016442+0000","last_undegraded":"2024-09-11T14:40:48.016442+0000","last_fullsized":"2024-09-11T14:40:48.016442+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19922944,"num_objects":304,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":111,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.113990+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:40:31.113990+0000","last_peered":"2024-09-11T14:40:31.113990+0000","last_clean":"2024-09-11T14:40:31.113990+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:40:31.113990+0000","last_undegraded":"2024-09-11T14:40:31.113990+0000","last_fullsized":"2024-09-11T14:40:31.113990+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"47'275","reported_seq":311,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:47.647193+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:40:47.647193+0000","last_peered":"2024-09-11T14:40:47.647193+0000","last_clean":"2024-09-11T14:40:47.647193+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:40:47.647193+0000","last_undegraded":"2024-09-11T14:40:47.647193+0000","last_fullsized":"2024-09-11T14:40:47.647193+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18022400,"num_objects":275,"num_object_clones":0,"num_object_copies":825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":17600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.890413+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:40:30.890413+0000","last_peered":"2024-09-11T14:40:30.890413+0000","last_clean":"2024-09-11T14:40:30.890413+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:40:30.890413+0000","last_undegraded":"2024-09-11T14:40:30.890413+0000","last_fullsized":"2024-09-11T14:40:30.890413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"47'315","reported_seq":351,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.247254+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:40:48.247254+0000","last_peered":"2024-09-11T14:40:48.247254+0000","last_clean":"2024-09-11T14:40:48.247254+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:40:48.247254+0000","last_undegraded":"2024-09-11T14:40:48.247254+0000","last_fullsized":"2024-09-11T14:40:48.247254+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20643840,"num_objects":315,"num_object_clones":0,"num_object_copies":945,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":20160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.909268+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:30.909268+0000","last_peered":"2024-09-11T14:40:30.909268+0000","last_clean":"2024-09-11T14:40:30.909268+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:40:30.909268+0000","last_undegraded":"2024-09-11T14:40:30.909268+0000","last_fullsized":"2024-09-11T14:40:30.909268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"47'311","reported_seq":347,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:47.936267+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:40:47.936267+0000","last_peered":"2024-09-11T14:40:47.936267+0000","last_clean":"2024-09-11T14:40:47.936267+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:40:47.936267+0000","last_undegraded":"2024-09-11T14:40:47.936267+0000","last_fullsized":"2024-09-11T14:40:47.936267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20381696,"num_objects":311,"num_object_clones":0,"num_object_copies":933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":19904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.878614+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:30.878614+0000","last_peered":"2024-09-11T14:40:30.878614+0000","last_clean":"2024-09-11T14:40:30.878614+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:40:30.878614+0000","last_undegraded":"2024-09-11T14:40:30.878614+0000","last_fullsized":"2024-09-11T14:40:30.878614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"47'322","reported_seq":358,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:48.159459+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:40:48.159459+0000","last_peered":"2024-09-11T14:40:48.159459+0000","last_clean":"2024-09-11T14:40:48.159459+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:40:48.159459+0000","last_undegraded":"2024-09-11T14:40:48.159459+0000","last_fullsized":"2024-09-11T14:40:48.159459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21102592,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":20608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.239377+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:40:31.239377+0000","last_peered":"2024-09-11T14:40:31.239377+0000","last_clean":"2024-09-11T14:40:31.239377+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:40:31.239377+0000","last_undegraded":"2024-09-11T14:40:31.239377+0000","last_fullsized":"2024-09-11T14:40:31.239377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":321847296,"num_objects":4911,"num_object_clones":0,"num_object_copies":14733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4911,"num_write_kb":314304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212252377088,"internally_reserved":0,"allocated":1959116800,"data_stored":1959116800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4911,"ondisk_log_size":4911,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212252508160,"internally_reserved":0,"allocated":1958985728,"data_stored":1958985728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53020045312,"internally_reserved":0,"allocated":532828160,"data_stored":532828160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673244,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":515852,"kb_used_data":515852,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51781876,"statfs":{"total":53552873472,"available":53024641024,"internally_reserved":0,"allocated":528232448,"data_stored":528232448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":393332,"kb_used_data":393332,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51904396,"statfs":{"total":53552873472,"available":53150101504,"internally_reserved":0,"allocated":402771968,"data_stored":402771968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":480488,"kb_used_data":480488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51817240,"statfs":{"total":53552873472,"available":53060853760,"internally_reserved":0,"allocated":492019712,"data_stored":492019712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":504248,"kb_used_data":504248,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51793480,"statfs":{"total":53552873472,"available":53036523520,"internally_reserved":0,"allocated":516349952,"data_stored":516349952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53020045312,"internally_reserved":0,"allocated":532828160,"data_stored":532828160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53055324160,"internally_reserved":0,"allocated":497549312,"data_stored":497549312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53030858752,"internally_reserved":0,"allocated":522014720,"data_stored":522014720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53146279936,"internally_reserved":0,"allocated":406593536,"data_stored":406593536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53020045312,"internally_reserved":0,"allocated":532828160,"data_stored":532828160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53055324160,"internally_reserved":0,"allocated":497549312,"data_stored":497549312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53030858752,"internally_reserved":0,"allocated":522014720,"data_stored":522014720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53146148864,"internally_reserved":0,"allocated":406724608,"data_stored":406724608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53020045312,"internally_reserved":0,"allocated":532828160,"data_stored":532828160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:40:55.418 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:40:55.436 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 77 16 5442 5426 4.40379 5.0625 0.127726 0.226787 2024-09-11T14:40:55.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:55.586+0000 7f442fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:55.594+0000 7f442fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:56.435 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 78 16 5509 5493 4.40102 4.1875 0.0477089 0.226479 2024-09-11T14:40:57.435 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 79 16 5592 5576 4.41097 5.1875 0.0974714 0.226271 2024-09-11T14:40:58.435 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:40:58.434991+0000 min lat: 0.0281091 max lat: 2.13574 avg lat: 0.226021 2024-09-11T14:40:58.435 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:40:58.435 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 80 16 5668 5652 4.4152 4.75 0.311633 0.226021 2024-09-11T14:40:58.462 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:40:58.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:58.623+0000 7f2ce0911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:58.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:40:58.632+0000 7f2ce0911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:40:59.435 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 81 16 5737 5721 4.41393 4.3125 0.0531405 0.225825 2024-09-11T14:41:00.308 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:41:00.308 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:41:00.308 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:41:00.308 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:41:00.435 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 82 16 5812 5796 4.41726 4.6875 0.314877 0.225936 2024-09-11T14:41:00.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:00.477+0000 7f4ab1191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:00.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:00.490+0000 7f4ab1191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:00.590 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:00.590 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:00.591 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:00.591 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:00.591 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:00.591 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:00.591 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:00.591 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:00.591 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:00.591 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:00.591 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:00.591 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:00.594 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:00.594 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:00.594 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:41:00.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:00.734+0000 7fdec1b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:00.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:00.750+0000 7fdec1b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:00.905 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:00.909 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:00.910 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:00.910 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:41:01.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:01.028+0000 7f50dc511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:01.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:01.040+0000 7f50dc511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:01.271 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:01.271 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:01.272 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:01.272 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:01.272 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:01.272 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:01.272 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:01.272 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:01.272 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:01.272 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:01.272 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:01.272 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:01.275 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:01.275 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:01.275 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:41:01.391 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:41:01.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:01.415+0000 7f7db26a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:01.435 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 83 16 5889 5873 4.42201 4.8125 0.279823 0.22588 2024-09-11T14:41:01.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:01.434+0000 7f7db26a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:01.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:01.566+0000 7f9f7f8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:01.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:01.575+0000 7f9f7f8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:01.612 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:01.612 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:01.613 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:01.613 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:01.613 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:01.613 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:01.613 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:01.613 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:01.613 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:01.613 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:01.613 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:01.613 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:01.616 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:01.617 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:02.435 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 84 16 5971 5955 4.43038 5.125 0.187619 0.225454 2024-09-11T14:41:03.435 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 85 16 6050 6034 4.43634 4.9375 0.304486 0.224981 2024-09-11T14:41:04.339 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:41:04.436 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 86 16 6133 6117 4.44507 5.1875 0.150583 0.224574 2024-09-11T14:41:04.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:04.490+0000 7f6281d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:04.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:04.501+0000 7f6281d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:05.436 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 87 16 6213 6197 4.45143 5 0.1029 0.224196 2024-09-11T14:41:06.436 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 88 16 6278 6262 4.44701 4.0625 0.0957258 0.224278 2024-09-11T14:41:06.617 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:41:06.617 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:41:06.618 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:41:06.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:06.792+0000 7f8dd1f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:06.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:06.807+0000 7f8dd1f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:07.194 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:41:07.195 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:41:07.218 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-09-11T14:41:05.284460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":396886579,"num_objects":6051,"num_object_clones":0,"num_object_copies":18153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6128,"num_write_kb":388116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6102,"ondisk_log_size":6102,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2335396,"kb_used_data":2335396,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206855516,"statfs":{"total":214211493888,"available":211820048384,"internally_reserved":0,"allocated":2391445504,"data_stored":2391445504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":74448896,"num_objects":1136,"num_object_clones":0,"num_object_copies":3408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1136,"num_write_kb":72704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004404"},"pg_stats":[{"pgid":"4.f","version":"47'394","reported_seq":430,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:03.090254+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:41:03.090254+0000","last_peered":"2024-09-11T14:41:03.090254+0000","last_clean":"2024-09-11T14:41:03.090254+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:41:03.090254+0000","last_undegraded":"2024-09-11T14:41:03.090254+0000","last_fullsized":"2024-09-11T14:41:03.090254+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25821184,"num_objects":394,"num_object_clones":0,"num_object_copies":1182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":394,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"47'355","reported_seq":391,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:02.963973+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:41:02.963973+0000","last_peered":"2024-09-11T14:41:02.963973+0000","last_clean":"2024-09-11T14:41:02.963973+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:41:02.963973+0000","last_undegraded":"2024-09-11T14:41:02.963973+0000","last_fullsized":"2024-09-11T14:41:02.963973+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23265280,"num_objects":355,"num_object_clones":0,"num_object_copies":1065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":22720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"47'367","reported_seq":403,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:03.318620+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:41:03.318620+0000","last_peered":"2024-09-11T14:41:03.318620+0000","last_clean":"2024-09-11T14:41:03.318620+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:41:03.318620+0000","last_undegraded":"2024-09-11T14:41:03.318620+0000","last_fullsized":"2024-09-11T14:41:03.318620+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24051712,"num_objects":367,"num_object_clones":0,"num_object_copies":1101,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":23488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"47'400","reported_seq":436,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:03.227420+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:41:03.227420+0000","last_peered":"2024-09-11T14:41:03.227420+0000","last_clean":"2024-09-11T14:41:03.227420+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:41:03.227420+0000","last_undegraded":"2024-09-11T14:41:03.227420+0000","last_fullsized":"2024-09-11T14:41:03.227420+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26214400,"num_objects":400,"num_object_clones":0,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"47'409","reported_seq":445,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:02.831139+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:41:02.831139+0000","last_peered":"2024-09-11T14:41:02.831139+0000","last_clean":"2024-09-11T14:41:02.831139+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:41:02.831139+0000","last_undegraded":"2024-09-11T14:41:02.831139+0000","last_fullsized":"2024-09-11T14:41:02.831139+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26804224,"num_objects":409,"num_object_clones":0,"num_object_copies":1227,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":409,"num_write_kb":26176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"47'377","reported_seq":413,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:03.231087+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:41:03.231087+0000","last_peered":"2024-09-11T14:41:03.231087+0000","last_clean":"2024-09-11T14:41:03.231087+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:41:03.231087+0000","last_undegraded":"2024-09-11T14:41:03.231087+0000","last_fullsized":"2024-09-11T14:41:03.231087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24707072,"num_objects":377,"num_object_clones":0,"num_object_copies":1131,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":24128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"47'359","reported_seq":395,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:03.002745+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:41:03.002745+0000","last_peered":"2024-09-11T14:41:03.002745+0000","last_clean":"2024-09-11T14:41:03.002745+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:41:03.002745+0000","last_undegraded":"2024-09-11T14:41:03.002745+0000","last_fullsized":"2024-09-11T14:41:03.002745+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23527424,"num_objects":359,"num_object_clones":0,"num_object_copies":1077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":359,"num_write_kb":22976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"47'351","reported_seq":387,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:02.683954+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:41:02.683954+0000","last_peered":"2024-09-11T14:41:02.683954+0000","last_clean":"2024-09-11T14:41:02.683954+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:41:02.683954+0000","last_undegraded":"2024-09-11T14:41:02.683954+0000","last_fullsized":"2024-09-11T14:41:02.683954+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23003136,"num_objects":351,"num_object_clones":0,"num_object_copies":1053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":351,"num_write_kb":22464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"47'368","reported_seq":404,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:02.107466+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:41:02.107466+0000","last_peered":"2024-09-11T14:41:02.107466+0000","last_clean":"2024-09-11T14:41:02.107466+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:41:02.107466+0000","last_undegraded":"2024-09-11T14:41:02.107466+0000","last_fullsized":"2024-09-11T14:41:02.107466+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24117248,"num_objects":368,"num_object_clones":0,"num_object_copies":1104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":23552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":181,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.902063+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:40:30.902063+0000","last_peered":"2024-09-11T14:40:30.902063+0000","last_clean":"2024-09-11T14:40:30.902063+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:40:30.902063+0000","last_undegraded":"2024-09-11T14:40:30.902063+0000","last_fullsized":"2024-09-11T14:40:30.902063+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":110,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.228134+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:40:31.228134+0000","last_peered":"2024-09-11T14:40:31.228134+0000","last_clean":"2024-09-11T14:40:31.228134+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:40:31.228134+0000","last_undegraded":"2024-09-11T14:40:31.228134+0000","last_fullsized":"2024-09-11T14:40:31.228134+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"47'393","reported_seq":429,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:02.647359+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:41:02.647359+0000","last_peered":"2024-09-11T14:41:02.647359+0000","last_clean":"2024-09-11T14:41:02.647359+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:41:02.647359+0000","last_undegraded":"2024-09-11T14:41:02.647359+0000","last_fullsized":"2024-09-11T14:41:02.647359+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":25152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.124463+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:40:31.124463+0000","last_peered":"2024-09-11T14:40:31.124463+0000","last_clean":"2024-09-11T14:40:31.124463+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:40:31.124463+0000","last_undegraded":"2024-09-11T14:40:31.124463+0000","last_fullsized":"2024-09-11T14:40:31.124463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"47'398","reported_seq":434,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:03.075085+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:41:03.075085+0000","last_peered":"2024-09-11T14:41:03.075085+0000","last_clean":"2024-09-11T14:41:03.075085+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:41:03.075085+0000","last_undegraded":"2024-09-11T14:41:03.075085+0000","last_fullsized":"2024-09-11T14:41:03.075085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26083328,"num_objects":398,"num_object_clones":0,"num_object_copies":1194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":398,"num_write_kb":25472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.217608+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:40:31.217608+0000","last_peered":"2024-09-11T14:40:31.217608+0000","last_clean":"2024-09-11T14:40:31.217608+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:40:31.217608+0000","last_undegraded":"2024-09-11T14:40:31.217608+0000","last_fullsized":"2024-09-11T14:40:31.217608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"47'386","reported_seq":422,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:02.502735+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:41:02.502735+0000","last_peered":"2024-09-11T14:41:02.502735+0000","last_clean":"2024-09-11T14:41:02.502735+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:41:02.502735+0000","last_undegraded":"2024-09-11T14:41:02.502735+0000","last_fullsized":"2024-09-11T14:41:02.502735+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25296896,"num_objects":386,"num_object_clones":0,"num_object_copies":1158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":386,"num_write_kb":24704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":111,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.113990+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:40:31.113990+0000","last_peered":"2024-09-11T14:40:31.113990+0000","last_clean":"2024-09-11T14:40:31.113990+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:40:31.113990+0000","last_undegraded":"2024-09-11T14:40:31.113990+0000","last_fullsized":"2024-09-11T14:40:31.113990+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"47'340","reported_seq":376,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:03.114668+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:41:03.114668+0000","last_peered":"2024-09-11T14:41:03.114668+0000","last_clean":"2024-09-11T14:41:03.114668+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:41:03.114668+0000","last_undegraded":"2024-09-11T14:41:03.114668+0000","last_fullsized":"2024-09-11T14:41:03.114668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":21760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.890413+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:40:30.890413+0000","last_peered":"2024-09-11T14:40:30.890413+0000","last_clean":"2024-09-11T14:40:30.890413+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:40:30.890413+0000","last_undegraded":"2024-09-11T14:40:30.890413+0000","last_fullsized":"2024-09-11T14:40:30.890413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"47'382","reported_seq":418,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:03.000347+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:41:03.000347+0000","last_peered":"2024-09-11T14:41:03.000347+0000","last_clean":"2024-09-11T14:41:03.000347+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:41:03.000347+0000","last_undegraded":"2024-09-11T14:41:03.000347+0000","last_fullsized":"2024-09-11T14:41:03.000347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25034752,"num_objects":382,"num_object_clones":0,"num_object_copies":1146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":24448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.909268+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:30.909268+0000","last_peered":"2024-09-11T14:40:30.909268+0000","last_clean":"2024-09-11T14:40:30.909268+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:40:30.909268+0000","last_undegraded":"2024-09-11T14:40:30.909268+0000","last_fullsized":"2024-09-11T14:40:30.909268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"47'378","reported_seq":414,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:02.977454+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:41:02.977454+0000","last_peered":"2024-09-11T14:41:02.977454+0000","last_clean":"2024-09-11T14:41:02.977454+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:41:02.977454+0000","last_undegraded":"2024-09-11T14:41:02.977454+0000","last_fullsized":"2024-09-11T14:41:02.977454+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24772608,"num_objects":378,"num_object_clones":0,"num_object_copies":1134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.878614+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:30.878614+0000","last_peered":"2024-09-11T14:40:30.878614+0000","last_clean":"2024-09-11T14:40:30.878614+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:40:30.878614+0000","last_undegraded":"2024-09-11T14:40:30.878614+0000","last_fullsized":"2024-09-11T14:40:30.878614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"47'390","reported_seq":426,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:02.328595+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:41:02.328595+0000","last_peered":"2024-09-11T14:41:02.328595+0000","last_clean":"2024-09-11T14:41:02.328595+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:41:02.328595+0000","last_undegraded":"2024-09-11T14:41:02.328595+0000","last_fullsized":"2024-09-11T14:41:02.328595+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25559040,"num_objects":390,"num_object_clones":0,"num_object_copies":1170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":24960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.239377+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:40:31.239377+0000","last_peered":"2024-09-11T14:40:31.239377+0000","last_clean":"2024-09-11T14:40:31.239377+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:40:31.239377+0000","last_undegraded":"2024-09-11T14:40:31.239377+0000","last_fullsized":"2024-09-11T14:40:31.239377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":396296192,"num_objects":6047,"num_object_clones":0,"num_object_copies":18141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6047,"num_write_kb":387008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211797745664,"internally_reserved":0,"allocated":2413748224,"data_stored":2413748224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6047,"ondisk_log_size":6047,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211798274048,"internally_reserved":0,"allocated":2413219840,"data_stored":2413219840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52896022528,"internally_reserved":0,"allocated":656850944,"data_stored":656850944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":634388,"kb_used_data":634388,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51663340,"statfs":{"total":53552873472,"available":52903260160,"internally_reserved":0,"allocated":649613312,"data_stored":649613312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":488520,"kb_used_data":488520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51809208,"statfs":{"total":53552873472,"available":53052628992,"internally_reserved":0,"allocated":500244480,"data_stored":500244480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":590640,"kb_used_data":590640,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51707088,"statfs":{"total":53552873472,"available":52948058112,"internally_reserved":0,"allocated":604815360,"data_stored":604815360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":621848,"kb_used_data":621848,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51675880,"statfs":{"total":53552873472,"available":52916101120,"internally_reserved":0,"allocated":636772352,"data_stored":636772352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52896022528,"internally_reserved":0,"allocated":656850944,"data_stored":656850944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52943515648,"internally_reserved":0,"allocated":609357824,"data_stored":609357824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52909400064,"internally_reserved":0,"allocated":643473408,"data_stored":643473408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53049335808,"internally_reserved":0,"allocated":503537664,"data_stored":503537664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52896022528,"internally_reserved":0,"allocated":656850944,"data_stored":656850944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":52943515648,"internally_reserved":0,"allocated":609357824,"data_stored":609357824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":52909268992,"internally_reserved":0,"allocated":643604480,"data_stored":643604480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53048938496,"internally_reserved":0,"allocated":503934976,"data_stored":503934976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":52896022528,"internally_reserved":0,"allocated":656850944,"data_stored":656850944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:41:07.297 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:41:07.436 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 89 16 6356 6340 4.45181 4.875 0.103074 0.22422 2024-09-11T14:41:07.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:07.481+0000 7f1e9b111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:07.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:07.491+0000 7f1e9b111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:08.436 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 90 16 6428 6412 4.45235 4.5 0.619754 0.224014 2024-09-11T14:41:09.436 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total time run: 90.1571 2024-09-11T14:41:09.437 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total writes made: 6428 2024-09-11T14:41:09.437 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Write size: 65536 2024-09-11T14:41:09.437 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object size: 65536 2024-09-11T14:41:09.437 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Bandwidth (MB/sec): 4.45611 2024-09-11T14:41:09.437 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Bandwidth: 0.701267 2024-09-11T14:41:09.437 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max bandwidth (MB/sec): 5.8125 2024-09-11T14:41:09.437 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min bandwidth (MB/sec): 2.4375 2024-09-11T14:41:09.437 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average IOPS: 71 2024-09-11T14:41:09.437 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev IOPS: 11.2203 2024-09-11T14:41:09.437 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max IOPS: 93 2024-09-11T14:41:09.437 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min IOPS: 39 2024-09-11T14:41:09.437 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average Latency(s): 0.224193 2024-09-11T14:41:09.437 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Latency(s): 0.186448 2024-09-11T14:41:09.438 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max latency(s): 2.13574 2024-09-11T14:41:09.438 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min latency(s): 0.0281091 2024-09-11T14:41:09.477 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Cleaning up (deleting benchmark objects) 2024-09-11T14:41:10.132 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:41:10.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:10.295+0000 7fab8ccd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:10.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:10.305+0000 7fab8ccd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:12.221 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:41:12.221 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:41:12.222 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:41:12.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:12.386+0000 7fbef9591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:12.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:12.401+0000 7fbef9591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:12.729 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:41:12.729 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:41:12.744 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:41:12.747 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-09-11T14:41:11.285795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":421528115,"num_objects":6427,"num_object_clones":0,"num_object_copies":19281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6504,"num_write_kb":412180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6478,"ondisk_log_size":6478,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2483068,"kb_used_data":2483068,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206707844,"statfs":{"total":214211493888,"available":211668832256,"internally_reserved":0,"allocated":2542661632,"data_stored":2542661632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51183616,"num_objects":781,"num_object_clones":0,"num_object_copies":2343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":781,"num_write_kb":49984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002608"},"pg_stats":[{"pgid":"4.f","version":"47'420","reported_seq":456,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:08.195888+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:41:08.195888+0000","last_peered":"2024-09-11T14:41:08.195888+0000","last_clean":"2024-09-11T14:41:08.195888+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:41:08.195888+0000","last_undegraded":"2024-09-11T14:41:08.195888+0000","last_fullsized":"2024-09-11T14:41:08.195888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27525120,"num_objects":420,"num_object_clones":0,"num_object_copies":1260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":420,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"47'374","reported_seq":410,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:07.972430+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:41:07.972430+0000","last_peered":"2024-09-11T14:41:07.972430+0000","last_clean":"2024-09-11T14:41:07.972430+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:41:07.972430+0000","last_undegraded":"2024-09-11T14:41:07.972430+0000","last_fullsized":"2024-09-11T14:41:07.972430+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24510464,"num_objects":374,"num_object_clones":0,"num_object_copies":1122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"47'395","reported_seq":431,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:08.272260+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:41:08.272260+0000","last_peered":"2024-09-11T14:41:08.272260+0000","last_clean":"2024-09-11T14:41:08.272260+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:41:08.272260+0000","last_undegraded":"2024-09-11T14:41:08.272260+0000","last_fullsized":"2024-09-11T14:41:08.272260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25886720,"num_objects":395,"num_object_clones":0,"num_object_copies":1185,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":395,"num_write_kb":25280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"47'426","reported_seq":462,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:07.831977+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:41:07.831977+0000","last_peered":"2024-09-11T14:41:07.831977+0000","last_clean":"2024-09-11T14:41:07.831977+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:41:07.831977+0000","last_undegraded":"2024-09-11T14:41:07.831977+0000","last_fullsized":"2024-09-11T14:41:07.831977+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27918336,"num_objects":426,"num_object_clones":0,"num_object_copies":1278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":27264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"47'429","reported_seq":465,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:07.872963+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:41:07.872963+0000","last_peered":"2024-09-11T14:41:07.872963+0000","last_clean":"2024-09-11T14:41:07.872963+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:41:07.872963+0000","last_undegraded":"2024-09-11T14:41:07.872963+0000","last_fullsized":"2024-09-11T14:41:07.872963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28114944,"num_objects":429,"num_object_clones":0,"num_object_copies":1287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":27456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"47'396","reported_seq":432,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:08.216712+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:41:08.216712+0000","last_peered":"2024-09-11T14:41:08.216712+0000","last_clean":"2024-09-11T14:41:08.216712+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:41:08.216712+0000","last_undegraded":"2024-09-11T14:41:08.216712+0000","last_fullsized":"2024-09-11T14:41:08.216712+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25952256,"num_objects":396,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"47'377","reported_seq":413,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:07.584462+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:41:07.584462+0000","last_peered":"2024-09-11T14:41:07.584462+0000","last_clean":"2024-09-11T14:41:07.584462+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:41:07.584462+0000","last_undegraded":"2024-09-11T14:41:07.584462+0000","last_fullsized":"2024-09-11T14:41:07.584462+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24707072,"num_objects":377,"num_object_clones":0,"num_object_copies":1131,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":24128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"47'382","reported_seq":418,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:08.212869+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:41:08.212869+0000","last_peered":"2024-09-11T14:41:08.212869+0000","last_clean":"2024-09-11T14:41:08.212869+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:41:08.212869+0000","last_undegraded":"2024-09-11T14:41:08.212869+0000","last_fullsized":"2024-09-11T14:41:08.212869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25034752,"num_objects":382,"num_object_clones":0,"num_object_copies":1146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":24448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"47'393","reported_seq":429,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:08.092191+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:41:08.092191+0000","last_peered":"2024-09-11T14:41:08.092191+0000","last_clean":"2024-09-11T14:41:08.092191+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:41:08.092191+0000","last_undegraded":"2024-09-11T14:41:08.092191+0000","last_fullsized":"2024-09-11T14:41:08.092191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":25152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":181,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.902063+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:40:30.902063+0000","last_peered":"2024-09-11T14:40:30.902063+0000","last_clean":"2024-09-11T14:40:30.902063+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:40:30.902063+0000","last_undegraded":"2024-09-11T14:40:30.902063+0000","last_fullsized":"2024-09-11T14:40:30.902063+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":110,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.228134+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:40:31.228134+0000","last_peered":"2024-09-11T14:40:31.228134+0000","last_clean":"2024-09-11T14:40:31.228134+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:40:31.228134+0000","last_undegraded":"2024-09-11T14:40:31.228134+0000","last_fullsized":"2024-09-11T14:40:31.228134+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"47'416","reported_seq":452,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:07.900382+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:41:07.900382+0000","last_peered":"2024-09-11T14:41:07.900382+0000","last_clean":"2024-09-11T14:41:07.900382+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:41:07.900382+0000","last_undegraded":"2024-09-11T14:41:07.900382+0000","last_fullsized":"2024-09-11T14:41:07.900382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.124463+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:40:31.124463+0000","last_peered":"2024-09-11T14:40:31.124463+0000","last_clean":"2024-09-11T14:40:31.124463+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:40:31.124463+0000","last_undegraded":"2024-09-11T14:40:31.124463+0000","last_fullsized":"2024-09-11T14:40:31.124463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"47'421","reported_seq":457,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:08.007197+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:41:08.007197+0000","last_peered":"2024-09-11T14:41:08.007197+0000","last_clean":"2024-09-11T14:41:08.007197+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:41:08.007197+0000","last_undegraded":"2024-09-11T14:41:08.007197+0000","last_fullsized":"2024-09-11T14:41:08.007197+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.217608+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:40:31.217608+0000","last_peered":"2024-09-11T14:40:31.217608+0000","last_clean":"2024-09-11T14:40:31.217608+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:40:31.217608+0000","last_undegraded":"2024-09-11T14:40:31.217608+0000","last_fullsized":"2024-09-11T14:40:31.217608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"47'411","reported_seq":447,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:08.044504+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:41:08.044504+0000","last_peered":"2024-09-11T14:41:08.044504+0000","last_clean":"2024-09-11T14:41:08.044504+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:41:08.044504+0000","last_undegraded":"2024-09-11T14:41:08.044504+0000","last_fullsized":"2024-09-11T14:41:08.044504+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26935296,"num_objects":411,"num_object_clones":0,"num_object_copies":1233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":26304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":111,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.113990+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:40:31.113990+0000","last_peered":"2024-09-11T14:40:31.113990+0000","last_clean":"2024-09-11T14:40:31.113990+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:40:31.113990+0000","last_undegraded":"2024-09-11T14:40:31.113990+0000","last_fullsized":"2024-09-11T14:40:31.113990+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"47'362","reported_seq":398,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:08.001092+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:41:08.001092+0000","last_peered":"2024-09-11T14:41:08.001092+0000","last_clean":"2024-09-11T14:41:08.001092+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:41:08.001092+0000","last_undegraded":"2024-09-11T14:41:08.001092+0000","last_fullsized":"2024-09-11T14:41:08.001092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23724032,"num_objects":362,"num_object_clones":0,"num_object_copies":1086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":362,"num_write_kb":23168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.890413+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:40:30.890413+0000","last_peered":"2024-09-11T14:40:30.890413+0000","last_clean":"2024-09-11T14:40:30.890413+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:40:30.890413+0000","last_undegraded":"2024-09-11T14:40:30.890413+0000","last_fullsized":"2024-09-11T14:40:30.890413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"47'411","reported_seq":447,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:08.073414+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:41:08.073414+0000","last_peered":"2024-09-11T14:41:08.073414+0000","last_clean":"2024-09-11T14:41:08.073414+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:41:08.073414+0000","last_undegraded":"2024-09-11T14:41:08.073414+0000","last_fullsized":"2024-09-11T14:41:08.073414+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26935296,"num_objects":411,"num_object_clones":0,"num_object_copies":1233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":26304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.909268+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:30.909268+0000","last_peered":"2024-09-11T14:40:30.909268+0000","last_clean":"2024-09-11T14:40:30.909268+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:40:30.909268+0000","last_undegraded":"2024-09-11T14:40:30.909268+0000","last_fullsized":"2024-09-11T14:40:30.909268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"47'396","reported_seq":432,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:07.450713+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:41:07.450713+0000","last_peered":"2024-09-11T14:41:07.450713+0000","last_clean":"2024-09-11T14:41:07.450713+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:41:07.450713+0000","last_undegraded":"2024-09-11T14:41:07.450713+0000","last_fullsized":"2024-09-11T14:41:07.450713+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25952256,"num_objects":396,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.878614+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:30.878614+0000","last_peered":"2024-09-11T14:40:30.878614+0000","last_clean":"2024-09-11T14:40:30.878614+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:40:30.878614+0000","last_undegraded":"2024-09-11T14:40:30.878614+0000","last_fullsized":"2024-09-11T14:40:30.878614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"47'414","reported_seq":450,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:08.247391+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:41:08.247391+0000","last_peered":"2024-09-11T14:41:08.247391+0000","last_clean":"2024-09-11T14:41:08.247391+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:41:08.247391+0000","last_undegraded":"2024-09-11T14:41:08.247391+0000","last_fullsized":"2024-09-11T14:41:08.247391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27131904,"num_objects":414,"num_object_clones":0,"num_object_copies":1242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":414,"num_write_kb":26496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.239377+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:40:31.239377+0000","last_peered":"2024-09-11T14:40:31.239377+0000","last_clean":"2024-09-11T14:40:31.239377+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:40:31.239377+0000","last_undegraded":"2024-09-11T14:40:31.239377+0000","last_fullsized":"2024-09-11T14:40:31.239377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":420937728,"num_objects":6423,"num_object_clones":0,"num_object_copies":19269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6423,"num_write_kb":411072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211655983104,"internally_reserved":0,"allocated":2555510784,"data_stored":2555510784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6423,"ondisk_log_size":6423,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211655983104,"internally_reserved":0,"allocated":2555510784,"data_stored":2555510784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52864094208,"internally_reserved":0,"allocated":688779264,"data_stored":688779264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":672636,"kb_used_data":672636,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51625092,"statfs":{"total":53552873472,"available":52864094208,"internally_reserved":0,"allocated":688779264,"data_stored":688779264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":519872,"kb_used_data":519872,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51777856,"statfs":{"total":53552873472,"available":53020524544,"internally_reserved":0,"allocated":532348928,"data_stored":532348928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":628612,"kb_used_data":628612,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51669116,"statfs":{"total":53552873472,"available":52909174784,"internally_reserved":0,"allocated":643698688,"data_stored":643698688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":661948,"kb_used_data":661948,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51635780,"statfs":{"total":53552873472,"available":52875038720,"internally_reserved":0,"allocated":677834752,"data_stored":677834752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52864094208,"internally_reserved":0,"allocated":688779264,"data_stored":688779264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52905250816,"internally_reserved":0,"allocated":647622656,"data_stored":647622656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52869779456,"internally_reserved":0,"allocated":683094016,"data_stored":683094016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53016858624,"internally_reserved":0,"allocated":536014848,"data_stored":536014848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52864094208,"internally_reserved":0,"allocated":688779264,"data_stored":688779264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":52905250816,"internally_reserved":0,"allocated":647622656,"data_stored":647622656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":52869779456,"internally_reserved":0,"allocated":683094016,"data_stored":683094016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53016858624,"internally_reserved":0,"allocated":536014848,"data_stored":536014848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":52864094208,"internally_reserved":0,"allocated":688779264,"data_stored":688779264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:41:12.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:12.889+0000 7fb0d6afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:12.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:12.898+0000 7fb0d6afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:15.527 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:41:15.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:15.695+0000 7f552e0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:15.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:15.705+0000 7f552e0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:17.749 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:41:17.750 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:41:17.750 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:41:17.750 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:41:17.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:17.898+0000 7f481d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:17.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:17.913+0000 7f481d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:18.141 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:18.141 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:18.142 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:41:18.217 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:41:18.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:18.318+0000 7f5be7151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:18.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:18.338+0000 7f5be7151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:18.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:18.394+0000 7f6294a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:18.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:18.402+0000 7f6294a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:18.475 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:18.476 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:18.476 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:18.476 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:18.476 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:18.476 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:18.476 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:18.476 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:18.476 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:18.476 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:18.477 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:18.477 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:18.480 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:18.481 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:18.481 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:41:18.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:18.625+0000 7f3d8e693640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:18.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:18.637+0000 7f3d8e693640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:18.808 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:18.808 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:18.808 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:18.808 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:18.809 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:18.809 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:18.809 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:18.809 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:18.809 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:18.809 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:18.809 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:18.809 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:18.813 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:18.813 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:18.813 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:41:18.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:18.953+0000 7ff017aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:18.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:18.967+0000 7ff017aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:19.024 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:19.024 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:19.024 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:19.024 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:19.024 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:19.025 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:19.025 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:19.025 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:19.025 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:19.025 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:19.025 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:19.025 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:19.029 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:19.029 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:20.835 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:41:20.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:20.957+0000 7f30e2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:20.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:20.963+0000 7f30e2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:23.619 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:41:23.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:23.786+0000 7fe7dd493640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:23.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:23.794+0000 7fe7dd493640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:24.031 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:41:24.031 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T14:41:24.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:24.210+0000 7f7829046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:24.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:24.230+0000 7f7829046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:24.867 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T14:41:24.890 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T14:41:25.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:25.026+0000 7f2f76b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:25.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:25.041+0000 7f2f76b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:25.873 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T14:41:25.899 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T14:41:26.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:26.049+0000 7f010e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:26.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:26.064+0000 7f010e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:26.505 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:41:26.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:26.686+0000 7f225bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:26.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:26.696+0000 7f225bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:26.879 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T14:41:26.906 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T14:41:27.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:27.082+0000 7ff968151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:27.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:27.102+0000 7ff968151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:27.888 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T14:41:27.913 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T14:41:27.914 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:41:28.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:28.083+0000 7feae3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:28.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:28.098+0000 7feae3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:28.481 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:41:28.482 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:41:28.507 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-09-11T14:41:27.887990+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":333251147,"num_objects":5081,"num_object_clones":0,"num_object_copies":15243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":7862,"num_write_kb":412501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7836,"ondisk_log_size":7836,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1999928,"kb_used_data":1999928,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207190984,"statfs":{"total":214211493888,"available":212163567616,"internally_reserved":0,"allocated":2047926272,"data_stored":2047926272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-30932992,"num_objects":-472,"num_object_clones":0,"num_object_copies":-1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.599578"},"pg_stats":[{"pgid":"4.f","version":"47'512","reported_seq":548,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:22.445868+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:41:22.445868+0000","last_peered":"2024-09-11T14:41:22.445868+0000","last_clean":"2024-09-11T14:41:22.445868+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:41:22.445868+0000","last_undegraded":"2024-09-11T14:41:22.445868+0000","last_fullsized":"2024-09-11T14:41:22.445868+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21495808,"num_objects":328,"num_object_clones":0,"num_object_copies":984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"47'459","reported_seq":495,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:23.151474+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:41:23.151474+0000","last_peered":"2024-09-11T14:41:23.151474+0000","last_clean":"2024-09-11T14:41:23.151474+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:41:23.151474+0000","last_undegraded":"2024-09-11T14:41:23.151474+0000","last_fullsized":"2024-09-11T14:41:23.151474+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18939904,"num_objects":289,"num_object_clones":0,"num_object_copies":867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"47'486","reported_seq":523,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:22.744955+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:41:22.744955+0000","last_peered":"2024-09-11T14:41:22.744955+0000","last_clean":"2024-09-11T14:41:22.744955+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:41:22.744955+0000","last_undegraded":"2024-09-11T14:41:22.744955+0000","last_fullsized":"2024-09-11T14:41:22.744955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19988504,"num_objects":306,"num_object_clones":0,"num_object_copies":918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":486,"num_write_kb":25281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"47'515","reported_seq":551,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:24.310261+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:41:24.310261+0000","last_peered":"2024-09-11T14:41:24.310261+0000","last_clean":"2024-09-11T14:41:24.310261+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:41:24.310261+0000","last_undegraded":"2024-09-11T14:41:24.310261+0000","last_fullsized":"2024-09-11T14:41:24.310261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22085632,"num_objects":337,"num_object_clones":0,"num_object_copies":1011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":27264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"47'519","reported_seq":555,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:23.057842+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:41:23.057842+0000","last_peered":"2024-09-11T14:41:23.057842+0000","last_clean":"2024-09-11T14:41:23.057842+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:41:23.057842+0000","last_undegraded":"2024-09-11T14:41:23.057842+0000","last_fullsized":"2024-09-11T14:41:23.057842+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22216704,"num_objects":339,"num_object_clones":0,"num_object_copies":1017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":519,"num_write_kb":27456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"47'491","reported_seq":527,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:22.818786+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:41:22.818786+0000","last_peered":"2024-09-11T14:41:22.818786+0000","last_clean":"2024-09-11T14:41:22.818786+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:41:22.818786+0000","last_undegraded":"2024-09-11T14:41:22.818786+0000","last_fullsized":"2024-09-11T14:41:22.818786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19726336,"num_objects":301,"num_object_clones":0,"num_object_copies":903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":491,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"47'468","reported_seq":504,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:23.085475+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:41:23.085475+0000","last_peered":"2024-09-11T14:41:23.085475+0000","last_clean":"2024-09-11T14:41:23.085475+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:41:23.085475+0000","last_undegraded":"2024-09-11T14:41:23.085475+0000","last_fullsized":"2024-09-11T14:41:23.085475+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18743296,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":468,"num_write_kb":24128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"47'452","reported_seq":488,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:23.230414+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:41:23.230414+0000","last_peered":"2024-09-11T14:41:23.230414+0000","last_clean":"2024-09-11T14:41:23.230414+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:41:23.230414+0000","last_undegraded":"2024-09-11T14:41:23.230414+0000","last_fullsized":"2024-09-11T14:41:23.230414+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20447232,"num_objects":312,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":452,"num_write_kb":24448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"47'490","reported_seq":526,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:23.238979+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:41:23.238979+0000","last_peered":"2024-09-11T14:41:23.238979+0000","last_clean":"2024-09-11T14:41:23.238979+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:41:23.238979+0000","last_undegraded":"2024-09-11T14:41:23.238979+0000","last_fullsized":"2024-09-11T14:41:23.238979+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19398656,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":25152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":181,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.902063+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:40:30.902063+0000","last_peered":"2024-09-11T14:40:30.902063+0000","last_clean":"2024-09-11T14:40:30.902063+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:40:30.902063+0000","last_undegraded":"2024-09-11T14:40:30.902063+0000","last_fullsized":"2024-09-11T14:40:30.902063+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":110,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.228134+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:40:31.228134+0000","last_peered":"2024-09-11T14:40:31.228134+0000","last_clean":"2024-09-11T14:40:31.228134+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:40:31.228134+0000","last_undegraded":"2024-09-11T14:40:31.228134+0000","last_fullsized":"2024-09-11T14:40:31.228134+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"47'488","reported_seq":524,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:22.652878+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:41:22.652878+0000","last_peered":"2024-09-11T14:41:22.652878+0000","last_clean":"2024-09-11T14:41:22.652878+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:41:22.652878+0000","last_undegraded":"2024-09-11T14:41:22.652878+0000","last_fullsized":"2024-09-11T14:41:22.652878+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22544384,"num_objects":344,"num_object_clones":0,"num_object_copies":1032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.124463+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:40:31.124463+0000","last_peered":"2024-09-11T14:40:31.124463+0000","last_clean":"2024-09-11T14:40:31.124463+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:40:31.124463+0000","last_undegraded":"2024-09-11T14:40:31.124463+0000","last_fullsized":"2024-09-11T14:40:31.124463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"47'503","reported_seq":539,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:23.073247+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:41:23.073247+0000","last_peered":"2024-09-11T14:41:23.073247+0000","last_clean":"2024-09-11T14:41:23.073247+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:41:23.073247+0000","last_undegraded":"2024-09-11T14:41:23.073247+0000","last_fullsized":"2024-09-11T14:41:23.073247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22216704,"num_objects":339,"num_object_clones":0,"num_object_copies":1017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.217608+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:40:31.217608+0000","last_peered":"2024-09-11T14:40:31.217608+0000","last_clean":"2024-09-11T14:40:31.217608+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:40:31.217608+0000","last_undegraded":"2024-09-11T14:40:31.217608+0000","last_fullsized":"2024-09-11T14:40:31.217608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"47'492","reported_seq":528,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:22.930662+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:41:22.930662+0000","last_peered":"2024-09-11T14:41:22.930662+0000","last_clean":"2024-09-11T14:41:22.930662+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:41:22.930662+0000","last_undegraded":"2024-09-11T14:41:22.930662+0000","last_fullsized":"2024-09-11T14:41:22.930662+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21889024,"num_objects":334,"num_object_clones":0,"num_object_copies":1002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":492,"num_write_kb":26432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":111,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.113990+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:40:31.113990+0000","last_peered":"2024-09-11T14:40:31.113990+0000","last_clean":"2024-09-11T14:40:31.113990+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:40:31.113990+0000","last_undegraded":"2024-09-11T14:40:31.113990+0000","last_fullsized":"2024-09-11T14:40:31.113990+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"47'444","reported_seq":480,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:22.981786+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:41:22.981786+0000","last_peered":"2024-09-11T14:41:22.981786+0000","last_clean":"2024-09-11T14:41:22.981786+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:41:22.981786+0000","last_undegraded":"2024-09-11T14:41:22.981786+0000","last_fullsized":"2024-09-11T14:41:22.981786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18350080,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":444,"num_write_kb":23168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.890413+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:40:30.890413+0000","last_peered":"2024-09-11T14:40:30.890413+0000","last_clean":"2024-09-11T14:40:30.890413+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:40:30.890413+0000","last_undegraded":"2024-09-11T14:40:30.890413+0000","last_fullsized":"2024-09-11T14:40:30.890413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"47'482","reported_seq":518,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:23.386925+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:41:23.386925+0000","last_peered":"2024-09-11T14:41:23.386925+0000","last_clean":"2024-09-11T14:41:23.386925+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:41:23.386925+0000","last_undegraded":"2024-09-11T14:41:23.386925+0000","last_fullsized":"2024-09-11T14:41:23.386925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":482,"num_write_kb":26304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.909268+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:30.909268+0000","last_peered":"2024-09-11T14:40:30.909268+0000","last_clean":"2024-09-11T14:40:30.909268+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:40:30.909268+0000","last_undegraded":"2024-09-11T14:40:30.909268+0000","last_fullsized":"2024-09-11T14:40:30.909268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"47'479","reported_seq":515,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:23.339437+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:41:23.339437+0000","last_peered":"2024-09-11T14:41:23.339437+0000","last_clean":"2024-09-11T14:41:23.339437+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:41:23.339437+0000","last_undegraded":"2024-09-11T14:41:23.339437+0000","last_fullsized":"2024-09-11T14:41:23.339437+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20512768,"num_objects":313,"num_object_clones":0,"num_object_copies":939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":479,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.878614+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:30.878614+0000","last_peered":"2024-09-11T14:40:30.878614+0000","last_clean":"2024-09-11T14:40:30.878614+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:40:30.878614+0000","last_undegraded":"2024-09-11T14:40:30.878614+0000","last_fullsized":"2024-09-11T14:40:30.878614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"47'501","reported_seq":537,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:22.805108+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:41:22.805108+0000","last_peered":"2024-09-11T14:41:22.805108+0000","last_clean":"2024-09-11T14:41:22.805108+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:41:22.805108+0000","last_undegraded":"2024-09-11T14:41:22.805108+0000","last_fullsized":"2024-09-11T14:41:22.805108+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21823488,"num_objects":333,"num_object_clones":0,"num_object_copies":999,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":501,"num_write_kb":26688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.239377+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:40:31.239377+0000","last_peered":"2024-09-11T14:40:31.239377+0000","last_clean":"2024-09-11T14:40:31.239377+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:40:31.239377+0000","last_undegraded":"2024-09-11T14:40:31.239377+0000","last_fullsized":"2024-09-11T14:40:31.239377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":332660760,"num_objects":5077,"num_object_clones":0,"num_object_copies":15231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7781,"num_write_kb":411393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212188925952,"internally_reserved":0,"allocated":2022567936,"data_stored":2022567936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7781,"ondisk_log_size":7781,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212188794880,"internally_reserved":0,"allocated":2022699008,"data_stored":2022699008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53017399296,"internally_reserved":0,"allocated":535474176,"data_stored":535474176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673279,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":529968,"kb_used_data":529968,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51767760,"statfs":{"total":53552873472,"available":53010186240,"internally_reserved":0,"allocated":542687232,"data_stored":542687232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":420712,"kb_used_data":420712,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51877016,"statfs":{"total":53552873472,"available":53122064384,"internally_reserved":0,"allocated":430809088,"data_stored":430809088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":511140,"kb_used_data":511140,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51786588,"statfs":{"total":53552873472,"available":53029466112,"internally_reserved":0,"allocated":523407360,"data_stored":523407360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":538108,"kb_used_data":538108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51759620,"statfs":{"total":53552873472,"available":53001850880,"internally_reserved":0,"allocated":551022592,"data_stored":551022592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53017399296,"internally_reserved":0,"allocated":535474176,"data_stored":535474176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53035315200,"internally_reserved":0,"allocated":517558272,"data_stored":517558272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53010276352,"internally_reserved":0,"allocated":542597120,"data_stored":542597120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53125804032,"internally_reserved":0,"allocated":427069440,"data_stored":427069440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53017399296,"internally_reserved":0,"allocated":535474176,"data_stored":535474176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53035315200,"internally_reserved":0,"allocated":517558272,"data_stored":517558272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53010407424,"internally_reserved":0,"allocated":542466048,"data_stored":542466048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53125804032,"internally_reserved":0,"allocated":427069440,"data_stored":427069440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53017399296,"internally_reserved":0,"allocated":535474176,"data_stored":535474176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:41:28.509 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:41:28.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:28.684+0000 7f3385911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:28.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:28.695+0000 7f3385911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:28.938 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:41:28.938 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:41:28.960 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-09-11T14:41:27.887990+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":333251147,"num_objects":5081,"num_object_clones":0,"num_object_copies":15243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":7862,"num_write_kb":412501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7836,"ondisk_log_size":7836,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1999928,"kb_used_data":1999928,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207190984,"statfs":{"total":214211493888,"available":212163567616,"internally_reserved":0,"allocated":2047926272,"data_stored":2047926272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-30932992,"num_objects":-472,"num_object_clones":0,"num_object_copies":-1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.599578"},"pg_stats":[{"pgid":"4.f","version":"47'512","reported_seq":548,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:22.445868+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:41:22.445868+0000","last_peered":"2024-09-11T14:41:22.445868+0000","last_clean":"2024-09-11T14:41:22.445868+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:41:22.445868+0000","last_undegraded":"2024-09-11T14:41:22.445868+0000","last_fullsized":"2024-09-11T14:41:22.445868+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21495808,"num_objects":328,"num_object_clones":0,"num_object_copies":984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"47'459","reported_seq":495,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:23.151474+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:41:23.151474+0000","last_peered":"2024-09-11T14:41:23.151474+0000","last_clean":"2024-09-11T14:41:23.151474+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:41:23.151474+0000","last_undegraded":"2024-09-11T14:41:23.151474+0000","last_fullsized":"2024-09-11T14:41:23.151474+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18939904,"num_objects":289,"num_object_clones":0,"num_object_copies":867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"47'486","reported_seq":523,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:22.744955+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:41:22.744955+0000","last_peered":"2024-09-11T14:41:22.744955+0000","last_clean":"2024-09-11T14:41:22.744955+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:41:22.744955+0000","last_undegraded":"2024-09-11T14:41:22.744955+0000","last_fullsized":"2024-09-11T14:41:22.744955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19988504,"num_objects":306,"num_object_clones":0,"num_object_copies":918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":486,"num_write_kb":25281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"47'515","reported_seq":551,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:24.310261+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:41:24.310261+0000","last_peered":"2024-09-11T14:41:24.310261+0000","last_clean":"2024-09-11T14:41:24.310261+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:41:24.310261+0000","last_undegraded":"2024-09-11T14:41:24.310261+0000","last_fullsized":"2024-09-11T14:41:24.310261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22085632,"num_objects":337,"num_object_clones":0,"num_object_copies":1011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":27264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"47'519","reported_seq":555,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:23.057842+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:41:23.057842+0000","last_peered":"2024-09-11T14:41:23.057842+0000","last_clean":"2024-09-11T14:41:23.057842+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:41:23.057842+0000","last_undegraded":"2024-09-11T14:41:23.057842+0000","last_fullsized":"2024-09-11T14:41:23.057842+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22216704,"num_objects":339,"num_object_clones":0,"num_object_copies":1017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":519,"num_write_kb":27456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"47'491","reported_seq":527,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:22.818786+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:41:22.818786+0000","last_peered":"2024-09-11T14:41:22.818786+0000","last_clean":"2024-09-11T14:41:22.818786+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:41:22.818786+0000","last_undegraded":"2024-09-11T14:41:22.818786+0000","last_fullsized":"2024-09-11T14:41:22.818786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19726336,"num_objects":301,"num_object_clones":0,"num_object_copies":903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":491,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"47'468","reported_seq":504,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:23.085475+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:41:23.085475+0000","last_peered":"2024-09-11T14:41:23.085475+0000","last_clean":"2024-09-11T14:41:23.085475+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:41:23.085475+0000","last_undegraded":"2024-09-11T14:41:23.085475+0000","last_fullsized":"2024-09-11T14:41:23.085475+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18743296,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":468,"num_write_kb":24128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"47'452","reported_seq":488,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:23.230414+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:41:23.230414+0000","last_peered":"2024-09-11T14:41:23.230414+0000","last_clean":"2024-09-11T14:41:23.230414+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:41:23.230414+0000","last_undegraded":"2024-09-11T14:41:23.230414+0000","last_fullsized":"2024-09-11T14:41:23.230414+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20447232,"num_objects":312,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":452,"num_write_kb":24448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"47'490","reported_seq":526,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:23.238979+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:41:23.238979+0000","last_peered":"2024-09-11T14:41:23.238979+0000","last_clean":"2024-09-11T14:41:23.238979+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:41:23.238979+0000","last_undegraded":"2024-09-11T14:41:23.238979+0000","last_fullsized":"2024-09-11T14:41:23.238979+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19398656,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":25152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":181,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.902063+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:40:30.902063+0000","last_peered":"2024-09-11T14:40:30.902063+0000","last_clean":"2024-09-11T14:40:30.902063+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:40:30.902063+0000","last_undegraded":"2024-09-11T14:40:30.902063+0000","last_fullsized":"2024-09-11T14:40:30.902063+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":110,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.228134+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:40:31.228134+0000","last_peered":"2024-09-11T14:40:31.228134+0000","last_clean":"2024-09-11T14:40:31.228134+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:40:31.228134+0000","last_undegraded":"2024-09-11T14:40:31.228134+0000","last_fullsized":"2024-09-11T14:40:31.228134+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"47'488","reported_seq":524,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:22.652878+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:41:22.652878+0000","last_peered":"2024-09-11T14:41:22.652878+0000","last_clean":"2024-09-11T14:41:22.652878+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:41:22.652878+0000","last_undegraded":"2024-09-11T14:41:22.652878+0000","last_fullsized":"2024-09-11T14:41:22.652878+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22544384,"num_objects":344,"num_object_clones":0,"num_object_copies":1032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.124463+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:40:31.124463+0000","last_peered":"2024-09-11T14:40:31.124463+0000","last_clean":"2024-09-11T14:40:31.124463+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:40:31.124463+0000","last_undegraded":"2024-09-11T14:40:31.124463+0000","last_fullsized":"2024-09-11T14:40:31.124463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"47'503","reported_seq":539,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:23.073247+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:41:23.073247+0000","last_peered":"2024-09-11T14:41:23.073247+0000","last_clean":"2024-09-11T14:41:23.073247+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:41:23.073247+0000","last_undegraded":"2024-09-11T14:41:23.073247+0000","last_fullsized":"2024-09-11T14:41:23.073247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22216704,"num_objects":339,"num_object_clones":0,"num_object_copies":1017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.217608+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:40:31.217608+0000","last_peered":"2024-09-11T14:40:31.217608+0000","last_clean":"2024-09-11T14:40:31.217608+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:40:31.217608+0000","last_undegraded":"2024-09-11T14:40:31.217608+0000","last_fullsized":"2024-09-11T14:40:31.217608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"47'492","reported_seq":528,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:22.930662+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:41:22.930662+0000","last_peered":"2024-09-11T14:41:22.930662+0000","last_clean":"2024-09-11T14:41:22.930662+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:41:22.930662+0000","last_undegraded":"2024-09-11T14:41:22.930662+0000","last_fullsized":"2024-09-11T14:41:22.930662+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21889024,"num_objects":334,"num_object_clones":0,"num_object_copies":1002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":492,"num_write_kb":26432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":111,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.113990+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:40:31.113990+0000","last_peered":"2024-09-11T14:40:31.113990+0000","last_clean":"2024-09-11T14:40:31.113990+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:40:31.113990+0000","last_undegraded":"2024-09-11T14:40:31.113990+0000","last_fullsized":"2024-09-11T14:40:31.113990+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"47'444","reported_seq":480,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:22.981786+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:41:22.981786+0000","last_peered":"2024-09-11T14:41:22.981786+0000","last_clean":"2024-09-11T14:41:22.981786+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:41:22.981786+0000","last_undegraded":"2024-09-11T14:41:22.981786+0000","last_fullsized":"2024-09-11T14:41:22.981786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18350080,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":444,"num_write_kb":23168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.890413+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:40:30.890413+0000","last_peered":"2024-09-11T14:40:30.890413+0000","last_clean":"2024-09-11T14:40:30.890413+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:40:30.890413+0000","last_undegraded":"2024-09-11T14:40:30.890413+0000","last_fullsized":"2024-09-11T14:40:30.890413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"47'482","reported_seq":518,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:23.386925+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:41:23.386925+0000","last_peered":"2024-09-11T14:41:23.386925+0000","last_clean":"2024-09-11T14:41:23.386925+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:41:23.386925+0000","last_undegraded":"2024-09-11T14:41:23.386925+0000","last_fullsized":"2024-09-11T14:41:23.386925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":482,"num_write_kb":26304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.909268+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:30.909268+0000","last_peered":"2024-09-11T14:40:30.909268+0000","last_clean":"2024-09-11T14:40:30.909268+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:40:30.909268+0000","last_undegraded":"2024-09-11T14:40:30.909268+0000","last_fullsized":"2024-09-11T14:40:30.909268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"47'479","reported_seq":515,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:23.339437+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:41:23.339437+0000","last_peered":"2024-09-11T14:41:23.339437+0000","last_clean":"2024-09-11T14:41:23.339437+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:41:23.339437+0000","last_undegraded":"2024-09-11T14:41:23.339437+0000","last_fullsized":"2024-09-11T14:41:23.339437+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20512768,"num_objects":313,"num_object_clones":0,"num_object_copies":939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":479,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:30.878614+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:40:30.878614+0000","last_peered":"2024-09-11T14:40:30.878614+0000","last_clean":"2024-09-11T14:40:30.878614+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:40:30.878614+0000","last_undegraded":"2024-09-11T14:40:30.878614+0000","last_fullsized":"2024-09-11T14:40:30.878614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"47'501","reported_seq":537,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:41:22.805108+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:41:22.805108+0000","last_peered":"2024-09-11T14:41:22.805108+0000","last_clean":"2024-09-11T14:41:22.805108+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:41:22.805108+0000","last_undegraded":"2024-09-11T14:41:22.805108+0000","last_fullsized":"2024-09-11T14:41:22.805108+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21823488,"num_objects":333,"num_object_clones":0,"num_object_copies":999,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":501,"num_write_kb":26688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T14:40:31.239377+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:40:31.239377+0000","last_peered":"2024-09-11T14:40:31.239377+0000","last_clean":"2024-09-11T14:40:31.239377+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:40:31.239377+0000","last_undegraded":"2024-09-11T14:40:31.239377+0000","last_fullsized":"2024-09-11T14:40:31.239377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":332660760,"num_objects":5077,"num_object_clones":0,"num_object_copies":15231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7781,"num_write_kb":411393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212188925952,"internally_reserved":0,"allocated":2022567936,"data_stored":2022567936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7781,"ondisk_log_size":7781,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212188794880,"internally_reserved":0,"allocated":2022699008,"data_stored":2022699008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53017399296,"internally_reserved":0,"allocated":535474176,"data_stored":535474176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673279,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":529968,"kb_used_data":529968,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51767760,"statfs":{"total":53552873472,"available":53010186240,"internally_reserved":0,"allocated":542687232,"data_stored":542687232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":420712,"kb_used_data":420712,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51877016,"statfs":{"total":53552873472,"available":53122064384,"internally_reserved":0,"allocated":430809088,"data_stored":430809088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":511140,"kb_used_data":511140,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51786588,"statfs":{"total":53552873472,"available":53029466112,"internally_reserved":0,"allocated":523407360,"data_stored":523407360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":538108,"kb_used_data":538108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51759620,"statfs":{"total":53552873472,"available":53001850880,"internally_reserved":0,"allocated":551022592,"data_stored":551022592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53017399296,"internally_reserved":0,"allocated":535474176,"data_stored":535474176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53035315200,"internally_reserved":0,"allocated":517558272,"data_stored":517558272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53010276352,"internally_reserved":0,"allocated":542597120,"data_stored":542597120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53125804032,"internally_reserved":0,"allocated":427069440,"data_stored":427069440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53017399296,"internally_reserved":0,"allocated":535474176,"data_stored":535474176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53035315200,"internally_reserved":0,"allocated":517558272,"data_stored":517558272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53010407424,"internally_reserved":0,"allocated":542466048,"data_stored":542466048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53125804032,"internally_reserved":0,"allocated":427069440,"data_stored":427069440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53017399296,"internally_reserved":0,"allocated":535474176,"data_stored":535474176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:41:28.962 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T14:41:28.962 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:41:28.962 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:41:28.962 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:41:29.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:29.142+0000 7f000c551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:29.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:29.160+0000 7f000c551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:29.342 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:29.343 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:29.343 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:29.343 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:29.343 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:29.343 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:29.343 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:29.343 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:29.343 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:29.343 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:29.343 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:29.343 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:29.346 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:29.346 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:29.347 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:41:29.476 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:41:29.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:29.476+0000 7f13ba791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:29.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:29.491+0000 7f13ba791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:29.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:29.654+0000 7f4abf551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:29.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:29.664+0000 7f4abf551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:29.701 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:29.701 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:29.701 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:29.701 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:29.701 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:29.701 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:29.701 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:29.701 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:29.701 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:29.701 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:29.701 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:29.702 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:29.705 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:29.706 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:29.706 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:41:29.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:29.898+0000 7f53dd351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:29.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:29.917+0000 7f53dd351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:29.941 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:29.941 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:29.941 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:29.942 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:29.942 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:29.942 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:29.942 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:29.942 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:29.942 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:29.942 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:29.942 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:29.942 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:29.945 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:29.946 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:29.946 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:41:30.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:30.109+0000 7f74a8791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:30.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:30.122+0000 7f74a8791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:30.167 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:30.167 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:30.167 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:30.169 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:30.170 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:32.224 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:41:32.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:32.351+0000 7f1fbdb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:32.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:32.359+0000 7f1fbdb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:34.836 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:41:34.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:34.973+0000 7fe217f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:34.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:34.984+0000 7fe217f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:35.170 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:41:35.171 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:41:35.171 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:41:35.171 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:41:35.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:35.296+0000 7fcd56474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:35.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:35.310+0000 7fcd56474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:35.459 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:35.459 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:35.459 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:35.460 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:35.460 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:35.460 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:35.460 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:35.460 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:35.460 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:35.460 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:35.460 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:35.460 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:35.463 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:35.463 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:35.464 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:41:35.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:35.619+0000 7f9059751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:35.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:35.634+0000 7f9059751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:35.826 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:35.827 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:35.827 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:41:36.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:35.991+0000 7f20e1351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:36.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:36.009+0000 7f20e1351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:36.075 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:36.075 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:36.075 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:36.075 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:36.075 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:36.076 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:36.076 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:36.076 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:36.076 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:36.076 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:36.076 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:36.076 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:36.079 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:36.080 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:36.080 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:41:36.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:36.240+0000 7f7ba4cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:36.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:36.254+0000 7f7ba4cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:36.351 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:36.351 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:36.351 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:36.351 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:36.351 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:36.351 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:36.351 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:36.351 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:36.352 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:36.352 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:36.352 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:36.352 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:36.355 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:36.356 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:37.500 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:41:37.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:37.670+0000 7f1b58711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:37.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:37.680+0000 7f1b58711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:40.483 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:41:40.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:40.660+0000 7f06afcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:40.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:40.672+0000 7f06afcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:41.356 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:41:41.357 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:41:41.357 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:41:41.357 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:41:41.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:41.509+0000 7f0e49191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:41.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:41.522+0000 7f0e49191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:41.731 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:41.731 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:41.731 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:41.732 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:41.732 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:41.732 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:41.732 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:41.732 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:41.732 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:41.732 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:41.732 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:41.732 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:41.734 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:41.735 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:41.735 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:41:41.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:41.900+0000 7fb446391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:41.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:41.914+0000 7fb446391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:42.077 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:42.077 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:42.077 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:42.077 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:42.077 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:42.077 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:42.077 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:42.077 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:42.077 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:42.078 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:42.078 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:42.078 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:42.081 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:42.082 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:42.082 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:41:42.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:42.216+0000 7fdc6e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:42.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:42.234+0000 7fdc6e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:42.341 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:42.341 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:42.341 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:42.342 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:42.342 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:42.342 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:42.342 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:42.342 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:42.342 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:42.342 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:42.342 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:42.342 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:42.346 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:42.347 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:42.347 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:41:42.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:42.522+0000 7f8b15f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:42.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:42.537+0000 7f8b15f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:42.640 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:42.640 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:42.640 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:42.641 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:42.641 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:42.641 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:42.641 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:42.641 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:42.641 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:42.641 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:42.641 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:42.641 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:42.643 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:42.644 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:43.124 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:41:43.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:43.254+0000 7fcc05b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:43.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:43.261+0000 7fcc05b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:45.895 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:41:46.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:46.041+0000 7f63e9791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:46.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:46.052+0000 7f63e9791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:47.645 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:41:47.645 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:41:47.646 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:41:47.646 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:41:47.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:47.797+0000 7f3881191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:47.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:47.809+0000 7f3881191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:48.086 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:48.086 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:48.087 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:48.087 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:48.087 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:48.087 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:48.087 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:48.087 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:48.087 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:48.087 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:48.087 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:48.087 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:48.090 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:48.091 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:48.091 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:41:48.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:48.267+0000 7fcbe6088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:48.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:48.280+0000 7fcbe6088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:48.451 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:48.451 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:48.451 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:48.451 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:48.451 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:48.451 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:48.451 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:48.451 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:48.452 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:48.452 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:48.452 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:48.452 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:48.456 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:48.456 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:48.456 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:41:48.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:48.579+0000 7f29dbf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:48.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:48.592+0000 7f29dbf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:48.634 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:48.635 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:48.635 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:48.635 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:48.635 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:48.635 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:48.635 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:48.635 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:48.635 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:48.635 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:48.635 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:48.635 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:48.639 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:48.640 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:48.640 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:41:48.712 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:41:48.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:48.757+0000 7fa7bb057640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:48.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:48.769+0000 7fa7bb057640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:48.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:48.860+0000 7fa9bab11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:48.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:48.867+0000 7fa9bab11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:48.890 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:48.890 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:51.563 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:41:51.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:51.697+0000 7fe5f7151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:51.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:51.704+0000 7fe5f7151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:53.891 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:41:53.891 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:41:53.891 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:41:53.891 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:41:54.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:54.042+0000 7fc8c7ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:54.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:54.054+0000 7fc8c7ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:54.339 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:54.339 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:54.339 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:54.339 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:54.339 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:54.339 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:54.339 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:54.339 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:54.340 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:54.340 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:54.340 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:54.340 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:54.342 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:54.342 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:54.343 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:41:54.350 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:41:54.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:54.482+0000 7f51c0b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:54.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:54.499+0000 7f51c0b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:54.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:54.531+0000 7fdea2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:54.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:54.538+0000 7fdea2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:54.712 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:54.713 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:54.713 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:54.713 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:54.713 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:54.713 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:54.713 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:54.713 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:54.713 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:54.713 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:54.713 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:54.713 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:54.717 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:54.717 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:54.717 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:41:54.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:54.839+0000 7f1c52f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:54.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:54.857+0000 7f1c52f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:54.881 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:54.881 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:54.881 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:54.882 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:54.882 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:54.882 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:54.882 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:54.882 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:54.882 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:54.882 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:54.882 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:54.882 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:54.885 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:54.885 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:54.885 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:41:55.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:55.016+0000 7f7243191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:55.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:55.034+0000 7f7243191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:55.224 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:41:55.225 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:41:55.225 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:41:55.225 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:41:55.225 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:41:55.225 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:41:55.225 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:41:55.228 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:41:55.228 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:41:55.228 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:41:55.228 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:41:55.228 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:41:55.229 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:41:55.230 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:41:57.155 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:41:57.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:57.294+0000 7f662ccbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:57.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:57.304+0000 7f662ccbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:59.840 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:41:59.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:59.989+0000 7fea1af11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:41:59.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:41:59.997+0000 7fea1af11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:00.231 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:42:00.231 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:42:00.231 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:42:00.231 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:42:00.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:00.350+0000 7fc0f1297640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:00.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:00.363+0000 7fc0f1297640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:00.414 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:00.415 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:00.415 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:00.415 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:00.415 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:00.415 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:00.415 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:00.415 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:00.415 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:00.415 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:00.415 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:00.415 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:00.418 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:00.418 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:00.419 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:42:00.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:00.565+0000 7f5cf7151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:00.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:00.582+0000 7f5cf7151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:00.726 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:00.726 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:00.726 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:00.726 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:00.726 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:00.726 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:00.727 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:00.727 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:00.727 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:00.728 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:00.728 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:00.728 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:00.730 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:00.730 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:00.730 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:42:00.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:00.913+0000 7f3c5c2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:00.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:00.927+0000 7f3c5c2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:01.076 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:01.076 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:01.076 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:01.076 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:01.076 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:01.076 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:01.076 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:01.076 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:01.077 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:01.077 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:01.077 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:01.077 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:01.079 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:01.079 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:01.080 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:42:01.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:01.211+0000 7f0b7e874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:01.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:01.221+0000 7f0b7e874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:01.317 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:01.317 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:01.317 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:01.317 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:01.317 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:01.317 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:01.318 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:01.318 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:01.318 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:01.318 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:01.318 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:01.318 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:01.321 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:01.321 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:02.710 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:42:02.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:02.881+0000 7fd255c23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:02.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:02.891+0000 7fd255c23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:05.494 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:42:05.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:05.632+0000 7f1d7d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:05.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:05.641+0000 7f1d7d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:06.322 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:42:06.322 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:42:06.322 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:42:06.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:06.454+0000 7fe7a48fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:06.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:06.463+0000 7fe7a48fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:06.790 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:42:06.791 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:42:06.808 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-09-11T14:42:05.297161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":138478155,"num_objects":2109,"num_object_clones":0,"num_object_copies":6327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":10834,"num_write_kb":412501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10808,"ondisk_log_size":10808,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":851880,"kb_used_data":851880,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208339032,"statfs":{"total":214211493888,"available":213339168768,"internally_reserved":0,"allocated":872325120,"data_stored":872325120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-62324736,"num_objects":-951,"num_object_clones":0,"num_object_copies":-2853,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":951,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002402"},"pg_stats":[{"pgid":"4.f","version":"51'692","reported_seq":740,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:03.123178+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:42:03.123178+0000","last_peered":"2024-09-11T14:42:03.123178+0000","last_clean":"2024-09-11T14:42:03.123178+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:42:03.123178+0000","last_undegraded":"2024-09-11T14:42:03.123178+0000","last_fullsized":"2024-09-11T14:42:03.123178+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":692,"log_dups_size":0,"ondisk_log_size":692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699328,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":692,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"51'625","reported_seq":673,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:02.756426+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:42:02.756426+0000","last_peered":"2024-09-11T14:42:02.756426+0000","last_clean":"2024-09-11T14:42:02.756426+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:42:02.756426+0000","last_undegraded":"2024-09-11T14:42:02.756426+0000","last_fullsized":"2024-09-11T14:42:02.756426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":625,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"51'656","reported_seq":705,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:03.241622+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:42:03.241622+0000","last_peered":"2024-09-11T14:42:03.241622+0000","last_clean":"2024-09-11T14:42:03.241622+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:42:03.241622+0000","last_undegraded":"2024-09-11T14:42:03.241622+0000","last_fullsized":"2024-09-11T14:42:03.241622+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847384,"num_objects":136,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":656,"num_write_kb":25281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"51'718","reported_seq":766,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:03.901538+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:42:03.901538+0000","last_peered":"2024-09-11T14:42:03.901538+0000","last_clean":"2024-09-11T14:42:03.901538+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:42:03.901538+0000","last_undegraded":"2024-09-11T14:42:03.901538+0000","last_fullsized":"2024-09-11T14:42:03.901538+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":718,"log_dups_size":0,"ondisk_log_size":718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":27264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"51'718","reported_seq":766,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:03.177362+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:42:03.177362+0000","last_peered":"2024-09-11T14:42:03.177362+0000","last_clean":"2024-09-11T14:42:03.177362+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:42:03.177362+0000","last_undegraded":"2024-09-11T14:42:03.177362+0000","last_fullsized":"2024-09-11T14:42:03.177362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":718,"log_dups_size":0,"ondisk_log_size":718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":27456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"51'662","reported_seq":710,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:02.933612+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:42:02.933612+0000","last_peered":"2024-09-11T14:42:02.933612+0000","last_clean":"2024-09-11T14:42:02.933612+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:42:02.933612+0000","last_undegraded":"2024-09-11T14:42:02.933612+0000","last_fullsized":"2024-09-11T14:42:02.933612+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":662,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"51'633","reported_seq":681,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:03.034002+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:42:03.034002+0000","last_peered":"2024-09-11T14:42:03.034002+0000","last_clean":"2024-09-11T14:42:03.034002+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:42:03.034002+0000","last_undegraded":"2024-09-11T14:42:03.034002+0000","last_fullsized":"2024-09-11T14:42:03.034002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":633,"num_write_kb":24128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"51'632","reported_seq":680,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:03.154085+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:42:03.154085+0000","last_peered":"2024-09-11T14:42:03.154085+0000","last_clean":"2024-09-11T14:42:03.154085+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:42:03.154085+0000","last_undegraded":"2024-09-11T14:42:03.154085+0000","last_fullsized":"2024-09-11T14:42:03.154085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":24448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"51'676","reported_seq":724,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:02.694840+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:42:02.694840+0000","last_peered":"2024-09-11T14:42:02.694840+0000","last_clean":"2024-09-11T14:42:02.694840+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:42:02.694840+0000","last_undegraded":"2024-09-11T14:42:02.694840+0000","last_fullsized":"2024-09-11T14:42:02.694840+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":676,"num_write_kb":25152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":193,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.178792+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:41:28.178792+0000","last_peered":"2024-09-11T14:41:28.178792+0000","last_clean":"2024-09-11T14:41:28.178792+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:41:28.178792+0000","last_undegraded":"2024-09-11T14:41:28.178792+0000","last_fullsized":"2024-09-11T14:41:28.178792+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":122,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.084337+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:41:28.084337+0000","last_peered":"2024-09-11T14:41:28.084337+0000","last_clean":"2024-09-11T14:41:28.084337+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:41:28.084337+0000","last_undegraded":"2024-09-11T14:41:28.084337+0000","last_fullsized":"2024-09-11T14:41:28.084337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"51'703","reported_seq":751,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:03.065664+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:42:03.065664+0000","last_peered":"2024-09-11T14:42:03.065664+0000","last_clean":"2024-09-11T14:42:03.065664+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:42:03.065664+0000","last_undegraded":"2024-09-11T14:42:03.065664+0000","last_fullsized":"2024-09-11T14:42:03.065664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":703,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.035538+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:41:28.035538+0000","last_peered":"2024-09-11T14:41:28.035538+0000","last_clean":"2024-09-11T14:41:28.035538+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:41:28.035538+0000","last_undegraded":"2024-09-11T14:41:28.035538+0000","last_fullsized":"2024-09-11T14:41:28.035538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"51'694","reported_seq":742,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:02.686030+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:42:02.686030+0000","last_peered":"2024-09-11T14:42:02.686030+0000","last_clean":"2024-09-11T14:42:02.686030+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:42:02.686030+0000","last_undegraded":"2024-09-11T14:42:02.686030+0000","last_fullsized":"2024-09-11T14:42:02.686030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699328,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":694,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.077878+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:41:28.077878+0000","last_peered":"2024-09-11T14:41:28.077878+0000","last_clean":"2024-09-11T14:41:28.077878+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:41:28.077878+0000","last_undegraded":"2024-09-11T14:41:28.077878+0000","last_fullsized":"2024-09-11T14:41:28.077878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"51'679","reported_seq":727,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:03.036107+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:42:03.036107+0000","last_peered":"2024-09-11T14:42:03.036107+0000","last_clean":"2024-09-11T14:42:03.036107+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:42:03.036107+0000","last_undegraded":"2024-09-11T14:42:03.036107+0000","last_fullsized":"2024-09-11T14:42:03.036107+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9633792,"num_objects":147,"num_object_clones":0,"num_object_copies":441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":679,"num_write_kb":26432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":123,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.029310+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:41:28.029310+0000","last_peered":"2024-09-11T14:41:28.029310+0000","last_clean":"2024-09-11T14:41:28.029310+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:41:28.029310+0000","last_undegraded":"2024-09-11T14:41:28.029310+0000","last_fullsized":"2024-09-11T14:41:28.029310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"51'603","reported_seq":651,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:01.470743+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:42:01.470743+0000","last_peered":"2024-09-11T14:42:01.470743+0000","last_clean":"2024-09-11T14:42:01.470743+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:42:01.470743+0000","last_undegraded":"2024-09-11T14:42:01.470743+0000","last_fullsized":"2024-09-11T14:42:01.470743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":23168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:27.946865+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:41:27.946865+0000","last_peered":"2024-09-11T14:41:27.946865+0000","last_clean":"2024-09-11T14:41:27.946865+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:41:27.946865+0000","last_undegraded":"2024-09-11T14:41:27.946865+0000","last_fullsized":"2024-09-11T14:41:27.946865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"51'689","reported_seq":737,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:02.900845+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:42:02.900845+0000","last_peered":"2024-09-11T14:42:02.900845+0000","last_clean":"2024-09-11T14:42:02.900845+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:42:02.900845+0000","last_undegraded":"2024-09-11T14:42:02.900845+0000","last_fullsized":"2024-09-11T14:42:02.900845+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":689,"log_dups_size":0,"ondisk_log_size":689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":689,"num_write_kb":26304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.188775+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:41:28.188775+0000","last_peered":"2024-09-11T14:41:28.188775+0000","last_clean":"2024-09-11T14:41:28.188775+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:41:28.188775+0000","last_undegraded":"2024-09-11T14:41:28.188775+0000","last_fullsized":"2024-09-11T14:41:28.188775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"51'671","reported_seq":719,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:03.127440+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:42:03.127440+0000","last_peered":"2024-09-11T14:42:03.127440+0000","last_clean":"2024-09-11T14:42:03.127440+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:42:03.127440+0000","last_undegraded":"2024-09-11T14:42:03.127440+0000","last_fullsized":"2024-09-11T14:42:03.127440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:27.944308+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:41:27.944308+0000","last_peered":"2024-09-11T14:41:27.944308+0000","last_clean":"2024-09-11T14:41:27.944308+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:41:27.944308+0000","last_undegraded":"2024-09-11T14:41:27.944308+0000","last_fullsized":"2024-09-11T14:41:27.944308+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"51'702","reported_seq":750,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:03.155727+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:42:03.155727+0000","last_peered":"2024-09-11T14:42:03.155727+0000","last_clean":"2024-09-11T14:42:03.155727+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:42:03.155727+0000","last_undegraded":"2024-09-11T14:42:03.155727+0000","last_fullsized":"2024-09-11T14:42:03.155727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":702,"num_write_kb":26688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.085103+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:41:28.085103+0000","last_peered":"2024-09-11T14:41:28.085103+0000","last_clean":"2024-09-11T14:41:28.085103+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:41:28.085103+0000","last_undegraded":"2024-09-11T14:41:28.085103+0000","last_fullsized":"2024-09-11T14:41:28.085103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":137887768,"num_objects":2105,"num_object_clones":0,"num_object_copies":6315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10753,"num_write_kb":411393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213355601920,"internally_reserved":0,"allocated":855891968,"data_stored":855891968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10753,"ondisk_log_size":10753,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213355470848,"internally_reserved":0,"allocated":856023040,"data_stored":856023040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53327867904,"internally_reserved":0,"allocated":225005568,"data_stored":225005568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":224200,"kb_used_data":224200,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52073528,"statfs":{"total":53552873472,"available":53323292672,"internally_reserved":0,"allocated":229580800,"data_stored":229580800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":182648,"kb_used_data":182648,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52115080,"statfs":{"total":53552873472,"available":53365841920,"internally_reserved":0,"allocated":187031552,"data_stored":187031552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":215120,"kb_used_data":215120,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52082608,"statfs":{"total":53552873472,"available":53332590592,"internally_reserved":0,"allocated":220282880,"data_stored":220282880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":229912,"kb_used_data":229912,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52067816,"statfs":{"total":53552873472,"available":53317443584,"internally_reserved":0,"allocated":235429888,"data_stored":235429888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53327867904,"internally_reserved":0,"allocated":225005568,"data_stored":225005568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53335904256,"internally_reserved":0,"allocated":216969216,"data_stored":216969216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53323493376,"internally_reserved":0,"allocated":229380096,"data_stored":229380096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53368205312,"internally_reserved":0,"allocated":184668160,"data_stored":184668160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53327867904,"internally_reserved":0,"allocated":225005568,"data_stored":225005568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53335904256,"internally_reserved":0,"allocated":216969216,"data_stored":216969216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53323493376,"internally_reserved":0,"allocated":229380096,"data_stored":229380096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53368205312,"internally_reserved":0,"allocated":184668160,"data_stored":184668160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53327998976,"internally_reserved":0,"allocated":224874496,"data_stored":224874496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:42:08.306 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:42:08.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:08.420+0000 7f3966151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:08.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:08.426+0000 7f3966151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:10.984 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:42:11.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:11.114+0000 7f45d6e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:11.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:11.122+0000 7f45d6e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:11.811 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:42:11.811 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:42:11.811 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:42:11.811 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:42:11.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:11.969+0000 7fded6d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:11.984+0000 7fded6d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:12.006 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:12.006 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:12.006 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:12.007 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:12.007 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:12.007 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:12.007 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:12.007 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:12.007 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:12.007 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:12.007 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:12.007 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:12.012 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:12.012 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:12.013 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:42:12.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:12.133+0000 7fc2b52fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:12.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:12.144+0000 7fc2b52fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:12.310 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:12.310 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:12.310 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:12.310 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:12.310 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:12.310 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:12.313 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:12.313 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:12.314 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:42:12.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:12.472+0000 7fe0c6191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:12.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:12.490+0000 7fe0c6191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:12.575 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:12.575 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:12.575 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:12.575 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:12.575 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:12.575 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:12.575 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:12.575 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:12.576 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:12.576 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:12.576 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:12.576 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:12.580 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:12.580 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:12.580 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:42:12.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:12.758+0000 7fbd0f748640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:12.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:12.775+0000 7fbd0f748640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:12.840 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:12.840 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:12.840 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:12.840 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:12.840 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:12.841 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:12.841 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:12.841 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:12.841 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:12.841 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:12.841 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:12.841 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:12.844 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:12.844 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:13.621 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:42:13.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:13.777+0000 7f9e03791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:13.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:13.785+0000 7f9e03791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:16.432 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:42:16.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:16.557+0000 7f1009ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:16.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:16.565+0000 7f1009ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:17.845 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:42:17.845 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:42:17.845 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:42:17.846 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:42:17.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:17.988+0000 7f226b951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:18.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:18.001+0000 7f226b951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:18.100 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:18.100 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:18.101 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:18.101 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:18.101 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:18.101 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:18.101 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:18.101 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:18.101 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:18.102 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:18.102 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:18.102 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:18.104 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:18.104 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:18.105 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:42:18.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:18.242+0000 7f34bba9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:18.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:18.255+0000 7f34bba9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:18.421 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:18.421 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:18.421 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:18.421 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:18.424 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:18.425 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:18.425 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:42:18.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:18.562+0000 7f4083874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:18.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:18.574+0000 7f4083874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:18.772 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:18.772 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:18.772 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:18.772 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:18.772 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:18.773 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:18.773 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:18.773 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:18.773 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:18.773 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:18.773 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:18.773 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:18.776 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:18.777 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:18.777 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:42:18.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:18.952+0000 7f98a0688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:18.972 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:42:18.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:18.971+0000 7f98a0688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:19.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:19.127+0000 7fc19b6fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:19.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:19.135+0000 7fc19a49b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:19.141 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:19.141 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:19.141 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:19.141 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:19.141 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:19.141 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:19.141 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:19.141 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:19.142 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:19.142 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:19.142 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:19.142 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:19.146 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:19.146 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:21.810 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:42:21.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:21.934+0000 7f0065b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:21.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:21.944+0000 7f0065b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:24.147 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:42:24.147 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:42:24.147 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:42:24.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:24.316+0000 7fa971551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:24.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:24.334+0000 7fa971551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:24.614 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:42:24.713 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:42:24.714 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:42:24.735 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2024-09-11T14:42:23.301075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68223563,"num_objects":1037,"num_object_clones":0,"num_object_copies":3111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":11906,"num_write_kb":412501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11880,"ondisk_log_size":11880,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":439320,"kb_used_data":439320,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208751592,"statfs":{"total":214211493888,"available":213761630208,"internally_reserved":0,"allocated":449863680,"data_stored":449863680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-50266112,"num_objects":-767,"num_object_clones":0,"num_object_copies":-2301,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002478"},"pg_stats":[{"pgid":"4.f","version":"51'766","reported_seq":814,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:18.015316+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:42:18.015316+0000","last_peered":"2024-09-11T14:42:18.015316+0000","last_clean":"2024-09-11T14:42:18.015316+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:42:18.015316+0000","last_undegraded":"2024-09-11T14:42:18.015316+0000","last_fullsized":"2024-09-11T14:42:18.015316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"51'681","reported_seq":729,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:18.248934+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:42:18.248934+0000","last_peered":"2024-09-11T14:42:18.248934+0000","last_clean":"2024-09-11T14:42:18.248934+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:42:18.248934+0000","last_undegraded":"2024-09-11T14:42:18.248934+0000","last_fullsized":"2024-09-11T14:42:18.248934+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"51'727","reported_seq":776,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:18.234006+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:42:18.234006+0000","last_peered":"2024-09-11T14:42:18.234006+0000","last_clean":"2024-09-11T14:42:18.234006+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:42:18.234006+0000","last_undegraded":"2024-09-11T14:42:18.234006+0000","last_fullsized":"2024-09-11T14:42:18.234006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194328,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":727,"num_write_kb":25281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"51'786","reported_seq":834,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:19.420571+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:42:19.420571+0000","last_peered":"2024-09-11T14:42:19.420571+0000","last_clean":"2024-09-11T14:42:19.420571+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:42:19.420571+0000","last_undegraded":"2024-09-11T14:42:19.420571+0000","last_fullsized":"2024-09-11T14:42:19.420571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":27264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"51'794","reported_seq":842,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:18.230099+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:42:18.230099+0000","last_peered":"2024-09-11T14:42:18.230099+0000","last_clean":"2024-09-11T14:42:18.230099+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:42:18.230099+0000","last_undegraded":"2024-09-11T14:42:18.230099+0000","last_fullsized":"2024-09-11T14:42:18.230099+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":794,"num_write_kb":27456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"51'728","reported_seq":776,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:17.733289+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:42:17.733289+0000","last_peered":"2024-09-11T14:42:17.733289+0000","last_clean":"2024-09-11T14:42:17.733289+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:42:17.733289+0000","last_undegraded":"2024-09-11T14:42:17.733289+0000","last_fullsized":"2024-09-11T14:42:17.733289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":728,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"51'703","reported_seq":751,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:17.852093+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:42:17.852093+0000","last_peered":"2024-09-11T14:42:17.852093+0000","last_clean":"2024-09-11T14:42:17.852093+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:42:17.852093+0000","last_undegraded":"2024-09-11T14:42:17.852093+0000","last_fullsized":"2024-09-11T14:42:17.852093+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":703,"num_write_kb":24128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"51'697","reported_seq":745,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:18.226207+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:42:18.226207+0000","last_peered":"2024-09-11T14:42:18.226207+0000","last_clean":"2024-09-11T14:42:18.226207+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:42:18.226207+0000","last_undegraded":"2024-09-11T14:42:18.226207+0000","last_fullsized":"2024-09-11T14:42:18.226207+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":697,"num_write_kb":24448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"51'738","reported_seq":786,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:18.150742+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:42:18.150742+0000","last_peered":"2024-09-11T14:42:18.150742+0000","last_clean":"2024-09-11T14:42:18.150742+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:42:18.150742+0000","last_undegraded":"2024-09-11T14:42:18.150742+0000","last_fullsized":"2024-09-11T14:42:18.150742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":25152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":193,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.178792+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:41:28.178792+0000","last_peered":"2024-09-11T14:41:28.178792+0000","last_clean":"2024-09-11T14:41:28.178792+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:41:28.178792+0000","last_undegraded":"2024-09-11T14:41:28.178792+0000","last_fullsized":"2024-09-11T14:41:28.178792+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":122,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.084337+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:41:28.084337+0000","last_peered":"2024-09-11T14:41:28.084337+0000","last_clean":"2024-09-11T14:41:28.084337+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:41:28.084337+0000","last_undegraded":"2024-09-11T14:41:28.084337+0000","last_fullsized":"2024-09-11T14:41:28.084337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"51'774","reported_seq":822,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:18.270146+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:42:18.270146+0000","last_peered":"2024-09-11T14:42:18.270146+0000","last_clean":"2024-09-11T14:42:18.270146+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:42:18.270146+0000","last_undegraded":"2024-09-11T14:42:18.270146+0000","last_fullsized":"2024-09-11T14:42:18.270146+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.035538+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:41:28.035538+0000","last_peered":"2024-09-11T14:41:28.035538+0000","last_clean":"2024-09-11T14:41:28.035538+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:41:28.035538+0000","last_undegraded":"2024-09-11T14:41:28.035538+0000","last_fullsized":"2024-09-11T14:41:28.035538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"51'767","reported_seq":815,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:18.082360+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:42:18.082360+0000","last_peered":"2024-09-11T14:42:18.082360+0000","last_clean":"2024-09-11T14:42:18.082360+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:42:18.082360+0000","last_undegraded":"2024-09-11T14:42:18.082360+0000","last_fullsized":"2024-09-11T14:42:18.082360+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.077878+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:41:28.077878+0000","last_peered":"2024-09-11T14:41:28.077878+0000","last_clean":"2024-09-11T14:41:28.077878+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:41:28.077878+0000","last_undegraded":"2024-09-11T14:41:28.077878+0000","last_fullsized":"2024-09-11T14:41:28.077878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"51'745","reported_seq":793,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:17.972282+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:42:17.972282+0000","last_peered":"2024-09-11T14:42:17.972282+0000","last_clean":"2024-09-11T14:42:17.972282+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:42:17.972282+0000","last_undegraded":"2024-09-11T14:42:17.972282+0000","last_fullsized":"2024-09-11T14:42:17.972282+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":745,"num_write_kb":26432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":123,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.029310+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:41:28.029310+0000","last_peered":"2024-09-11T14:41:28.029310+0000","last_clean":"2024-09-11T14:41:28.029310+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:41:28.029310+0000","last_undegraded":"2024-09-11T14:41:28.029310+0000","last_fullsized":"2024-09-11T14:41:28.029310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"51'669","reported_seq":717,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:17.799642+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:42:17.799642+0000","last_peered":"2024-09-11T14:42:17.799642+0000","last_clean":"2024-09-11T14:42:17.799642+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:42:17.799642+0000","last_undegraded":"2024-09-11T14:42:17.799642+0000","last_fullsized":"2024-09-11T14:42:17.799642+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":23168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:27.946865+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:41:27.946865+0000","last_peered":"2024-09-11T14:41:27.946865+0000","last_clean":"2024-09-11T14:41:27.946865+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:41:27.946865+0000","last_undegraded":"2024-09-11T14:41:27.946865+0000","last_fullsized":"2024-09-11T14:41:27.946865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"51'752","reported_seq":800,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:18.341346+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:42:18.341346+0000","last_peered":"2024-09-11T14:42:18.341346+0000","last_clean":"2024-09-11T14:42:18.341346+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:42:18.341346+0000","last_undegraded":"2024-09-11T14:42:18.341346+0000","last_fullsized":"2024-09-11T14:42:18.341346+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":26304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.188775+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:41:28.188775+0000","last_peered":"2024-09-11T14:41:28.188775+0000","last_clean":"2024-09-11T14:41:28.188775+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:41:28.188775+0000","last_undegraded":"2024-09-11T14:41:28.188775+0000","last_fullsized":"2024-09-11T14:41:28.188775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"51'734","reported_seq":782,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:17.746488+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:42:17.746488+0000","last_peered":"2024-09-11T14:42:17.746488+0000","last_clean":"2024-09-11T14:42:17.746488+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:42:17.746488+0000","last_undegraded":"2024-09-11T14:42:17.746488+0000","last_fullsized":"2024-09-11T14:42:17.746488+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:27.944308+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:41:27.944308+0000","last_peered":"2024-09-11T14:41:27.944308+0000","last_clean":"2024-09-11T14:41:27.944308+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:41:27.944308+0000","last_undegraded":"2024-09-11T14:41:27.944308+0000","last_fullsized":"2024-09-11T14:41:27.944308+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"51'764","reported_seq":812,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:18.164583+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:42:18.164583+0000","last_peered":"2024-09-11T14:42:18.164583+0000","last_clean":"2024-09-11T14:42:18.164583+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:42:18.164583+0000","last_undegraded":"2024-09-11T14:42:18.164583+0000","last_fullsized":"2024-09-11T14:42:18.164583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":764,"num_write_kb":26688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.085103+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:41:28.085103+0000","last_peered":"2024-09-11T14:41:28.085103+0000","last_clean":"2024-09-11T14:41:28.085103+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:41:28.085103+0000","last_undegraded":"2024-09-11T14:41:28.085103+0000","last_fullsized":"2024-09-11T14:41:28.085103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":67633176,"num_objects":1033,"num_object_clones":0,"num_object_copies":3099,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11825,"num_write_kb":411393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213783699456,"internally_reserved":0,"allocated":427794432,"data_stored":427794432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11825,"ondisk_log_size":11825,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213783433216,"internally_reserved":0,"allocated":428060672,"data_stored":428060672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53446184960,"internally_reserved":0,"allocated":106688512,"data_stored":106688512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673334,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":112296,"kb_used_data":112296,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52185432,"statfs":{"total":53552873472,"available":53437882368,"internally_reserved":0,"allocated":114991104,"data_stored":114991104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706038,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":96704,"kb_used_data":96704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52201024,"statfs":{"total":53552873472,"available":53453848576,"internally_reserved":0,"allocated":99024896,"data_stored":99024896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706038,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":110384,"kb_used_data":110384,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52187344,"statfs":{"total":53552873472,"available":53439840256,"internally_reserved":0,"allocated":113033216,"data_stored":113033216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706038,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":119936,"kb_used_data":119936,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52177792,"statfs":{"total":53552873472,"available":53430059008,"internally_reserved":0,"allocated":122814464,"data_stored":122814464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53446184960,"internally_reserved":0,"allocated":106688512,"data_stored":106688512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53443674112,"internally_reserved":0,"allocated":109199360,"data_stored":109199360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53435768832,"internally_reserved":0,"allocated":117104640,"data_stored":117104640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53457805312,"internally_reserved":0,"allocated":95068160,"data_stored":95068160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53446184960,"internally_reserved":0,"allocated":106688512,"data_stored":106688512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53443809280,"internally_reserved":0,"allocated":109064192,"data_stored":109064192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53435899904,"internally_reserved":0,"allocated":116973568,"data_stored":116973568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53457805312,"internally_reserved":0,"allocated":95068160,"data_stored":95068160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53446184960,"internally_reserved":0,"allocated":106688512,"data_stored":106688512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:42:24.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:24.770+0000 7fa954497640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:24.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:24.780+0000 7fa954497640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:27.500 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:42:27.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:27.651+0000 7f4883aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:27.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:27.660+0000 7f4883aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:29.737 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:42:29.737 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:42:29.737 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:42:29.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:29.864+0000 7f21ff391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:29.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:29.874+0000 7f21ff391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:29.966 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:42:30.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:30.078+0000 7fde228d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:30.085 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:42:30.086 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:42:30.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:30.084+0000 7fde228d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:30.102 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2024-09-11T14:42:29.302218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":10093131,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12793,"num_write_kb":412501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12767,"ondisk_log_size":12767,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":127288,"kb_used_data":127288,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209063624,"statfs":{"total":214211493888,"available":214081150976,"internally_reserved":0,"allocated":130342912,"data_stored":130342912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-84738048,"num_objects":-1293,"num_object_clones":0,"num_object_copies":-3879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1293,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002379"},"pg_stats":[{"pgid":"4.f","version":"51'831","reported_seq":879,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:28.059003+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:42:28.059003+0000","last_peered":"2024-09-11T14:42:28.059003+0000","last_clean":"2024-09-11T14:42:28.059003+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:42:28.059003+0000","last_undegraded":"2024-09-11T14:42:28.059003+0000","last_fullsized":"2024-09-11T14:42:28.059003+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":831,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"51'742","reported_seq":790,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:28.033976+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:42:28.033976+0000","last_peered":"2024-09-11T14:42:28.033976+0000","last_clean":"2024-09-11T14:42:28.033976+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:42:28.033976+0000","last_undegraded":"2024-09-11T14:42:28.033976+0000","last_fullsized":"2024-09-11T14:42:28.033976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"51'783","reported_seq":832,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:28.196563+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:42:28.196563+0000","last_peered":"2024-09-11T14:42:28.196563+0000","last_clean":"2024-09-11T14:42:28.196563+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:42:28.196563+0000","last_undegraded":"2024-09-11T14:42:28.196563+0000","last_fullsized":"2024-09-11T14:42:28.196563+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524312,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":783,"num_write_kb":25281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"51'819","reported_seq":867,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:24.244351+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:42:24.244351+0000","last_peered":"2024-09-11T14:42:24.244351+0000","last_clean":"2024-09-11T14:42:24.244351+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:42:24.244351+0000","last_undegraded":"2024-09-11T14:42:24.244351+0000","last_fullsized":"2024-09-11T14:42:24.244351+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":819,"num_write_kb":27264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"51'852","reported_seq":900,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:28.090165+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:42:28.090165+0000","last_peered":"2024-09-11T14:42:28.090165+0000","last_clean":"2024-09-11T14:42:28.090165+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:42:28.090165+0000","last_undegraded":"2024-09-11T14:42:28.090165+0000","last_fullsized":"2024-09-11T14:42:28.090165+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":852,"num_write_kb":27456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"51'786","reported_seq":834,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:27.865676+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:42:27.865676+0000","last_peered":"2024-09-11T14:42:27.865676+0000","last_clean":"2024-09-11T14:42:27.865676+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:42:27.865676+0000","last_undegraded":"2024-09-11T14:42:27.865676+0000","last_fullsized":"2024-09-11T14:42:27.865676+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"51'751","reported_seq":799,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:28.219968+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:42:28.219968+0000","last_peered":"2024-09-11T14:42:28.219968+0000","last_clean":"2024-09-11T14:42:28.219968+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:42:28.219968+0000","last_undegraded":"2024-09-11T14:42:28.219968+0000","last_fullsized":"2024-09-11T14:42:28.219968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":751,"num_write_kb":24128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"51'755","reported_seq":803,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:28.072483+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:42:28.072483+0000","last_peered":"2024-09-11T14:42:28.072483+0000","last_clean":"2024-09-11T14:42:28.072483+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:42:28.072483+0000","last_undegraded":"2024-09-11T14:42:28.072483+0000","last_fullsized":"2024-09-11T14:42:28.072483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":24448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"51'777","reported_seq":825,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:27.800931+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:42:27.800931+0000","last_peered":"2024-09-11T14:42:27.800931+0000","last_clean":"2024-09-11T14:42:27.800931+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:42:27.800931+0000","last_undegraded":"2024-09-11T14:42:27.800931+0000","last_fullsized":"2024-09-11T14:42:27.800931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":25152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":193,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.178792+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:41:28.178792+0000","last_peered":"2024-09-11T14:41:28.178792+0000","last_clean":"2024-09-11T14:41:28.178792+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:41:28.178792+0000","last_undegraded":"2024-09-11T14:41:28.178792+0000","last_fullsized":"2024-09-11T14:41:28.178792+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":122,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.084337+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:41:28.084337+0000","last_peered":"2024-09-11T14:41:28.084337+0000","last_clean":"2024-09-11T14:41:28.084337+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:41:28.084337+0000","last_undegraded":"2024-09-11T14:41:28.084337+0000","last_fullsized":"2024-09-11T14:41:28.084337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"51'825","reported_seq":873,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:28.284330+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:42:28.284330+0000","last_peered":"2024-09-11T14:42:28.284330+0000","last_clean":"2024-09-11T14:42:28.284330+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:42:28.284330+0000","last_undegraded":"2024-09-11T14:42:28.284330+0000","last_fullsized":"2024-09-11T14:42:28.284330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":825,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.035538+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:41:28.035538+0000","last_peered":"2024-09-11T14:41:28.035538+0000","last_clean":"2024-09-11T14:41:28.035538+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:41:28.035538+0000","last_undegraded":"2024-09-11T14:41:28.035538+0000","last_fullsized":"2024-09-11T14:41:28.035538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"51'835","reported_seq":883,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:27.792770+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:42:27.792770+0000","last_peered":"2024-09-11T14:42:27.792770+0000","last_clean":"2024-09-11T14:42:27.792770+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:42:27.792770+0000","last_undegraded":"2024-09-11T14:42:27.792770+0000","last_fullsized":"2024-09-11T14:42:27.792770+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":835,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.077878+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:41:28.077878+0000","last_peered":"2024-09-11T14:41:28.077878+0000","last_clean":"2024-09-11T14:41:28.077878+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:41:28.077878+0000","last_undegraded":"2024-09-11T14:41:28.077878+0000","last_fullsized":"2024-09-11T14:41:28.077878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"51'816","reported_seq":864,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:27.735342+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:42:27.735342+0000","last_peered":"2024-09-11T14:42:27.735342+0000","last_clean":"2024-09-11T14:42:27.735342+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:42:27.735342+0000","last_undegraded":"2024-09-11T14:42:27.735342+0000","last_fullsized":"2024-09-11T14:42:27.735342+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":26432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":123,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.029310+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:41:28.029310+0000","last_peered":"2024-09-11T14:41:28.029310+0000","last_clean":"2024-09-11T14:41:28.029310+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:41:28.029310+0000","last_undegraded":"2024-09-11T14:41:28.029310+0000","last_fullsized":"2024-09-11T14:41:28.029310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"51'717","reported_seq":765,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:27.917157+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:42:27.917157+0000","last_peered":"2024-09-11T14:42:27.917157+0000","last_clean":"2024-09-11T14:42:27.917157+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:42:27.917157+0000","last_undegraded":"2024-09-11T14:42:27.917157+0000","last_fullsized":"2024-09-11T14:42:27.917157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":23168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:27.946865+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:41:27.946865+0000","last_peered":"2024-09-11T14:41:27.946865+0000","last_clean":"2024-09-11T14:41:27.946865+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:41:27.946865+0000","last_undegraded":"2024-09-11T14:41:27.946865+0000","last_fullsized":"2024-09-11T14:41:27.946865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"51'813","reported_seq":861,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:28.227392+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:42:28.227392+0000","last_peered":"2024-09-11T14:42:28.227392+0000","last_clean":"2024-09-11T14:42:28.227392+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:42:28.227392+0000","last_undegraded":"2024-09-11T14:42:28.227392+0000","last_fullsized":"2024-09-11T14:42:28.227392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":813,"num_write_kb":26304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.188775+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:41:28.188775+0000","last_peered":"2024-09-11T14:41:28.188775+0000","last_clean":"2024-09-11T14:41:28.188775+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:41:28.188775+0000","last_undegraded":"2024-09-11T14:41:28.188775+0000","last_fullsized":"2024-09-11T14:41:28.188775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"51'787","reported_seq":835,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:28.147206+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:42:28.147206+0000","last_peered":"2024-09-11T14:42:28.147206+0000","last_clean":"2024-09-11T14:42:28.147206+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:42:28.147206+0000","last_undegraded":"2024-09-11T14:42:28.147206+0000","last_fullsized":"2024-09-11T14:42:28.147206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:27.944308+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:41:27.944308+0000","last_peered":"2024-09-11T14:41:27.944308+0000","last_clean":"2024-09-11T14:41:27.944308+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:41:27.944308+0000","last_undegraded":"2024-09-11T14:41:27.944308+0000","last_fullsized":"2024-09-11T14:41:27.944308+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"51'823","reported_seq":871,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:27.866994+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:42:27.866994+0000","last_peered":"2024-09-11T14:42:27.866994+0000","last_clean":"2024-09-11T14:42:27.866994+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:42:27.866994+0000","last_undegraded":"2024-09-11T14:42:27.866994+0000","last_fullsized":"2024-09-11T14:42:27.866994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":26688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.085103+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:41:28.085103+0000","last_peered":"2024-09-11T14:41:28.085103+0000","last_clean":"2024-09-11T14:41:28.085103+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:41:28.085103+0000","last_undegraded":"2024-09-11T14:41:28.085103+0000","last_fullsized":"2024-09-11T14:41:28.085103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":9502744,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12712,"num_write_kb":411393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214100635648,"internally_reserved":0,"allocated":110858240,"data_stored":110858240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12712,"ondisk_log_size":12712,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214100504576,"internally_reserved":0,"allocated":110989312,"data_stored":110989312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53497868288,"internally_reserved":0,"allocated":55005184,"data_stored":55005184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":60668,"kb_used_data":60668,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52237060,"statfs":{"total":53552873472,"available":53490749440,"internally_reserved":0,"allocated":62124032,"data_stored":62124032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706048,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":19112,"kb_used_data":19112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52278616,"statfs":{"total":53552873472,"available":53533302784,"internally_reserved":0,"allocated":19570688,"data_stored":19570688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706048,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":22172,"kb_used_data":22172,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52275556,"statfs":{"total":53552873472,"available":53530169344,"internally_reserved":0,"allocated":22704128,"data_stored":22704128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706048,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":25336,"kb_used_data":25336,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272392,"statfs":{"total":53552873472,"available":53526929408,"internally_reserved":0,"allocated":25944064,"data_stored":25944064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53497868288,"internally_reserved":0,"allocated":55005184,"data_stored":55005184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53534167040,"internally_reserved":0,"allocated":18706432,"data_stored":18706432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53532012544,"internally_reserved":0,"allocated":20860928,"data_stored":20860928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53536456704,"internally_reserved":0,"allocated":16416768,"data_stored":16416768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53497868288,"internally_reserved":0,"allocated":55005184,"data_stored":55005184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53534167040,"internally_reserved":0,"allocated":18706432,"data_stored":18706432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53532143616,"internally_reserved":0,"allocated":20729856,"data_stored":20729856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53536456704,"internally_reserved":0,"allocated":16416768,"data_stored":16416768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53497868288,"internally_reserved":0,"allocated":55005184,"data_stored":55005184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:42:30.104 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Removed 6428 objects 2024-09-11T14:42:30.104 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Clean up completed and total clean up time :80.6271 2024-09-11T14:42:32.206 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:42:32.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:32.323+0000 7f28b02c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:32.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:32.329+0000 7f28b02c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:34.437 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:42:34.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:34.554+0000 7f7128cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:34.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:34.560+0000 7f7128cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:35.105 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:42:35.105 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:42:35.106 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:42:35.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:35.210+0000 7f048f111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:35.218+0000 7f048f111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:35.302 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_1 2024-09-11T14:42:35.303 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2024-09-11T14:42:35.408 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:42:35.408 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:42:35.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:35.408+0000 7f1bc5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:35.421 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2024-09-11T14:42:35.303895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12939,"num_write_kb":412501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12913,"ondisk_log_size":12913,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":25264,"kb_used_data":25264,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209165648,"statfs":{"total":214211493888,"available":214185623552,"internally_reserved":0,"allocated":25870336,"data_stored":25870336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-67633176,"num_objects":-1033,"num_object_clones":0,"num_object_copies":-3099,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1033,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002819"},"pg_stats":[{"pgid":"4.f","version":"51'840","reported_seq":888,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:29.734177+0000","last_change":"2024-09-11T14:39:37.670575+0000","last_active":"2024-09-11T14:42:29.734177+0000","last_peered":"2024-09-11T14:42:29.734177+0000","last_clean":"2024-09-11T14:42:29.734177+0000","last_became_active":"2024-09-11T14:39:37.663249+0000","last_became_peered":"2024-09-11T14:39:37.663249+0000","last_unstale":"2024-09-11T14:42:29.734177+0000","last_undegraded":"2024-09-11T14:42:29.734177+0000","last_fullsized":"2024-09-11T14:42:29.734177+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"51'748","reported_seq":796,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:29.496706+0000","last_change":"2024-09-11T14:39:37.539841+0000","last_active":"2024-09-11T14:42:29.496706+0000","last_peered":"2024-09-11T14:42:29.496706+0000","last_clean":"2024-09-11T14:42:29.496706+0000","last_became_active":"2024-09-11T14:39:37.532384+0000","last_became_peered":"2024-09-11T14:39:37.532384+0000","last_unstale":"2024-09-11T14:42:29.496706+0000","last_undegraded":"2024-09-11T14:42:29.496706+0000","last_fullsized":"2024-09-11T14:42:29.496706+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"51'792","reported_seq":841,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:29.848426+0000","last_change":"2024-09-11T14:39:37.654766+0000","last_active":"2024-09-11T14:42:29.848426+0000","last_peered":"2024-09-11T14:42:29.848426+0000","last_clean":"2024-09-11T14:42:29.848426+0000","last_became_active":"2024-09-11T14:39:37.637947+0000","last_became_peered":"2024-09-11T14:39:37.637947+0000","last_unstale":"2024-09-11T14:42:29.848426+0000","last_undegraded":"2024-09-11T14:42:29.848426+0000","last_fullsized":"2024-09-11T14:42:29.848426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":792,"num_write_kb":25281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"51'852","reported_seq":900,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:29.289605+0000","last_change":"2024-09-11T14:39:37.562586+0000","last_active":"2024-09-11T14:42:29.289605+0000","last_peered":"2024-09-11T14:42:29.289605+0000","last_clean":"2024-09-11T14:42:29.289605+0000","last_became_active":"2024-09-11T14:39:37.521534+0000","last_became_peered":"2024-09-11T14:39:37.521534+0000","last_unstale":"2024-09-11T14:42:29.289605+0000","last_undegraded":"2024-09-11T14:42:29.289605+0000","last_fullsized":"2024-09-11T14:42:29.289605+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":852,"num_write_kb":27264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"51'858","reported_seq":906,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:29.372891+0000","last_change":"2024-09-11T14:39:37.536302+0000","last_active":"2024-09-11T14:42:29.372891+0000","last_peered":"2024-09-11T14:42:29.372891+0000","last_clean":"2024-09-11T14:42:29.372891+0000","last_became_active":"2024-09-11T14:39:37.527687+0000","last_became_peered":"2024-09-11T14:39:37.527687+0000","last_unstale":"2024-09-11T14:42:29.372891+0000","last_undegraded":"2024-09-11T14:42:29.372891+0000","last_fullsized":"2024-09-11T14:42:29.372891+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":858,"num_write_kb":27456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"51'792","reported_seq":840,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:29.687251+0000","last_change":"2024-09-11T14:39:37.519226+0000","last_active":"2024-09-11T14:42:29.687251+0000","last_peered":"2024-09-11T14:42:29.687251+0000","last_clean":"2024-09-11T14:42:29.687251+0000","last_became_active":"2024-09-11T14:39:37.491017+0000","last_became_peered":"2024-09-11T14:39:37.491017+0000","last_unstale":"2024-09-11T14:42:29.687251+0000","last_undegraded":"2024-09-11T14:42:29.687251+0000","last_fullsized":"2024-09-11T14:42:29.687251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"51'754","reported_seq":802,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:29.069247+0000","last_change":"2024-09-11T14:39:37.614626+0000","last_active":"2024-09-11T14:42:29.069247+0000","last_peered":"2024-09-11T14:42:29.069247+0000","last_clean":"2024-09-11T14:42:29.069247+0000","last_became_active":"2024-09-11T14:39:37.571092+0000","last_became_peered":"2024-09-11T14:39:37.571092+0000","last_unstale":"2024-09-11T14:42:29.069247+0000","last_undegraded":"2024-09-11T14:42:29.069247+0000","last_fullsized":"2024-09-11T14:42:29.069247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":24128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"51'764","reported_seq":812,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:29.688898+0000","last_change":"2024-09-11T14:39:37.611604+0000","last_active":"2024-09-11T14:42:29.688898+0000","last_peered":"2024-09-11T14:42:29.688898+0000","last_clean":"2024-09-11T14:42:29.688898+0000","last_became_active":"2024-09-11T14:39:37.582324+0000","last_became_peered":"2024-09-11T14:39:37.582324+0000","last_unstale":"2024-09-11T14:42:29.688898+0000","last_undegraded":"2024-09-11T14:42:29.688898+0000","last_fullsized":"2024-09-11T14:42:29.688898+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":764,"num_write_kb":24448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"51'786","reported_seq":834,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:29.598513+0000","last_change":"2024-09-11T14:39:37.623258+0000","last_active":"2024-09-11T14:42:29.598513+0000","last_peered":"2024-09-11T14:42:29.598513+0000","last_clean":"2024-09-11T14:42:29.598513+0000","last_became_active":"2024-09-11T14:39:37.593910+0000","last_became_peered":"2024-09-11T14:39:37.593910+0000","last_unstale":"2024-09-11T14:42:29.598513+0000","last_undegraded":"2024-09-11T14:42:29.598513+0000","last_fullsized":"2024-09-11T14:42:29.598513+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":25152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":193,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.178792+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:41:28.178792+0000","last_peered":"2024-09-11T14:41:28.178792+0000","last_clean":"2024-09-11T14:41:28.178792+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:41:28.178792+0000","last_undegraded":"2024-09-11T14:41:28.178792+0000","last_fullsized":"2024-09-11T14:41:28.178792+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":122,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.084337+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:41:28.084337+0000","last_peered":"2024-09-11T14:41:28.084337+0000","last_clean":"2024-09-11T14:41:28.084337+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:41:28.084337+0000","last_undegraded":"2024-09-11T14:41:28.084337+0000","last_fullsized":"2024-09-11T14:41:28.084337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"51'832","reported_seq":880,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:29.379706+0000","last_change":"2024-09-11T14:39:37.596449+0000","last_active":"2024-09-11T14:42:29.379706+0000","last_peered":"2024-09-11T14:42:29.379706+0000","last_clean":"2024-09-11T14:42:29.379706+0000","last_became_active":"2024-09-11T14:39:37.575505+0000","last_became_peered":"2024-09-11T14:39:37.575505+0000","last_unstale":"2024-09-11T14:42:29.379706+0000","last_undegraded":"2024-09-11T14:42:29.379706+0000","last_fullsized":"2024-09-11T14:42:29.379706+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.035538+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:41:28.035538+0000","last_peered":"2024-09-11T14:41:28.035538+0000","last_clean":"2024-09-11T14:41:28.035538+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:41:28.035538+0000","last_undegraded":"2024-09-11T14:41:28.035538+0000","last_fullsized":"2024-09-11T14:41:28.035538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"51'842","reported_seq":890,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:29.526821+0000","last_change":"2024-09-11T14:39:37.621181+0000","last_active":"2024-09-11T14:42:29.526821+0000","last_peered":"2024-09-11T14:42:29.526821+0000","last_clean":"2024-09-11T14:42:29.526821+0000","last_became_active":"2024-09-11T14:39:37.612840+0000","last_became_peered":"2024-09-11T14:39:37.612840+0000","last_unstale":"2024-09-11T14:42:29.526821+0000","last_undegraded":"2024-09-11T14:42:29.526821+0000","last_fullsized":"2024-09-11T14:42:29.526821+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.077878+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:41:28.077878+0000","last_peered":"2024-09-11T14:41:28.077878+0000","last_clean":"2024-09-11T14:41:28.077878+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:41:28.077878+0000","last_undegraded":"2024-09-11T14:41:28.077878+0000","last_fullsized":"2024-09-11T14:41:28.077878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"51'826","reported_seq":874,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:29.930745+0000","last_change":"2024-09-11T14:39:37.640246+0000","last_active":"2024-09-11T14:42:29.930745+0000","last_peered":"2024-09-11T14:42:29.930745+0000","last_clean":"2024-09-11T14:42:29.930745+0000","last_became_active":"2024-09-11T14:39:37.587042+0000","last_became_peered":"2024-09-11T14:39:37.587042+0000","last_unstale":"2024-09-11T14:42:29.930745+0000","last_undegraded":"2024-09-11T14:42:29.930745+0000","last_fullsized":"2024-09-11T14:42:29.930745+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":826,"num_write_kb":26432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":123,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.029310+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:41:28.029310+0000","last_peered":"2024-09-11T14:41:28.029310+0000","last_clean":"2024-09-11T14:41:28.029310+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:41:28.029310+0000","last_undegraded":"2024-09-11T14:41:28.029310+0000","last_fullsized":"2024-09-11T14:41:28.029310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"51'724","reported_seq":772,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:29.484201+0000","last_change":"2024-09-11T14:39:37.626080+0000","last_active":"2024-09-11T14:42:29.484201+0000","last_peered":"2024-09-11T14:42:29.484201+0000","last_clean":"2024-09-11T14:42:29.484201+0000","last_became_active":"2024-09-11T14:39:37.589624+0000","last_became_peered":"2024-09-11T14:39:37.589624+0000","last_unstale":"2024-09-11T14:42:29.484201+0000","last_undegraded":"2024-09-11T14:42:29.484201+0000","last_fullsized":"2024-09-11T14:42:29.484201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":23168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:27.946865+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:41:27.946865+0000","last_peered":"2024-09-11T14:41:27.946865+0000","last_clean":"2024-09-11T14:41:27.946865+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:41:27.946865+0000","last_undegraded":"2024-09-11T14:41:27.946865+0000","last_fullsized":"2024-09-11T14:41:27.946865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"51'822","reported_seq":870,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:29.598751+0000","last_change":"2024-09-11T14:39:37.643609+0000","last_active":"2024-09-11T14:42:29.598751+0000","last_peered":"2024-09-11T14:42:29.598751+0000","last_clean":"2024-09-11T14:42:29.598751+0000","last_became_active":"2024-09-11T14:39:37.627865+0000","last_became_peered":"2024-09-11T14:39:37.627865+0000","last_unstale":"2024-09-11T14:42:29.598751+0000","last_undegraded":"2024-09-11T14:42:29.598751+0000","last_fullsized":"2024-09-11T14:42:29.598751+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":26304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.188775+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:41:28.188775+0000","last_peered":"2024-09-11T14:41:28.188775+0000","last_clean":"2024-09-11T14:41:28.188775+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:41:28.188775+0000","last_undegraded":"2024-09-11T14:41:28.188775+0000","last_fullsized":"2024-09-11T14:41:28.188775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"51'792","reported_seq":840,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:28.973426+0000","last_change":"2024-09-11T14:39:37.526252+0000","last_active":"2024-09-11T14:42:28.973426+0000","last_peered":"2024-09-11T14:42:28.973426+0000","last_clean":"2024-09-11T14:42:28.973426+0000","last_became_active":"2024-09-11T14:39:37.517356+0000","last_became_peered":"2024-09-11T14:39:37.517356+0000","last_unstale":"2024-09-11T14:42:28.973426+0000","last_undegraded":"2024-09-11T14:42:28.973426+0000","last_fullsized":"2024-09-11T14:42:28.973426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:27.944308+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:41:27.944308+0000","last_peered":"2024-09-11T14:41:27.944308+0000","last_clean":"2024-09-11T14:41:27.944308+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:41:27.944308+0000","last_undegraded":"2024-09-11T14:41:27.944308+0000","last_fullsized":"2024-09-11T14:41:27.944308+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"51'834","reported_seq":882,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:42:29.876673+0000","last_change":"2024-09-11T14:39:37.603932+0000","last_active":"2024-09-11T14:42:29.876673+0000","last_peered":"2024-09-11T14:42:29.876673+0000","last_clean":"2024-09-11T14:42:29.876673+0000","last_became_active":"2024-09-11T14:39:37.565628+0000","last_became_peered":"2024-09-11T14:39:37.565628+0000","last_unstale":"2024-09-11T14:42:29.876673+0000","last_undegraded":"2024-09-11T14:42:29.876673+0000","last_fullsized":"2024-09-11T14:42:29.876673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:36.324054+0000","last_clean_scrub_stamp":"2024-09-11T14:39:36.324054+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":26688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T14:41:28.085103+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:41:28.085103+0000","last_peered":"2024-09-11T14:41:28.085103+0000","last_clean":"2024-09-11T14:41:28.085103+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:41:28.085103+0000","last_undegraded":"2024-09-11T14:41:28.085103+0000","last_fullsized":"2024-09-11T14:41:28.085103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12858,"num_write_kb":411393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214185623552,"internally_reserved":0,"allocated":25870336,"data_stored":25870336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12858,"ondisk_log_size":12858,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214185623552,"internally_reserved":0,"allocated":25870336,"data_stored":25870336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53546151936,"internally_reserved":0,"allocated":6721536,"data_stored":6721536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6564,"kb_used_data":6564,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291164,"statfs":{"total":53552873472,"available":53546151936,"internally_reserved":0,"allocated":6721536,"data_stored":6721536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6148,"kb_used_data":6148,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291580,"statfs":{"total":53552873472,"available":53546577920,"internally_reserved":0,"allocated":6295552,"data_stored":6295552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6580,"kb_used_data":6580,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291148,"statfs":{"total":53552873472,"available":53546135552,"internally_reserved":0,"allocated":6737920,"data_stored":6737920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":5972,"kb_used_data":5972,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291756,"statfs":{"total":53552873472,"available":53546758144,"internally_reserved":0,"allocated":6115328,"data_stored":6115328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53546151936,"internally_reserved":0,"allocated":6721536,"data_stored":6721536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53546135552,"internally_reserved":0,"allocated":6737920,"data_stored":6737920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53546758144,"internally_reserved":0,"allocated":6115328,"data_stored":6115328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53546577920,"internally_reserved":0,"allocated":6295552,"data_stored":6295552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53546151936,"internally_reserved":0,"allocated":6721536,"data_stored":6721536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53546135552,"internally_reserved":0,"allocated":6737920,"data_stored":6737920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53546758144,"internally_reserved":0,"allocated":6115328,"data_stored":6115328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53546577920,"internally_reserved":0,"allocated":6295552,"data_stored":6295552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53546151936,"internally_reserved":0,"allocated":6721536,"data_stored":6721536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:42:35.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:35.421+0000 7f1bc5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:35.864 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_1' removed 2024-09-11T14:42:35.882 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-11T14:42:35.883 INFO:tasks.radosbench:Beginning radosbench... 2024-09-11T14:42:35.884 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_2 2024-09-11T14:42:35.884 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_2 16 2024-09-11T14:42:36.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:36.093+0000 7fb4996d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:36.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:36.109+0000 7fb4996d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:36.666 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:42:36.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:36.770+0000 7fadccb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:36.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:36.775+0000 7fadccb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:36.865 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_2' created 2024-09-11T14:42:36.885 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2024-09-11T14:42:37.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:37.062+0000 7f3ebe991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:37.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:37.077+0000 7f3ebe991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:37.880 INFO:teuthology.orchestra.run.smithi103.stderr:enabled application 'rados' on pool 'unique_pool_2' 2024-09-11T14:42:38.882 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:42:38.905 DEBUG:teuthology.orchestra.run.smithi103:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_2 bench 90 write' 2024-09-11T14:42:38.930 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-11T14:42:38.930 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-11T14:42:39.003 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:hints = 1 2024-09-11T14:42:39.003 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-11T14:42:39.003 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object prefix: benchmark_data_smithi103_44844 2024-09-11T14:42:39.003 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:42:39.003 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 0 0 0 0 0 0 - 0 2024-09-11T14:42:39.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:39.014+0000 7ff8faa9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:39.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:39.022+0000 7ff8faa9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:40.003 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 1 16 79 63 3.93726 3.9375 0.118211 0.207517 2024-09-11T14:42:40.423 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:42:40.424 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:42:40.424 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:42:40.424 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:42:40.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:40.589+0000 7efe7f311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:40.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:40.604+0000 7efe7f311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:40.632 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:40.632 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:40.632 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:40.632 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:40.632 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:40.632 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:40.632 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:40.633 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:40.633 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:40.633 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:40.633 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:40.633 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:40.636 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:40.637 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:40.637 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:42:40.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:40.775+0000 7f5b0e29c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:40.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:40.785+0000 7f5b0e29c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:40.826 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:40.826 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:40.830 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:40.830 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:40.831 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:42:40.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:40.962+0000 7f98e8791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:40.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:40.972+0000 7f98e8791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:41.004 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 2 16 134 118 3.68721 3.4375 0.106899 0.229499 2024-09-11T14:42:41.016 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:41.016 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:41.016 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:41.016 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:41.016 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:41.016 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:41.016 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:41.016 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:41.016 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:41.016 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:41.016 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:41.016 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:41.019 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:41.020 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:41.020 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:42:41.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:41.146+0000 7fe04a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:41.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:41.159+0000 7fe04a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:41.179 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:41.181 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:41.184 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:41.184 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:41.184 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:41.184 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:41.184 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:41.184 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:41.184 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:41.185 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:41.185 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:41.185 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:41.185 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:41.186 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:41.389 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:42:41.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:41.535+0000 7f49992d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:41.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:41.542+0000 7f49992d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:42.003 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 3 16 202 186 3.87469 4.25 0.0796302 0.233668 2024-09-11T14:42:43.003 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 4 16 268 252 3.93718 4.125 0.455592 0.242656 2024-09-11T14:42:43.775 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:42:43.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:43.894+0000 7fe8b185c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:43.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:43.904+0000 7fe8b185c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:44.003 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 5 16 339 323 4.03716 4.4375 0.716985 0.236724 2024-09-11T14:42:45.004 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 6 16 401 385 4.01007 3.875 0.148085 0.239942 2024-09-11T14:42:46.004 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 7 16 457 441 3.93716 3.5 0.106241 0.242324 2024-09-11T14:42:46.187 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:42:46.187 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:42:46.187 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:42:46.188 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:42:46.313 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:42:46.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:46.322+0000 7f0b4227d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:46.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:46.332+0000 7f0b4227d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:46.381 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:46.381 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:46.382 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:46.382 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:46.382 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:46.382 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:46.382 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:46.382 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:46.382 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:46.382 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:46.382 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:46.382 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:46.386 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:46.387 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:46.387 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:42:46.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:46.451+0000 7ff5f264f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:46.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:46.460+0000 7ff5f264f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:46.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:46.566+0000 7fbdbab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:46.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:46.578+0000 7fbdbab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:46.612 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:46.613 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:46.613 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:46.613 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:46.613 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:46.613 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:46.613 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:46.613 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:46.613 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:46.613 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:46.613 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:46.613 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:46.617 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:46.617 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:46.617 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:42:46.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:46.817+0000 7fa034191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:46.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:46.832+0000 7fa034191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:46.910 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:46.911 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:46.911 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:46.911 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:46.911 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:46.911 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:46.911 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:46.911 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:46.911 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:46.911 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:46.911 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:46.911 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:46.914 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:46.915 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:46.915 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:42:47.004 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 8 16 525 509 3.97622 4.25 0.414048 0.245715 2024-09-11T14:42:47.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:47.046+0000 7f4bc5991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:47.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:47.063+0000 7f4bc5991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:47.094 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:47.094 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:47.095 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:47.095 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:47.095 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:47.095 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:47.095 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:47.095 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:47.095 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:47.095 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:47.095 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:47.095 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:47.099 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:47.099 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:48.004 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 9 16 598 582 4.04131 4.5625 0.136612 0.242565 2024-09-11T14:42:48.847 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:42:48.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:48.960+0000 7fb7228d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:48.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:48.967+0000 7fb7228d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:49.004 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 10 16 675 659 4.11839 4.8125 0.107013 0.238089 2024-09-11T14:42:50.004 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 11 16 739 723 4.10759 4 0.0839239 0.238749 2024-09-11T14:42:51.004 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 12 16 813 797 4.15067 4.625 0.452247 0.23877 2024-09-11T14:42:51.418 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:42:51.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:51.563+0000 7f7c4c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:51.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:51.570+0000 7f7c4c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:52.004 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 13 16 880 864 4.15347 4.1875 0.148289 0.237006 2024-09-11T14:42:52.100 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:42:52.100 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:42:52.100 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:42:52.101 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:42:52.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:52.226+0000 7f7313f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:52.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:52.237+0000 7f7313f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:52.268 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:52.268 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:52.268 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:52.268 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:52.268 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:52.268 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:52.268 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:52.268 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:52.268 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:52.269 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:52.269 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:52.269 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:52.271 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:52.272 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:52.272 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:42:52.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:52.420+0000 7fd725d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:52.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:52.433+0000 7fd725d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:52.461 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:52.461 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:52.461 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:52.461 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:52.462 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:52.462 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:52.462 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:52.462 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:52.462 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:52.462 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:52.462 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:52.462 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:52.464 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:52.464 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:52.464 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:42:52.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:52.606+0000 7fb91d4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:52.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:52.617+0000 7fb91d4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:52.745 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:52.745 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:52.745 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:52.745 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:52.745 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:52.745 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:52.745 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:52.746 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:52.746 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:52.746 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:52.746 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:52.746 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:52.753 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:52.754 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:52.754 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:42:52.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:52.891+0000 7f275d551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:52.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:52.908+0000 7f275d551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:52.970 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:42:52.971 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:42:52.971 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:42:52.971 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:42:52.971 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:42:52.971 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:42:52.971 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:42:52.971 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:42:52.971 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:42:52.971 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:42:52.971 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:42:52.971 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:42:52.974 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:42:52.974 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:42:53.004 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 14 16 956 940 4.19605 4.75 0.243183 0.235672 2024-09-11T14:42:53.947 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:42:54.005 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 15 16 1031 1015 4.22878 4.6875 0.217167 0.23405 2024-09-11T14:42:54.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:54.106+0000 7fa9ec551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:54.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:54.115+0000 7fa9ec551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:55.005 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 16 15 1096 1081 4.22228 4.125 0.194136 0.233915 2024-09-11T14:42:56.005 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 17 16 1167 1151 4.23124 4.375 0.22213 0.233154 2024-09-11T14:42:56.446 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:42:56.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:56.612+0000 7fac6a2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:56.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:56.621+0000 7fac6a2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:57.005 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 18 16 1241 1225 4.25309 4.625 0.121728 0.233337 2024-09-11T14:42:57.975 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:42:57.976 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:42:57.976 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:42:58.005 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 19 16 1319 1303 4.2858 4.875 0.422516 0.231756 2024-09-11T14:42:58.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:58.137+0000 7f2e93791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:58.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:58.149+0000 7f2e93791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:58.416 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:42:58.416 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:42:58.441 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-09-11T14:42:57.308920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":66060851,"num_objects":1003,"num_object_clones":0,"num_object_copies":3009,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1080,"num_write_kb":65044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1054,"ondisk_log_size":1054,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":380424,"kb_used_data":380424,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208810488,"statfs":{"total":214211493888,"available":213821939712,"internally_reserved":0,"allocated":389554176,"data_stored":389554176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45744128,"num_objects":698,"num_object_clones":0,"num_object_copies":2094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":44672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002998"},"pg_stats":[{"pgid":"5.f","version":"55'64","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:53.035684+0000","last_change":"2024-09-11T14:42:38.114713+0000","last_active":"2024-09-11T14:42:53.035684+0000","last_peered":"2024-09-11T14:42:53.035684+0000","last_clean":"2024-09-11T14:42:53.035684+0000","last_became_active":"2024-09-11T14:42:38.099767+0000","last_became_peered":"2024-09-11T14:42:38.099767+0000","last_unstale":"2024-09-11T14:42:53.035684+0000","last_undegraded":"2024-09-11T14:42:53.035684+0000","last_fullsized":"2024-09-11T14:42:53.035684+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"55'59","reported_seq":71,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:52.901138+0000","last_change":"2024-09-11T14:42:38.177741+0000","last_active":"2024-09-11T14:42:52.901138+0000","last_peered":"2024-09-11T14:42:52.901138+0000","last_clean":"2024-09-11T14:42:52.901138+0000","last_became_active":"2024-09-11T14:42:38.170462+0000","last_became_peered":"2024-09-11T14:42:38.170462+0000","last_unstale":"2024-09-11T14:42:52.901138+0000","last_undegraded":"2024-09-11T14:42:52.901138+0000","last_fullsized":"2024-09-11T14:42:52.901138+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"55'71","reported_seq":83,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:53.412538+0000","last_change":"2024-09-11T14:42:38.204931+0000","last_active":"2024-09-11T14:42:53.412538+0000","last_peered":"2024-09-11T14:42:53.412538+0000","last_clean":"2024-09-11T14:42:53.412538+0000","last_became_active":"2024-09-11T14:42:38.189110+0000","last_became_peered":"2024-09-11T14:42:38.189110+0000","last_unstale":"2024-09-11T14:42:53.412538+0000","last_undegraded":"2024-09-11T14:42:53.412538+0000","last_fullsized":"2024-09-11T14:42:53.412538+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"55'68","reported_seq":80,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:53.731551+0000","last_change":"2024-09-11T14:42:38.097894+0000","last_active":"2024-09-11T14:42:53.731551+0000","last_peered":"2024-09-11T14:42:53.731551+0000","last_clean":"2024-09-11T14:42:53.731551+0000","last_became_active":"2024-09-11T14:42:38.068084+0000","last_became_peered":"2024-09-11T14:42:38.068084+0000","last_unstale":"2024-09-11T14:42:53.731551+0000","last_undegraded":"2024-09-11T14:42:53.731551+0000","last_fullsized":"2024-09-11T14:42:53.731551+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"55'52","reported_seq":64,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:53.044002+0000","last_change":"2024-09-11T14:42:38.084302+0000","last_active":"2024-09-11T14:42:53.044002+0000","last_peered":"2024-09-11T14:42:53.044002+0000","last_clean":"2024-09-11T14:42:53.044002+0000","last_became_active":"2024-09-11T14:42:38.060054+0000","last_became_peered":"2024-09-11T14:42:38.060054+0000","last_unstale":"2024-09-11T14:42:53.044002+0000","last_undegraded":"2024-09-11T14:42:53.044002+0000","last_fullsized":"2024-09-11T14:42:53.044002+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"55'59","reported_seq":71,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:52.728667+0000","last_change":"2024-09-11T14:42:38.114647+0000","last_active":"2024-09-11T14:42:52.728667+0000","last_peered":"2024-09-11T14:42:52.728667+0000","last_clean":"2024-09-11T14:42:52.728667+0000","last_became_active":"2024-09-11T14:42:38.075902+0000","last_became_peered":"2024-09-11T14:42:38.075902+0000","last_unstale":"2024-09-11T14:42:52.728667+0000","last_undegraded":"2024-09-11T14:42:52.728667+0000","last_fullsized":"2024-09-11T14:42:52.728667+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"55'56","reported_seq":68,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:53.195311+0000","last_change":"2024-09-11T14:42:38.105488+0000","last_active":"2024-09-11T14:42:53.195311+0000","last_peered":"2024-09-11T14:42:53.195311+0000","last_clean":"2024-09-11T14:42:53.195311+0000","last_became_active":"2024-09-11T14:42:38.071282+0000","last_became_peered":"2024-09-11T14:42:38.071282+0000","last_unstale":"2024-09-11T14:42:53.195311+0000","last_undegraded":"2024-09-11T14:42:53.195311+0000","last_fullsized":"2024-09-11T14:42:53.195311+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"55'65","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:52.521841+0000","last_change":"2024-09-11T14:42:38.122969+0000","last_active":"2024-09-11T14:42:52.521841+0000","last_peered":"2024-09-11T14:42:52.521841+0000","last_clean":"2024-09-11T14:42:52.521841+0000","last_became_active":"2024-09-11T14:42:38.109230+0000","last_became_peered":"2024-09-11T14:42:38.109230+0000","last_unstale":"2024-09-11T14:42:52.521841+0000","last_undegraded":"2024-09-11T14:42:52.521841+0000","last_fullsized":"2024-09-11T14:42:52.521841+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"55'72","reported_seq":84,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:52.955734+0000","last_change":"2024-09-11T14:42:38.222378+0000","last_active":"2024-09-11T14:42:52.955734+0000","last_peered":"2024-09-11T14:42:52.955734+0000","last_clean":"2024-09-11T14:42:52.955734+0000","last_became_active":"2024-09-11T14:42:38.204348+0000","last_became_peered":"2024-09-11T14:42:38.204348+0000","last_unstale":"2024-09-11T14:42:52.955734+0000","last_undegraded":"2024-09-11T14:42:52.955734+0000","last_fullsized":"2024-09-11T14:42:52.955734+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":205,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.913572+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:42:38.913572+0000","last_peered":"2024-09-11T14:42:38.913572+0000","last_clean":"2024-09-11T14:42:38.913572+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:42:38.913572+0000","last_undegraded":"2024-09-11T14:42:38.913572+0000","last_fullsized":"2024-09-11T14:42:38.913572+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":134,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.922201+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:42:38.922201+0000","last_peered":"2024-09-11T14:42:38.922201+0000","last_clean":"2024-09-11T14:42:38.922201+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:42:38.922201+0000","last_undegraded":"2024-09-11T14:42:38.922201+0000","last_fullsized":"2024-09-11T14:42:38.922201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"55'60","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:53.281472+0000","last_change":"2024-09-11T14:42:38.156444+0000","last_active":"2024-09-11T14:42:53.281472+0000","last_peered":"2024-09-11T14:42:53.281472+0000","last_clean":"2024-09-11T14:42:53.281472+0000","last_became_active":"2024-09-11T14:42:38.142793+0000","last_became_peered":"2024-09-11T14:42:38.142793+0000","last_unstale":"2024-09-11T14:42:53.281472+0000","last_undegraded":"2024-09-11T14:42:53.281472+0000","last_fullsized":"2024-09-11T14:42:53.281472+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.926607+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:42:38.926607+0000","last_peered":"2024-09-11T14:42:38.926607+0000","last_clean":"2024-09-11T14:42:38.926607+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:42:38.926607+0000","last_undegraded":"2024-09-11T14:42:38.926607+0000","last_fullsized":"2024-09-11T14:42:38.926607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"55'63","reported_seq":75,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:53.183996+0000","last_change":"2024-09-11T14:42:38.179244+0000","last_active":"2024-09-11T14:42:53.183996+0000","last_peered":"2024-09-11T14:42:53.183996+0000","last_clean":"2024-09-11T14:42:53.183996+0000","last_became_active":"2024-09-11T14:42:38.159043+0000","last_became_peered":"2024-09-11T14:42:38.159043+0000","last_unstale":"2024-09-11T14:42:53.183996+0000","last_undegraded":"2024-09-11T14:42:53.183996+0000","last_fullsized":"2024-09-11T14:42:53.183996+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.915623+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:42:38.915623+0000","last_peered":"2024-09-11T14:42:38.915623+0000","last_clean":"2024-09-11T14:42:38.915623+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:42:38.915623+0000","last_undegraded":"2024-09-11T14:42:38.915623+0000","last_fullsized":"2024-09-11T14:42:38.915623+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"55'61","reported_seq":73,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:53.306744+0000","last_change":"2024-09-11T14:42:38.098677+0000","last_active":"2024-09-11T14:42:53.306744+0000","last_peered":"2024-09-11T14:42:53.306744+0000","last_clean":"2024-09-11T14:42:53.306744+0000","last_became_active":"2024-09-11T14:42:38.060593+0000","last_became_peered":"2024-09-11T14:42:38.060593+0000","last_unstale":"2024-09-11T14:42:53.306744+0000","last_undegraded":"2024-09-11T14:42:53.306744+0000","last_fullsized":"2024-09-11T14:42:53.306744+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":135,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.918644+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:42:38.918644+0000","last_peered":"2024-09-11T14:42:38.918644+0000","last_clean":"2024-09-11T14:42:38.918644+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:42:38.918644+0000","last_undegraded":"2024-09-11T14:42:38.918644+0000","last_fullsized":"2024-09-11T14:42:38.918644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"55'62","reported_seq":74,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:53.345846+0000","last_change":"2024-09-11T14:42:38.108084+0000","last_active":"2024-09-11T14:42:53.345846+0000","last_peered":"2024-09-11T14:42:53.345846+0000","last_clean":"2024-09-11T14:42:53.345846+0000","last_became_active":"2024-09-11T14:42:38.044460+0000","last_became_peered":"2024-09-11T14:42:38.044460+0000","last_unstale":"2024-09-11T14:42:53.345846+0000","last_undegraded":"2024-09-11T14:42:53.345846+0000","last_fullsized":"2024-09-11T14:42:53.345846+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.917356+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:42:38.917356+0000","last_peered":"2024-09-11T14:42:38.917356+0000","last_clean":"2024-09-11T14:42:38.917356+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:42:38.917356+0000","last_undegraded":"2024-09-11T14:42:38.917356+0000","last_fullsized":"2024-09-11T14:42:38.917356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"55'50","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:52.770135+0000","last_change":"2024-09-11T14:42:38.096488+0000","last_active":"2024-09-11T14:42:52.770135+0000","last_peered":"2024-09-11T14:42:52.770135+0000","last_clean":"2024-09-11T14:42:52.770135+0000","last_became_active":"2024-09-11T14:42:38.071104+0000","last_became_peered":"2024-09-11T14:42:38.071104+0000","last_unstale":"2024-09-11T14:42:52.770135+0000","last_undegraded":"2024-09-11T14:42:52.770135+0000","last_fullsized":"2024-09-11T14:42:52.770135+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.919824+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:42:38.919824+0000","last_peered":"2024-09-11T14:42:38.919824+0000","last_clean":"2024-09-11T14:42:38.919824+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:42:38.919824+0000","last_undegraded":"2024-09-11T14:42:38.919824+0000","last_fullsized":"2024-09-11T14:42:38.919824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"55'76","reported_seq":88,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:54.146396+0000","last_change":"2024-09-11T14:42:38.132564+0000","last_active":"2024-09-11T14:42:54.146396+0000","last_peered":"2024-09-11T14:42:54.146396+0000","last_clean":"2024-09-11T14:42:54.146396+0000","last_became_active":"2024-09-11T14:42:38.112585+0000","last_became_peered":"2024-09-11T14:42:38.112585+0000","last_unstale":"2024-09-11T14:42:54.146396+0000","last_undegraded":"2024-09-11T14:42:54.146396+0000","last_fullsized":"2024-09-11T14:42:54.146396+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.917862+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:42:38.917862+0000","last_peered":"2024-09-11T14:42:38.917862+0000","last_clean":"2024-09-11T14:42:38.917862+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:42:38.917862+0000","last_undegraded":"2024-09-11T14:42:38.917862+0000","last_fullsized":"2024-09-11T14:42:38.917862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"55'61","reported_seq":73,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:52.766817+0000","last_change":"2024-09-11T14:42:38.233207+0000","last_active":"2024-09-11T14:42:52.766817+0000","last_peered":"2024-09-11T14:42:52.766817+0000","last_clean":"2024-09-11T14:42:52.766817+0000","last_became_active":"2024-09-11T14:42:38.225462+0000","last_became_peered":"2024-09-11T14:42:38.225462+0000","last_unstale":"2024-09-11T14:42:52.766817+0000","last_undegraded":"2024-09-11T14:42:52.766817+0000","last_fullsized":"2024-09-11T14:42:52.766817+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.925822+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:42:38.925822+0000","last_peered":"2024-09-11T14:42:38.925822+0000","last_clean":"2024-09-11T14:42:38.925822+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:42:38.925822+0000","last_undegraded":"2024-09-11T14:42:38.925822+0000","last_fullsized":"2024-09-11T14:42:38.925822+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":65470464,"num_objects":999,"num_object_clones":0,"num_object_copies":2997,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":999,"num_write_kb":63936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213807579136,"internally_reserved":0,"allocated":403914752,"data_stored":403914752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":999,"ondisk_log_size":999,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213807988736,"internally_reserved":0,"allocated":403505152,"data_stored":403505152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53456220160,"internally_reserved":0,"allocated":96653312,"data_stored":96653312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673369,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":90648,"kb_used_data":90648,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52207080,"statfs":{"total":53552873472,"available":53460049920,"internally_reserved":0,"allocated":92823552,"data_stored":92823552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706073,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":111724,"kb_used_data":111724,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52186004,"statfs":{"total":53552873472,"available":53438468096,"internally_reserved":0,"allocated":114405376,"data_stored":114405376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706073,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":102892,"kb_used_data":102892,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52194836,"statfs":{"total":53552873472,"available":53447512064,"internally_reserved":0,"allocated":105361408,"data_stored":105361408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706073,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":75160,"kb_used_data":75160,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52222568,"statfs":{"total":53552873472,"available":53475909632,"internally_reserved":0,"allocated":76963840,"data_stored":76963840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53456220160,"internally_reserved":0,"allocated":96653312,"data_stored":96653312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53444468736,"internally_reserved":0,"allocated":108404736,"data_stored":108404736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53472497664,"internally_reserved":0,"allocated":80375808,"data_stored":80375808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53434802176,"internally_reserved":0,"allocated":118071296,"data_stored":118071296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53456220160,"internally_reserved":0,"allocated":96653312,"data_stored":96653312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53444321280,"internally_reserved":0,"allocated":108552192,"data_stored":108552192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53472366592,"internally_reserved":0,"allocated":80506880,"data_stored":80506880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53434671104,"internally_reserved":0,"allocated":118202368,"data_stored":118202368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53456220160,"internally_reserved":0,"allocated":96653312,"data_stored":96653312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:42:59.005 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:42:59.004816+0000 min lat: 0.0325842 max lat: 1.40872 avg lat: 0.230411 2024-09-11T14:42:59.005 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:42:59.005 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 20 16 1390 1374 4.29336 4.4375 0.149453 0.230411 2024-09-11T14:42:59.107 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:42:59.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:59.274+0000 7f7b7ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:42:59.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:42:59.283+0000 7f7b7ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:00.005 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 21 16 1458 1442 4.29128 4.25 0.260341 0.231266 2024-09-11T14:43:01.005 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 22 16 1516 1500 4.26098 3.625 0.03746 0.230275 2024-09-11T14:43:01.832 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:43:01.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:01.973+0000 7f83f5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:01.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:01.981+0000 7f83f5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:02.005 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 23 16 1589 1573 4.27407 4.5625 0.124306 0.232426 2024-09-11T14:43:03.005 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 24 16 1662 1646 4.28607 4.5625 0.187414 0.231954 2024-09-11T14:43:03.443 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:43:03.443 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:43:03.444 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:43:03.444 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:43:03.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:03.565+0000 7f0416591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:03.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:03.581+0000 7f0416591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:03.602 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:43:03.603 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:43:03.603 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:43:03.603 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:43:03.603 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:43:03.603 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:43:03.603 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:43:03.603 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:43:03.603 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:43:03.603 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:43:03.603 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:43:03.603 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:43:03.605 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:43:03.606 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:43:03.606 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:43:03.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:03.735+0000 7f2cf4c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:03.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:03.749+0000 7f2cf4c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:03.770 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:43:03.770 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:43:03.770 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:43:03.770 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:43:03.770 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:43:03.770 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:43:03.770 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:43:03.770 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:43:03.771 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:43:03.771 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:43:03.771 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:43:03.771 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:43:03.775 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:43:03.775 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:43:03.776 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:43:03.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:03.909+0000 7fa5a706c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:03.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:03.925+0000 7fa5a706c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:04.005 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 25 16 1732 1716 4.28961 4.375 0.214392 0.23188 2024-09-11T14:43:04.033 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:43:04.033 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:43:04.034 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:43:04.034 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:43:04.034 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:43:04.034 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:43:04.034 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:43:04.034 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:43:04.034 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:43:04.034 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:43:04.034 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:43:04.034 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:43:04.037 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:43:04.037 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:43:04.038 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:43:04.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:04.177+0000 7fcf8cc46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:04.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:04.188+0000 7fcf8cc46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:04.253 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:43:04.254 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:43:04.254 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:43:04.254 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:43:04.254 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:43:04.254 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:43:04.254 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:43:04.254 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:43:04.254 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:43:04.254 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:43:04.254 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:43:04.254 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:43:04.257 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:43:04.257 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:43:04.298 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:43:04.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:04.424+0000 7f46ec191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:04.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:04.431+0000 7f46ec191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:05.005 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 26 16 1806 1790 4.30249 4.625 0.120137 0.230472 2024-09-11T14:43:06.006 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 27 16 1878 1862 4.30979 4.5 0.238361 0.229813 2024-09-11T14:43:06.747 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:43:06.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:06.884+0000 7f9ebf85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:06.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:06.894+0000 7f9ebf85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:07.006 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 28 16 1955 1939 4.32773 4.8125 0.583174 0.230151 2024-09-11T14:43:08.006 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 29 16 2037 2021 4.35521 5.125 0.174854 0.228815 2024-09-11T14:43:09.006 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 30 16 2096 2080 4.33294 3.6875 0.216744 0.229385 2024-09-11T14:43:09.258 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:43:09.259 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:43:09.259 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:43:09.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:09.410+0000 7f97ffaac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:09.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:09.424+0000 7f97ffaac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:09.464 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:43:09.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:09.652+0000 7f86b8991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:09.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:09.659+0000 7f86b8991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:09.749 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:43:09.750 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:43:09.767 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2024-09-11T14:43:09.311392+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":133759539,"num_objects":2036,"num_object_clones":0,"num_object_copies":6108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2113,"num_write_kb":131156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2087,"ondisk_log_size":2087,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":763092,"kb_used_data":763092,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208427820,"statfs":{"total":214211493888,"available":213430087680,"internally_reserved":0,"allocated":781406208,"data_stored":781406208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":67698688,"num_objects":1033,"num_object_clones":0,"num_object_copies":3099,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1033,"num_write_kb":66112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002472"},"pg_stats":[{"pgid":"5.f","version":"55'137","reported_seq":149,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.117625+0000","last_change":"2024-09-11T14:42:38.114713+0000","last_active":"2024-09-11T14:43:08.117625+0000","last_peered":"2024-09-11T14:43:08.117625+0000","last_clean":"2024-09-11T14:43:08.117625+0000","last_became_active":"2024-09-11T14:42:38.099767+0000","last_became_peered":"2024-09-11T14:42:38.099767+0000","last_unstale":"2024-09-11T14:43:08.117625+0000","last_undegraded":"2024-09-11T14:43:08.117625+0000","last_fullsized":"2024-09-11T14:43:08.117625+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"55'141","reported_seq":153,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.149260+0000","last_change":"2024-09-11T14:42:38.177741+0000","last_active":"2024-09-11T14:43:08.149260+0000","last_peered":"2024-09-11T14:43:08.149260+0000","last_clean":"2024-09-11T14:43:08.149260+0000","last_became_active":"2024-09-11T14:42:38.170462+0000","last_became_peered":"2024-09-11T14:42:38.170462+0000","last_unstale":"2024-09-11T14:43:08.149260+0000","last_undegraded":"2024-09-11T14:43:08.149260+0000","last_fullsized":"2024-09-11T14:43:08.149260+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9240576,"num_objects":141,"num_object_clones":0,"num_object_copies":423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":9024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"55'130","reported_seq":142,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.155676+0000","last_change":"2024-09-11T14:42:38.204931+0000","last_active":"2024-09-11T14:43:08.155676+0000","last_peered":"2024-09-11T14:43:08.155676+0000","last_clean":"2024-09-11T14:43:08.155676+0000","last_became_active":"2024-09-11T14:42:38.189110+0000","last_became_peered":"2024-09-11T14:42:38.189110+0000","last_unstale":"2024-09-11T14:43:08.155676+0000","last_undegraded":"2024-09-11T14:43:08.155676+0000","last_fullsized":"2024-09-11T14:43:08.155676+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"55'114","reported_seq":126,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:03.901258+0000","last_change":"2024-09-11T14:42:38.097894+0000","last_active":"2024-09-11T14:43:03.901258+0000","last_peered":"2024-09-11T14:43:03.901258+0000","last_clean":"2024-09-11T14:43:03.901258+0000","last_became_active":"2024-09-11T14:42:38.068084+0000","last_became_peered":"2024-09-11T14:42:38.068084+0000","last_unstale":"2024-09-11T14:43:03.901258+0000","last_undegraded":"2024-09-11T14:43:03.901258+0000","last_fullsized":"2024-09-11T14:43:03.901258+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"55'112","reported_seq":124,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:07.895224+0000","last_change":"2024-09-11T14:42:38.084302+0000","last_active":"2024-09-11T14:43:07.895224+0000","last_peered":"2024-09-11T14:43:07.895224+0000","last_clean":"2024-09-11T14:43:07.895224+0000","last_became_active":"2024-09-11T14:42:38.060054+0000","last_became_peered":"2024-09-11T14:42:38.060054+0000","last_unstale":"2024-09-11T14:43:07.895224+0000","last_undegraded":"2024-09-11T14:43:07.895224+0000","last_fullsized":"2024-09-11T14:43:07.895224+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"55'133","reported_seq":145,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.281236+0000","last_change":"2024-09-11T14:42:38.114647+0000","last_active":"2024-09-11T14:43:08.281236+0000","last_peered":"2024-09-11T14:43:08.281236+0000","last_clean":"2024-09-11T14:43:08.281236+0000","last_became_active":"2024-09-11T14:42:38.075902+0000","last_became_peered":"2024-09-11T14:42:38.075902+0000","last_unstale":"2024-09-11T14:43:08.281236+0000","last_undegraded":"2024-09-11T14:43:08.281236+0000","last_fullsized":"2024-09-11T14:43:08.281236+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"55'127","reported_seq":139,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:07.881088+0000","last_change":"2024-09-11T14:42:38.105488+0000","last_active":"2024-09-11T14:43:07.881088+0000","last_peered":"2024-09-11T14:43:07.881088+0000","last_clean":"2024-09-11T14:43:07.881088+0000","last_became_active":"2024-09-11T14:42:38.071282+0000","last_became_peered":"2024-09-11T14:42:38.071282+0000","last_unstale":"2024-09-11T14:43:07.881088+0000","last_undegraded":"2024-09-11T14:43:07.881088+0000","last_fullsized":"2024-09-11T14:43:07.881088+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"55'133","reported_seq":145,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.371211+0000","last_change":"2024-09-11T14:42:38.122969+0000","last_active":"2024-09-11T14:43:08.371211+0000","last_peered":"2024-09-11T14:43:08.371211+0000","last_clean":"2024-09-11T14:43:08.371211+0000","last_became_active":"2024-09-11T14:42:38.109230+0000","last_became_peered":"2024-09-11T14:42:38.109230+0000","last_unstale":"2024-09-11T14:43:08.371211+0000","last_undegraded":"2024-09-11T14:43:08.371211+0000","last_fullsized":"2024-09-11T14:43:08.371211+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"55'136","reported_seq":148,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.038986+0000","last_change":"2024-09-11T14:42:38.222378+0000","last_active":"2024-09-11T14:43:08.038986+0000","last_peered":"2024-09-11T14:43:08.038986+0000","last_clean":"2024-09-11T14:43:08.038986+0000","last_became_active":"2024-09-11T14:42:38.204348+0000","last_became_peered":"2024-09-11T14:42:38.204348+0000","last_unstale":"2024-09-11T14:43:08.038986+0000","last_undegraded":"2024-09-11T14:43:08.038986+0000","last_fullsized":"2024-09-11T14:43:08.038986+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8912896,"num_objects":136,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":8704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":205,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.913572+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:42:38.913572+0000","last_peered":"2024-09-11T14:42:38.913572+0000","last_clean":"2024-09-11T14:42:38.913572+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:42:38.913572+0000","last_undegraded":"2024-09-11T14:42:38.913572+0000","last_fullsized":"2024-09-11T14:42:38.913572+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":134,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.922201+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:42:38.922201+0000","last_peered":"2024-09-11T14:42:38.922201+0000","last_clean":"2024-09-11T14:42:38.922201+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:42:38.922201+0000","last_undegraded":"2024-09-11T14:42:38.922201+0000","last_fullsized":"2024-09-11T14:42:38.922201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"55'127","reported_seq":139,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:07.364666+0000","last_change":"2024-09-11T14:42:38.156444+0000","last_active":"2024-09-11T14:43:07.364666+0000","last_peered":"2024-09-11T14:43:07.364666+0000","last_clean":"2024-09-11T14:43:07.364666+0000","last_became_active":"2024-09-11T14:42:38.142793+0000","last_became_peered":"2024-09-11T14:42:38.142793+0000","last_unstale":"2024-09-11T14:43:07.364666+0000","last_undegraded":"2024-09-11T14:43:07.364666+0000","last_fullsized":"2024-09-11T14:43:07.364666+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.926607+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:42:38.926607+0000","last_peered":"2024-09-11T14:42:38.926607+0000","last_clean":"2024-09-11T14:42:38.926607+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:42:38.926607+0000","last_undegraded":"2024-09-11T14:42:38.926607+0000","last_fullsized":"2024-09-11T14:42:38.926607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"55'127","reported_seq":139,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:07.927886+0000","last_change":"2024-09-11T14:42:38.179244+0000","last_active":"2024-09-11T14:43:07.927886+0000","last_peered":"2024-09-11T14:43:07.927886+0000","last_clean":"2024-09-11T14:43:07.927886+0000","last_became_active":"2024-09-11T14:42:38.159043+0000","last_became_peered":"2024-09-11T14:42:38.159043+0000","last_unstale":"2024-09-11T14:43:07.927886+0000","last_undegraded":"2024-09-11T14:43:07.927886+0000","last_fullsized":"2024-09-11T14:43:07.927886+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.915623+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:42:38.915623+0000","last_peered":"2024-09-11T14:42:38.915623+0000","last_clean":"2024-09-11T14:42:38.915623+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:42:38.915623+0000","last_undegraded":"2024-09-11T14:42:38.915623+0000","last_fullsized":"2024-09-11T14:42:38.915623+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"55'115","reported_seq":127,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.324569+0000","last_change":"2024-09-11T14:42:38.098677+0000","last_active":"2024-09-11T14:43:08.324569+0000","last_peered":"2024-09-11T14:43:08.324569+0000","last_clean":"2024-09-11T14:43:08.324569+0000","last_became_active":"2024-09-11T14:42:38.060593+0000","last_became_peered":"2024-09-11T14:42:38.060593+0000","last_unstale":"2024-09-11T14:43:08.324569+0000","last_undegraded":"2024-09-11T14:43:08.324569+0000","last_fullsized":"2024-09-11T14:43:08.324569+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":135,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.918644+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:42:38.918644+0000","last_peered":"2024-09-11T14:42:38.918644+0000","last_clean":"2024-09-11T14:42:38.918644+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:42:38.918644+0000","last_undegraded":"2024-09-11T14:42:38.918644+0000","last_fullsized":"2024-09-11T14:42:38.918644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"55'127","reported_seq":139,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.161739+0000","last_change":"2024-09-11T14:42:38.108084+0000","last_active":"2024-09-11T14:43:08.161739+0000","last_peered":"2024-09-11T14:43:08.161739+0000","last_clean":"2024-09-11T14:43:08.161739+0000","last_became_active":"2024-09-11T14:42:38.044460+0000","last_became_peered":"2024-09-11T14:42:38.044460+0000","last_unstale":"2024-09-11T14:43:08.161739+0000","last_undegraded":"2024-09-11T14:43:08.161739+0000","last_fullsized":"2024-09-11T14:43:08.161739+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.917356+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:42:38.917356+0000","last_peered":"2024-09-11T14:42:38.917356+0000","last_clean":"2024-09-11T14:42:38.917356+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:42:38.917356+0000","last_undegraded":"2024-09-11T14:42:38.917356+0000","last_fullsized":"2024-09-11T14:42:38.917356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"55'123","reported_seq":135,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.060311+0000","last_change":"2024-09-11T14:42:38.096488+0000","last_active":"2024-09-11T14:43:08.060311+0000","last_peered":"2024-09-11T14:43:08.060311+0000","last_clean":"2024-09-11T14:43:08.060311+0000","last_became_active":"2024-09-11T14:42:38.071104+0000","last_became_peered":"2024-09-11T14:42:38.071104+0000","last_unstale":"2024-09-11T14:43:08.060311+0000","last_undegraded":"2024-09-11T14:43:08.060311+0000","last_fullsized":"2024-09-11T14:43:08.060311+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.919824+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:42:38.919824+0000","last_peered":"2024-09-11T14:42:38.919824+0000","last_clean":"2024-09-11T14:42:38.919824+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:42:38.919824+0000","last_undegraded":"2024-09-11T14:42:38.919824+0000","last_fullsized":"2024-09-11T14:42:38.919824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"55'122","reported_seq":134,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:03.870607+0000","last_change":"2024-09-11T14:42:38.132564+0000","last_active":"2024-09-11T14:43:03.870607+0000","last_peered":"2024-09-11T14:43:03.870607+0000","last_clean":"2024-09-11T14:43:03.870607+0000","last_became_active":"2024-09-11T14:42:38.112585+0000","last_became_peered":"2024-09-11T14:42:38.112585+0000","last_unstale":"2024-09-11T14:43:03.870607+0000","last_undegraded":"2024-09-11T14:43:03.870607+0000","last_fullsized":"2024-09-11T14:43:03.870607+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.917862+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:42:38.917862+0000","last_peered":"2024-09-11T14:42:38.917862+0000","last_clean":"2024-09-11T14:42:38.917862+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:42:38.917862+0000","last_undegraded":"2024-09-11T14:42:38.917862+0000","last_fullsized":"2024-09-11T14:42:38.917862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"55'128","reported_seq":140,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.214698+0000","last_change":"2024-09-11T14:42:38.233207+0000","last_active":"2024-09-11T14:43:08.214698+0000","last_peered":"2024-09-11T14:43:08.214698+0000","last_clean":"2024-09-11T14:43:08.214698+0000","last_became_active":"2024-09-11T14:42:38.225462+0000","last_became_peered":"2024-09-11T14:42:38.225462+0000","last_unstale":"2024-09-11T14:43:08.214698+0000","last_undegraded":"2024-09-11T14:43:08.214698+0000","last_fullsized":"2024-09-11T14:43:08.214698+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.925822+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:42:38.925822+0000","last_peered":"2024-09-11T14:42:38.925822+0000","last_clean":"2024-09-11T14:42:38.925822+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:42:38.925822+0000","last_undegraded":"2024-09-11T14:42:38.925822+0000","last_fullsized":"2024-09-11T14:42:38.925822+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":133169152,"num_objects":2032,"num_object_clones":0,"num_object_copies":6096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2032,"num_write_kb":130048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213414023168,"internally_reserved":0,"allocated":797470720,"data_stored":797470720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2032,"ondisk_log_size":2032,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213414023168,"internally_reserved":0,"allocated":797470720,"data_stored":797470720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53390831616,"internally_reserved":0,"allocated":162041856,"data_stored":162041856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":152580,"kb_used_data":152580,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52145148,"statfs":{"total":53552873472,"available":53396631552,"internally_reserved":0,"allocated":156241920,"data_stored":156241920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706088,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":233368,"kb_used_data":233368,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52064360,"statfs":{"total":53552873472,"available":53313904640,"internally_reserved":0,"allocated":238968832,"data_stored":238968832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706088,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":217180,"kb_used_data":217180,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52080548,"statfs":{"total":53552873472,"available":53330481152,"internally_reserved":0,"allocated":222392320,"data_stored":222392320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706088,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":159964,"kb_used_data":159964,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52137764,"statfs":{"total":53552873472,"available":53389070336,"internally_reserved":0,"allocated":163803136,"data_stored":163803136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53390831616,"internally_reserved":0,"allocated":162041856,"data_stored":162041856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53327200256,"internally_reserved":0,"allocated":225673216,"data_stored":225673216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53385248768,"internally_reserved":0,"allocated":167624704,"data_stored":167624704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53310742528,"internally_reserved":0,"allocated":242130944,"data_stored":242130944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53390831616,"internally_reserved":0,"allocated":162041856,"data_stored":162041856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53327200256,"internally_reserved":0,"allocated":225673216,"data_stored":225673216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53385248768,"internally_reserved":0,"allocated":167624704,"data_stored":167624704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53310742528,"internally_reserved":0,"allocated":242130944,"data_stored":242130944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53390831616,"internally_reserved":0,"allocated":162041856,"data_stored":162041856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:43:10.006 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 31 16 2155 2139 4.31211 3.6875 0.76723 0.230847 2024-09-11T14:43:11.006 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 32 16 2218 2202 4.30039 3.9375 0.294313 0.231633 2024-09-11T14:43:12.006 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 33 16 2293 2277 4.31211 4.6875 0.275225 0.230077 2024-09-11T14:43:12.207 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:43:12.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:12.329+0000 7fd416d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:12.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:12.336+0000 7fd416d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:13.006 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 34 16 2363 2347 4.31395 4.375 0.10029 0.23015 2024-09-11T14:43:14.006 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 35 16 2435 2419 4.31925 4.5 0.495262 0.23054 2024-09-11T14:43:14.770 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:43:14.770 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:43:14.770 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:43:14.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:14.901+0000 7fe14e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:14.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:14.912+0000 7fe14e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:14.949 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:43:15.006 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 36 16 2509 2493 4.32773 4.625 0.180121 0.230252 2024-09-11T14:43:15.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:15.077+0000 7f1ce84a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:15.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:15.084+0000 7f1ce84a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:15.291 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:43:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:43:15.316 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":263,"stamp":"2024-09-11T14:43:13.312265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":136315443,"num_objects":2075,"num_object_clones":0,"num_object_copies":6225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2152,"num_write_kb":133652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2126,"ondisk_log_size":2126,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":796316,"kb_used_data":796316,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208394596,"statfs":{"total":214211493888,"available":213396066304,"internally_reserved":0,"allocated":815427584,"data_stored":815427584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46858240,"num_objects":715,"num_object_clones":0,"num_object_copies":2145,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":715,"num_write_kb":45760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002568"},"pg_stats":[{"pgid":"5.f","version":"55'137","reported_seq":149,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.117625+0000","last_change":"2024-09-11T14:42:38.114713+0000","last_active":"2024-09-11T14:43:08.117625+0000","last_peered":"2024-09-11T14:43:08.117625+0000","last_clean":"2024-09-11T14:43:08.117625+0000","last_became_active":"2024-09-11T14:42:38.099767+0000","last_became_peered":"2024-09-11T14:42:38.099767+0000","last_unstale":"2024-09-11T14:43:08.117625+0000","last_undegraded":"2024-09-11T14:43:08.117625+0000","last_fullsized":"2024-09-11T14:43:08.117625+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"55'141","reported_seq":153,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.149260+0000","last_change":"2024-09-11T14:42:38.177741+0000","last_active":"2024-09-11T14:43:08.149260+0000","last_peered":"2024-09-11T14:43:08.149260+0000","last_clean":"2024-09-11T14:43:08.149260+0000","last_became_active":"2024-09-11T14:42:38.170462+0000","last_became_peered":"2024-09-11T14:42:38.170462+0000","last_unstale":"2024-09-11T14:43:08.149260+0000","last_undegraded":"2024-09-11T14:43:08.149260+0000","last_fullsized":"2024-09-11T14:43:08.149260+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9240576,"num_objects":141,"num_object_clones":0,"num_object_copies":423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":9024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"55'130","reported_seq":142,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.155676+0000","last_change":"2024-09-11T14:42:38.204931+0000","last_active":"2024-09-11T14:43:08.155676+0000","last_peered":"2024-09-11T14:43:08.155676+0000","last_clean":"2024-09-11T14:43:08.155676+0000","last_became_active":"2024-09-11T14:42:38.189110+0000","last_became_peered":"2024-09-11T14:42:38.189110+0000","last_unstale":"2024-09-11T14:43:08.155676+0000","last_undegraded":"2024-09-11T14:43:08.155676+0000","last_fullsized":"2024-09-11T14:43:08.155676+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"55'137","reported_seq":149,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:09.175448+0000","last_change":"2024-09-11T14:42:38.097894+0000","last_active":"2024-09-11T14:43:09.175448+0000","last_peered":"2024-09-11T14:43:09.175448+0000","last_clean":"2024-09-11T14:43:09.175448+0000","last_became_active":"2024-09-11T14:42:38.068084+0000","last_became_peered":"2024-09-11T14:42:38.068084+0000","last_unstale":"2024-09-11T14:43:09.175448+0000","last_undegraded":"2024-09-11T14:43:09.175448+0000","last_fullsized":"2024-09-11T14:43:09.175448+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"55'112","reported_seq":124,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:07.895224+0000","last_change":"2024-09-11T14:42:38.084302+0000","last_active":"2024-09-11T14:43:07.895224+0000","last_peered":"2024-09-11T14:43:07.895224+0000","last_clean":"2024-09-11T14:43:07.895224+0000","last_became_active":"2024-09-11T14:42:38.060054+0000","last_became_peered":"2024-09-11T14:42:38.060054+0000","last_unstale":"2024-09-11T14:43:07.895224+0000","last_undegraded":"2024-09-11T14:43:07.895224+0000","last_fullsized":"2024-09-11T14:43:07.895224+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"55'133","reported_seq":145,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.281236+0000","last_change":"2024-09-11T14:42:38.114647+0000","last_active":"2024-09-11T14:43:08.281236+0000","last_peered":"2024-09-11T14:43:08.281236+0000","last_clean":"2024-09-11T14:43:08.281236+0000","last_became_active":"2024-09-11T14:42:38.075902+0000","last_became_peered":"2024-09-11T14:42:38.075902+0000","last_unstale":"2024-09-11T14:43:08.281236+0000","last_undegraded":"2024-09-11T14:43:08.281236+0000","last_fullsized":"2024-09-11T14:43:08.281236+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"55'127","reported_seq":139,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:07.881088+0000","last_change":"2024-09-11T14:42:38.105488+0000","last_active":"2024-09-11T14:43:07.881088+0000","last_peered":"2024-09-11T14:43:07.881088+0000","last_clean":"2024-09-11T14:43:07.881088+0000","last_became_active":"2024-09-11T14:42:38.071282+0000","last_became_peered":"2024-09-11T14:42:38.071282+0000","last_unstale":"2024-09-11T14:43:07.881088+0000","last_undegraded":"2024-09-11T14:43:07.881088+0000","last_fullsized":"2024-09-11T14:43:07.881088+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"55'133","reported_seq":145,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.371211+0000","last_change":"2024-09-11T14:42:38.122969+0000","last_active":"2024-09-11T14:43:08.371211+0000","last_peered":"2024-09-11T14:43:08.371211+0000","last_clean":"2024-09-11T14:43:08.371211+0000","last_became_active":"2024-09-11T14:42:38.109230+0000","last_became_peered":"2024-09-11T14:42:38.109230+0000","last_unstale":"2024-09-11T14:43:08.371211+0000","last_undegraded":"2024-09-11T14:43:08.371211+0000","last_fullsized":"2024-09-11T14:43:08.371211+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"55'136","reported_seq":148,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.038986+0000","last_change":"2024-09-11T14:42:38.222378+0000","last_active":"2024-09-11T14:43:08.038986+0000","last_peered":"2024-09-11T14:43:08.038986+0000","last_clean":"2024-09-11T14:43:08.038986+0000","last_became_active":"2024-09-11T14:42:38.204348+0000","last_became_peered":"2024-09-11T14:42:38.204348+0000","last_unstale":"2024-09-11T14:43:08.038986+0000","last_undegraded":"2024-09-11T14:43:08.038986+0000","last_fullsized":"2024-09-11T14:43:08.038986+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8912896,"num_objects":136,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":8704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":205,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.913572+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:42:38.913572+0000","last_peered":"2024-09-11T14:42:38.913572+0000","last_clean":"2024-09-11T14:42:38.913572+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:42:38.913572+0000","last_undegraded":"2024-09-11T14:42:38.913572+0000","last_fullsized":"2024-09-11T14:42:38.913572+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":134,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.922201+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:42:38.922201+0000","last_peered":"2024-09-11T14:42:38.922201+0000","last_clean":"2024-09-11T14:42:38.922201+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:42:38.922201+0000","last_undegraded":"2024-09-11T14:42:38.922201+0000","last_fullsized":"2024-09-11T14:42:38.922201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"55'127","reported_seq":139,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:07.364666+0000","last_change":"2024-09-11T14:42:38.156444+0000","last_active":"2024-09-11T14:43:07.364666+0000","last_peered":"2024-09-11T14:43:07.364666+0000","last_clean":"2024-09-11T14:43:07.364666+0000","last_became_active":"2024-09-11T14:42:38.142793+0000","last_became_peered":"2024-09-11T14:42:38.142793+0000","last_unstale":"2024-09-11T14:43:07.364666+0000","last_undegraded":"2024-09-11T14:43:07.364666+0000","last_fullsized":"2024-09-11T14:43:07.364666+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.926607+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:42:38.926607+0000","last_peered":"2024-09-11T14:42:38.926607+0000","last_clean":"2024-09-11T14:42:38.926607+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:42:38.926607+0000","last_undegraded":"2024-09-11T14:42:38.926607+0000","last_fullsized":"2024-09-11T14:42:38.926607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"55'127","reported_seq":139,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:07.927886+0000","last_change":"2024-09-11T14:42:38.179244+0000","last_active":"2024-09-11T14:43:07.927886+0000","last_peered":"2024-09-11T14:43:07.927886+0000","last_clean":"2024-09-11T14:43:07.927886+0000","last_became_active":"2024-09-11T14:42:38.159043+0000","last_became_peered":"2024-09-11T14:42:38.159043+0000","last_unstale":"2024-09-11T14:43:07.927886+0000","last_undegraded":"2024-09-11T14:43:07.927886+0000","last_fullsized":"2024-09-11T14:43:07.927886+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.915623+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:42:38.915623+0000","last_peered":"2024-09-11T14:42:38.915623+0000","last_clean":"2024-09-11T14:42:38.915623+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:42:38.915623+0000","last_undegraded":"2024-09-11T14:42:38.915623+0000","last_fullsized":"2024-09-11T14:42:38.915623+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"55'115","reported_seq":127,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.324569+0000","last_change":"2024-09-11T14:42:38.098677+0000","last_active":"2024-09-11T14:43:08.324569+0000","last_peered":"2024-09-11T14:43:08.324569+0000","last_clean":"2024-09-11T14:43:08.324569+0000","last_became_active":"2024-09-11T14:42:38.060593+0000","last_became_peered":"2024-09-11T14:42:38.060593+0000","last_unstale":"2024-09-11T14:43:08.324569+0000","last_undegraded":"2024-09-11T14:43:08.324569+0000","last_fullsized":"2024-09-11T14:43:08.324569+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":135,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.918644+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:42:38.918644+0000","last_peered":"2024-09-11T14:42:38.918644+0000","last_clean":"2024-09-11T14:42:38.918644+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:42:38.918644+0000","last_undegraded":"2024-09-11T14:42:38.918644+0000","last_fullsized":"2024-09-11T14:42:38.918644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"55'127","reported_seq":139,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.161739+0000","last_change":"2024-09-11T14:42:38.108084+0000","last_active":"2024-09-11T14:43:08.161739+0000","last_peered":"2024-09-11T14:43:08.161739+0000","last_clean":"2024-09-11T14:43:08.161739+0000","last_became_active":"2024-09-11T14:42:38.044460+0000","last_became_peered":"2024-09-11T14:42:38.044460+0000","last_unstale":"2024-09-11T14:43:08.161739+0000","last_undegraded":"2024-09-11T14:43:08.161739+0000","last_fullsized":"2024-09-11T14:43:08.161739+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.917356+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:42:38.917356+0000","last_peered":"2024-09-11T14:42:38.917356+0000","last_clean":"2024-09-11T14:42:38.917356+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:42:38.917356+0000","last_undegraded":"2024-09-11T14:42:38.917356+0000","last_fullsized":"2024-09-11T14:42:38.917356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"55'123","reported_seq":135,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.060311+0000","last_change":"2024-09-11T14:42:38.096488+0000","last_active":"2024-09-11T14:43:08.060311+0000","last_peered":"2024-09-11T14:43:08.060311+0000","last_clean":"2024-09-11T14:43:08.060311+0000","last_became_active":"2024-09-11T14:42:38.071104+0000","last_became_peered":"2024-09-11T14:42:38.071104+0000","last_unstale":"2024-09-11T14:43:08.060311+0000","last_undegraded":"2024-09-11T14:43:08.060311+0000","last_fullsized":"2024-09-11T14:43:08.060311+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.919824+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:42:38.919824+0000","last_peered":"2024-09-11T14:42:38.919824+0000","last_clean":"2024-09-11T14:42:38.919824+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:42:38.919824+0000","last_undegraded":"2024-09-11T14:42:38.919824+0000","last_fullsized":"2024-09-11T14:42:38.919824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"55'138","reported_seq":150,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.723614+0000","last_change":"2024-09-11T14:42:38.132564+0000","last_active":"2024-09-11T14:43:08.723614+0000","last_peered":"2024-09-11T14:43:08.723614+0000","last_clean":"2024-09-11T14:43:08.723614+0000","last_became_active":"2024-09-11T14:42:38.112585+0000","last_became_peered":"2024-09-11T14:42:38.112585+0000","last_unstale":"2024-09-11T14:43:08.723614+0000","last_undegraded":"2024-09-11T14:43:08.723614+0000","last_fullsized":"2024-09-11T14:43:08.723614+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.917862+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:42:38.917862+0000","last_peered":"2024-09-11T14:42:38.917862+0000","last_clean":"2024-09-11T14:42:38.917862+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:42:38.917862+0000","last_undegraded":"2024-09-11T14:42:38.917862+0000","last_fullsized":"2024-09-11T14:42:38.917862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"55'128","reported_seq":140,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:08.214698+0000","last_change":"2024-09-11T14:42:38.233207+0000","last_active":"2024-09-11T14:43:08.214698+0000","last_peered":"2024-09-11T14:43:08.214698+0000","last_clean":"2024-09-11T14:43:08.214698+0000","last_became_active":"2024-09-11T14:42:38.225462+0000","last_became_peered":"2024-09-11T14:42:38.225462+0000","last_unstale":"2024-09-11T14:43:08.214698+0000","last_undegraded":"2024-09-11T14:43:08.214698+0000","last_fullsized":"2024-09-11T14:43:08.214698+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.925822+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:42:38.925822+0000","last_peered":"2024-09-11T14:42:38.925822+0000","last_clean":"2024-09-11T14:42:38.925822+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:42:38.925822+0000","last_undegraded":"2024-09-11T14:42:38.925822+0000","last_fullsized":"2024-09-11T14:42:38.925822+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":135725056,"num_objects":2071,"num_object_clones":0,"num_object_copies":6213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2071,"num_write_kb":132544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213382381568,"internally_reserved":0,"allocated":829112320,"data_stored":829112320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2071,"ondisk_log_size":2071,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213382381568,"internally_reserved":0,"allocated":829112320,"data_stored":829112320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53359190016,"internally_reserved":0,"allocated":193683456,"data_stored":193683456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673384,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":185804,"kb_used_data":185804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52111924,"statfs":{"total":53552873472,"available":53362610176,"internally_reserved":0,"allocated":190263296,"data_stored":190263296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706088,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":233368,"kb_used_data":233368,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52064360,"statfs":{"total":53552873472,"available":53313904640,"internally_reserved":0,"allocated":238968832,"data_stored":238968832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706088,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":217180,"kb_used_data":217180,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52080548,"statfs":{"total":53552873472,"available":53330481152,"internally_reserved":0,"allocated":222392320,"data_stored":222392320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706088,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":159964,"kb_used_data":159964,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52137764,"statfs":{"total":53552873472,"available":53389070336,"internally_reserved":0,"allocated":163803136,"data_stored":163803136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53359190016,"internally_reserved":0,"allocated":193683456,"data_stored":193683456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53327200256,"internally_reserved":0,"allocated":225673216,"data_stored":225673216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53385248768,"internally_reserved":0,"allocated":167624704,"data_stored":167624704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53310742528,"internally_reserved":0,"allocated":242130944,"data_stored":242130944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53359190016,"internally_reserved":0,"allocated":193683456,"data_stored":193683456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53327200256,"internally_reserved":0,"allocated":225673216,"data_stored":225673216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53385248768,"internally_reserved":0,"allocated":167624704,"data_stored":167624704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53310742528,"internally_reserved":0,"allocated":242130944,"data_stored":242130944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53359190016,"internally_reserved":0,"allocated":193683456,"data_stored":193683456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:43:16.006 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 37 16 2581 2565 4.33238 4.5 0.329796 0.22985 2024-09-11T14:43:17.007 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 38 16 2642 2626 4.31869 3.8125 0.255166 0.230397 2024-09-11T14:43:17.710 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:43:17.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:17.854+0000 7ff5f2391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:17.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:17.863+0000 7ff5f2391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:18.006 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 39 16 2699 2683 4.29929 3.5625 0.20381 0.231408 2024-09-11T14:43:19.007 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:43:19.006610+0000 min lat: 0.0325842 max lat: 1.40872 avg lat: 0.232671 2024-09-11T14:43:19.007 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:43:19.007 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 40 16 2758 2742 4.28399 3.6875 0.1378 0.232671 2024-09-11T14:43:20.007 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 41 16 2826 2810 4.28315 4.25 0.0898317 0.232541 2024-09-11T14:43:20.318 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:43:20.318 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:43:20.318 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:43:20.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:20.463+0000 7f78e8191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:20.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:20.476+0000 7f78e8191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:20.510 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:43:20.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:20.684+0000 7f021a68e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:20.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:20.694+0000 7f021a68e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:20.755 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:43:20.756 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:43:20.772 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2024-09-11T14:43:19.313645+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":177144371,"num_objects":2698,"num_object_clones":0,"num_object_copies":8094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2775,"num_write_kb":173524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2749,"ondisk_log_size":2749,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1024308,"kb_used_data":1024308,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208166604,"statfs":{"total":214211493888,"available":213162602496,"internally_reserved":0,"allocated":1048891392,"data_stored":1048891392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":65601536,"num_objects":1001,"num_object_clones":0,"num_object_copies":3003,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1001,"num_write_kb":64064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002604"},"pg_stats":[{"pgid":"5.f","version":"55'178","reported_seq":190,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:17.247068+0000","last_change":"2024-09-11T14:42:38.114713+0000","last_active":"2024-09-11T14:43:17.247068+0000","last_peered":"2024-09-11T14:43:17.247068+0000","last_clean":"2024-09-11T14:43:17.247068+0000","last_became_active":"2024-09-11T14:42:38.099767+0000","last_became_peered":"2024-09-11T14:42:38.099767+0000","last_unstale":"2024-09-11T14:43:17.247068+0000","last_undegraded":"2024-09-11T14:43:17.247068+0000","last_fullsized":"2024-09-11T14:43:17.247068+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11665408,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":11392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"55'183","reported_seq":195,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:17.626290+0000","last_change":"2024-09-11T14:42:38.177741+0000","last_active":"2024-09-11T14:43:17.626290+0000","last_peered":"2024-09-11T14:43:17.626290+0000","last_clean":"2024-09-11T14:43:17.626290+0000","last_became_active":"2024-09-11T14:42:38.170462+0000","last_became_peered":"2024-09-11T14:42:38.170462+0000","last_unstale":"2024-09-11T14:43:17.626290+0000","last_undegraded":"2024-09-11T14:43:17.626290+0000","last_fullsized":"2024-09-11T14:43:17.626290+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":11712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"55'174","reported_seq":186,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:18.312928+0000","last_change":"2024-09-11T14:42:38.204931+0000","last_active":"2024-09-11T14:43:18.312928+0000","last_peered":"2024-09-11T14:43:18.312928+0000","last_clean":"2024-09-11T14:43:18.312928+0000","last_became_active":"2024-09-11T14:42:38.189110+0000","last_became_peered":"2024-09-11T14:42:38.189110+0000","last_unstale":"2024-09-11T14:43:18.312928+0000","last_undegraded":"2024-09-11T14:43:18.312928+0000","last_fullsized":"2024-09-11T14:43:18.312928+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11403264,"num_objects":174,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"55'161","reported_seq":173,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:14.267649+0000","last_change":"2024-09-11T14:42:38.097894+0000","last_active":"2024-09-11T14:43:14.267649+0000","last_peered":"2024-09-11T14:43:14.267649+0000","last_clean":"2024-09-11T14:43:14.267649+0000","last_became_active":"2024-09-11T14:42:38.068084+0000","last_became_peered":"2024-09-11T14:42:38.068084+0000","last_unstale":"2024-09-11T14:43:14.267649+0000","last_undegraded":"2024-09-11T14:43:14.267649+0000","last_fullsized":"2024-09-11T14:43:14.267649+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"55'155","reported_seq":167,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:17.200750+0000","last_change":"2024-09-11T14:42:38.084302+0000","last_active":"2024-09-11T14:43:17.200750+0000","last_peered":"2024-09-11T14:43:17.200750+0000","last_clean":"2024-09-11T14:43:17.200750+0000","last_became_active":"2024-09-11T14:42:38.060054+0000","last_became_peered":"2024-09-11T14:42:38.060054+0000","last_unstale":"2024-09-11T14:43:17.200750+0000","last_undegraded":"2024-09-11T14:43:17.200750+0000","last_fullsized":"2024-09-11T14:43:17.200750+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":9920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"55'171","reported_seq":183,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:18.157135+0000","last_change":"2024-09-11T14:42:38.114647+0000","last_active":"2024-09-11T14:43:18.157135+0000","last_peered":"2024-09-11T14:43:18.157135+0000","last_clean":"2024-09-11T14:43:18.157135+0000","last_became_active":"2024-09-11T14:42:38.075902+0000","last_became_peered":"2024-09-11T14:42:38.075902+0000","last_unstale":"2024-09-11T14:43:18.157135+0000","last_undegraded":"2024-09-11T14:43:18.157135+0000","last_fullsized":"2024-09-11T14:43:18.157135+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":10944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"55'167","reported_seq":179,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:17.960109+0000","last_change":"2024-09-11T14:42:38.105488+0000","last_active":"2024-09-11T14:43:17.960109+0000","last_peered":"2024-09-11T14:43:17.960109+0000","last_clean":"2024-09-11T14:43:17.960109+0000","last_became_active":"2024-09-11T14:42:38.071282+0000","last_became_peered":"2024-09-11T14:42:38.071282+0000","last_unstale":"2024-09-11T14:43:17.960109+0000","last_undegraded":"2024-09-11T14:43:17.960109+0000","last_fullsized":"2024-09-11T14:43:17.960109+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10944512,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":10688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"55'176","reported_seq":188,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:18.036256+0000","last_change":"2024-09-11T14:42:38.122969+0000","last_active":"2024-09-11T14:43:18.036256+0000","last_peered":"2024-09-11T14:43:18.036256+0000","last_clean":"2024-09-11T14:43:18.036256+0000","last_became_active":"2024-09-11T14:42:38.109230+0000","last_became_peered":"2024-09-11T14:42:38.109230+0000","last_unstale":"2024-09-11T14:43:18.036256+0000","last_undegraded":"2024-09-11T14:43:18.036256+0000","last_fullsized":"2024-09-11T14:43:18.036256+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":176,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"55'176","reported_seq":188,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:18.119910+0000","last_change":"2024-09-11T14:42:38.222378+0000","last_active":"2024-09-11T14:43:18.119910+0000","last_peered":"2024-09-11T14:43:18.119910+0000","last_clean":"2024-09-11T14:43:18.119910+0000","last_became_active":"2024-09-11T14:42:38.204348+0000","last_became_peered":"2024-09-11T14:42:38.204348+0000","last_unstale":"2024-09-11T14:43:18.119910+0000","last_undegraded":"2024-09-11T14:43:18.119910+0000","last_fullsized":"2024-09-11T14:43:18.119910+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":176,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":205,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.913572+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:42:38.913572+0000","last_peered":"2024-09-11T14:42:38.913572+0000","last_clean":"2024-09-11T14:42:38.913572+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:42:38.913572+0000","last_undegraded":"2024-09-11T14:42:38.913572+0000","last_fullsized":"2024-09-11T14:42:38.913572+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":134,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.922201+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:42:38.922201+0000","last_peered":"2024-09-11T14:42:38.922201+0000","last_clean":"2024-09-11T14:42:38.922201+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:42:38.922201+0000","last_undegraded":"2024-09-11T14:42:38.922201+0000","last_fullsized":"2024-09-11T14:42:38.922201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"55'156","reported_seq":168,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:16.949117+0000","last_change":"2024-09-11T14:42:38.156444+0000","last_active":"2024-09-11T14:43:16.949117+0000","last_peered":"2024-09-11T14:43:16.949117+0000","last_clean":"2024-09-11T14:43:16.949117+0000","last_became_active":"2024-09-11T14:42:38.142793+0000","last_became_peered":"2024-09-11T14:42:38.142793+0000","last_unstale":"2024-09-11T14:43:16.949117+0000","last_undegraded":"2024-09-11T14:43:16.949117+0000","last_fullsized":"2024-09-11T14:43:16.949117+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":9984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.926607+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:42:38.926607+0000","last_peered":"2024-09-11T14:42:38.926607+0000","last_clean":"2024-09-11T14:42:38.926607+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:42:38.926607+0000","last_undegraded":"2024-09-11T14:42:38.926607+0000","last_fullsized":"2024-09-11T14:42:38.926607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"55'164","reported_seq":176,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:17.811661+0000","last_change":"2024-09-11T14:42:38.179244+0000","last_active":"2024-09-11T14:43:17.811661+0000","last_peered":"2024-09-11T14:43:17.811661+0000","last_clean":"2024-09-11T14:43:17.811661+0000","last_became_active":"2024-09-11T14:42:38.159043+0000","last_became_peered":"2024-09-11T14:42:38.159043+0000","last_unstale":"2024-09-11T14:43:17.811661+0000","last_undegraded":"2024-09-11T14:43:17.811661+0000","last_fullsized":"2024-09-11T14:43:17.811661+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747904,"num_objects":164,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":10496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.915623+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:42:38.915623+0000","last_peered":"2024-09-11T14:42:38.915623+0000","last_clean":"2024-09-11T14:42:38.915623+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:42:38.915623+0000","last_undegraded":"2024-09-11T14:42:38.915623+0000","last_fullsized":"2024-09-11T14:42:38.915623+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"55'159","reported_seq":171,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:17.468109+0000","last_change":"2024-09-11T14:42:38.098677+0000","last_active":"2024-09-11T14:43:17.468109+0000","last_peered":"2024-09-11T14:43:17.468109+0000","last_clean":"2024-09-11T14:43:17.468109+0000","last_became_active":"2024-09-11T14:42:38.060593+0000","last_became_peered":"2024-09-11T14:42:38.060593+0000","last_unstale":"2024-09-11T14:43:17.468109+0000","last_undegraded":"2024-09-11T14:43:17.468109+0000","last_fullsized":"2024-09-11T14:43:17.468109+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":10176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":135,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.918644+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:42:38.918644+0000","last_peered":"2024-09-11T14:42:38.918644+0000","last_clean":"2024-09-11T14:42:38.918644+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:42:38.918644+0000","last_undegraded":"2024-09-11T14:42:38.918644+0000","last_fullsized":"2024-09-11T14:42:38.918644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"55'165","reported_seq":177,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:18.137483+0000","last_change":"2024-09-11T14:42:38.108084+0000","last_active":"2024-09-11T14:43:18.137483+0000","last_peered":"2024-09-11T14:43:18.137483+0000","last_clean":"2024-09-11T14:43:18.137483+0000","last_became_active":"2024-09-11T14:42:38.044460+0000","last_became_peered":"2024-09-11T14:42:38.044460+0000","last_unstale":"2024-09-11T14:43:18.137483+0000","last_undegraded":"2024-09-11T14:43:18.137483+0000","last_fullsized":"2024-09-11T14:43:18.137483+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":10560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.917356+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:42:38.917356+0000","last_peered":"2024-09-11T14:42:38.917356+0000","last_clean":"2024-09-11T14:42:38.917356+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:42:38.917356+0000","last_undegraded":"2024-09-11T14:42:38.917356+0000","last_fullsized":"2024-09-11T14:42:38.917356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"55'174","reported_seq":186,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:18.160237+0000","last_change":"2024-09-11T14:42:38.096488+0000","last_active":"2024-09-11T14:43:18.160237+0000","last_peered":"2024-09-11T14:43:18.160237+0000","last_clean":"2024-09-11T14:43:18.160237+0000","last_became_active":"2024-09-11T14:42:38.071104+0000","last_became_peered":"2024-09-11T14:42:38.071104+0000","last_unstale":"2024-09-11T14:43:18.160237+0000","last_undegraded":"2024-09-11T14:43:18.160237+0000","last_fullsized":"2024-09-11T14:43:18.160237+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11403264,"num_objects":174,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.919824+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:42:38.919824+0000","last_peered":"2024-09-11T14:42:38.919824+0000","last_clean":"2024-09-11T14:42:38.919824+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:42:38.919824+0000","last_undegraded":"2024-09-11T14:42:38.919824+0000","last_fullsized":"2024-09-11T14:42:38.919824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"55'165","reported_seq":177,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:14.386183+0000","last_change":"2024-09-11T14:42:38.132564+0000","last_active":"2024-09-11T14:43:14.386183+0000","last_peered":"2024-09-11T14:43:14.386183+0000","last_clean":"2024-09-11T14:43:14.386183+0000","last_became_active":"2024-09-11T14:42:38.112585+0000","last_became_peered":"2024-09-11T14:42:38.112585+0000","last_unstale":"2024-09-11T14:43:14.386183+0000","last_undegraded":"2024-09-11T14:43:14.386183+0000","last_fullsized":"2024-09-11T14:43:14.386183+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":10560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.917862+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:42:38.917862+0000","last_peered":"2024-09-11T14:42:38.917862+0000","last_clean":"2024-09-11T14:42:38.917862+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:42:38.917862+0000","last_undegraded":"2024-09-11T14:42:38.917862+0000","last_fullsized":"2024-09-11T14:42:38.917862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"55'170","reported_seq":182,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:18.012658+0000","last_change":"2024-09-11T14:42:38.233207+0000","last_active":"2024-09-11T14:43:18.012658+0000","last_peered":"2024-09-11T14:43:18.012658+0000","last_clean":"2024-09-11T14:43:18.012658+0000","last_became_active":"2024-09-11T14:42:38.225462+0000","last_became_peered":"2024-09-11T14:42:38.225462+0000","last_unstale":"2024-09-11T14:43:18.012658+0000","last_undegraded":"2024-09-11T14:43:18.012658+0000","last_fullsized":"2024-09-11T14:43:18.012658+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11141120,"num_objects":170,"num_object_clones":0,"num_object_copies":510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.925822+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:42:38.925822+0000","last_peered":"2024-09-11T14:42:38.925822+0000","last_clean":"2024-09-11T14:42:38.925822+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:42:38.925822+0000","last_undegraded":"2024-09-11T14:42:38.925822+0000","last_fullsized":"2024-09-11T14:42:38.925822+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":176553984,"num_objects":2694,"num_object_clones":0,"num_object_copies":8082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2694,"num_write_kb":172416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213149904896,"internally_reserved":0,"allocated":1061588992,"data_stored":1061588992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2694,"ondisk_log_size":2694,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213150035968,"internally_reserved":0,"allocated":1061457920,"data_stored":1061457920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53325930496,"internally_reserved":0,"allocated":226942976,"data_stored":226942976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673389,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":216612,"kb_used_data":216612,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52081116,"statfs":{"total":53552873472,"available":53331062784,"internally_reserved":0,"allocated":221810688,"data_stored":221810688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706098,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":307564,"kb_used_data":307564,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51990164,"statfs":{"total":53552873472,"available":53237927936,"internally_reserved":0,"allocated":314945536,"data_stored":314945536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706098,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":286368,"kb_used_data":286368,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52011360,"statfs":{"total":53552873472,"available":53259632640,"internally_reserved":0,"allocated":293240832,"data_stored":293240832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706098,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":213764,"kb_used_data":213764,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52083964,"statfs":{"total":53552873472,"available":53333979136,"internally_reserved":0,"allocated":218894336,"data_stored":218894336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53325930496,"internally_reserved":0,"allocated":226942976,"data_stored":226942976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53257236480,"internally_reserved":0,"allocated":295636992,"data_stored":295636992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53330825216,"internally_reserved":0,"allocated":222048256,"data_stored":222048256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53236043776,"internally_reserved":0,"allocated":316829696,"data_stored":316829696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53325930496,"internally_reserved":0,"allocated":226942976,"data_stored":226942976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53257236480,"internally_reserved":0,"allocated":295636992,"data_stored":295636992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53330825216,"internally_reserved":0,"allocated":222048256,"data_stored":222048256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53236043776,"internally_reserved":0,"allocated":316829696,"data_stored":316829696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53325799424,"internally_reserved":0,"allocated":227074048,"data_stored":227074048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:43:21.007 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 42 16 2893 2877 4.28086 4.1875 0.074544 0.232594 2024-09-11T14:43:22.007 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 43 16 2965 2949 4.28595 4.5 0.260827 0.232333 2024-09-11T14:43:22.893 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:43:23.007 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 44 16 3038 3022 4.29222 4.5625 0.278542 0.232182 2024-09-11T14:43:23.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:23.044+0000 7f85ded91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:23.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:23.052+0000 7f85ded91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:24.007 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 45 16 3119 3103 4.30933 5.0625 0.168099 0.231705 2024-09-11T14:43:25.007 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 46 16 3193 3177 4.31619 4.625 0.388009 0.231041 2024-09-11T14:43:25.445 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:43:25.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:25.566+0000 7fb8a4cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:25.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:25.573+0000 7fb8a4cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:25.774 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:43:25.774 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:43:25.774 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:43:25.775 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:43:25.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:25.932+0000 7f7effa6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:25.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:25.943+0000 7f7effa6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:25.962 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:43:25.962 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:43:25.963 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:43:25.963 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:43:25.963 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:43:25.963 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:43:25.963 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:43:25.963 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:43:25.963 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:43:25.963 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:43:25.963 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:43:25.963 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:43:25.965 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:43:25.966 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:43:25.966 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:43:26.007 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 47 16 3264 3248 4.31876 4.4375 0.386403 0.230704 2024-09-11T14:43:26.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:26.089+0000 7fd005d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:26.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:26.103+0000 7fd005d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:43:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:43:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:43:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:43:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:43:26.125 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:43:26.125 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:43:26.125 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:43:26.125 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:43:26.125 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:43:26.125 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:43:26.125 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:43:26.128 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:43:26.129 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:43:26.129 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:43:26.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:26.297+0000 7f008caa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:26.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:26.311+0000 7f008caa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:26.498 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:43:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:43:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:43:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:43:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:43:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:43:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:43:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:43:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:43:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:43:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:43:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:43:26.503 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:43:26.503 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:43:26.504 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:43:26.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:26.663+0000 7fdd8be63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:26.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:26.682+0000 7fdd8be63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:26.804 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:43:26.804 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:43:26.804 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:43:26.804 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:43:26.804 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:43:26.804 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:43:26.804 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:43:26.805 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:43:26.805 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:43:26.805 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:43:26.805 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:43:26.805 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:43:26.807 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:43:26.808 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:43:27.007 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 48 16 3346 3330 4.33555 5.125 0.250608 0.230056 2024-09-11T14:43:27.895 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:43:28.008 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 49 16 3416 3400 4.33634 4.375 0.142218 0.229882 2024-09-11T14:43:28.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:28.041+0000 7f922ed51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:28.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:28.047+0000 7f922ed51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:29.008 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 50 16 3486 3470 4.33711 4.375 0.49507 0.229842 2024-09-11T14:43:30.008 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 51 16 3564 3548 4.34765 4.875 0.154331 0.229426 2024-09-11T14:43:30.394 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:43:30.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:30.511+0000 7f4e77abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:30.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:30.517+0000 7f4e77abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:31.008 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 52 16 3634 3618 4.34816 4.375 0.120441 0.229175 2024-09-11T14:43:31.809 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:43:31.809 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:43:31.809 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:43:31.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:31.955+0000 7f753b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:31.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:31.970+0000 7f753b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:32.008 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 53 16 3706 3690 4.35102 4.5 0.147769 0.229301 2024-09-11T14:43:32.245 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:43:32.246 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:43:32.263 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-09-11T14:43:31.316255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":227148339,"num_objects":3461,"num_object_clones":0,"num_object_copies":10383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3538,"num_write_kb":222356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3512,"ondisk_log_size":3512,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1331732,"kb_used_data":1331732,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207859180,"statfs":{"total":214211493888,"available":212847800320,"internally_reserved":0,"allocated":1363693568,"data_stored":1363693568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":50003968,"num_objects":763,"num_object_clones":0,"num_object_copies":2289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":48832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002610"},"pg_stats":[{"pgid":"5.f","version":"55'213","reported_seq":225,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:28.101169+0000","last_change":"2024-09-11T14:42:38.114713+0000","last_active":"2024-09-11T14:43:28.101169+0000","last_peered":"2024-09-11T14:43:28.101169+0000","last_clean":"2024-09-11T14:43:28.101169+0000","last_became_active":"2024-09-11T14:42:38.099767+0000","last_became_peered":"2024-09-11T14:42:38.099767+0000","last_unstale":"2024-09-11T14:43:28.101169+0000","last_undegraded":"2024-09-11T14:43:28.101169+0000","last_fullsized":"2024-09-11T14:43:28.101169+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13959168,"num_objects":213,"num_object_clones":0,"num_object_copies":639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":13632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"55'226","reported_seq":238,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:27.599929+0000","last_change":"2024-09-11T14:42:38.177741+0000","last_active":"2024-09-11T14:43:27.599929+0000","last_peered":"2024-09-11T14:43:27.599929+0000","last_clean":"2024-09-11T14:43:27.599929+0000","last_became_active":"2024-09-11T14:42:38.170462+0000","last_became_peered":"2024-09-11T14:42:38.170462+0000","last_unstale":"2024-09-11T14:43:27.599929+0000","last_undegraded":"2024-09-11T14:43:27.599929+0000","last_fullsized":"2024-09-11T14:43:27.599929+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":14464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"55'228","reported_seq":240,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:28.116033+0000","last_change":"2024-09-11T14:42:38.204931+0000","last_active":"2024-09-11T14:43:28.116033+0000","last_peered":"2024-09-11T14:43:28.116033+0000","last_clean":"2024-09-11T14:43:28.116033+0000","last_became_active":"2024-09-11T14:42:38.189110+0000","last_became_peered":"2024-09-11T14:42:38.189110+0000","last_unstale":"2024-09-11T14:43:28.116033+0000","last_undegraded":"2024-09-11T14:43:28.116033+0000","last_fullsized":"2024-09-11T14:43:28.116033+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14942208,"num_objects":228,"num_object_clones":0,"num_object_copies":684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":14592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"55'223","reported_seq":235,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:29.325528+0000","last_change":"2024-09-11T14:42:38.097894+0000","last_active":"2024-09-11T14:43:29.325528+0000","last_peered":"2024-09-11T14:43:29.325528+0000","last_clean":"2024-09-11T14:43:29.325528+0000","last_became_active":"2024-09-11T14:42:38.068084+0000","last_became_peered":"2024-09-11T14:42:38.068084+0000","last_unstale":"2024-09-11T14:43:29.325528+0000","last_undegraded":"2024-09-11T14:43:29.325528+0000","last_fullsized":"2024-09-11T14:43:29.325528+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14614528,"num_objects":223,"num_object_clones":0,"num_object_copies":669,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":14272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"55'199","reported_seq":211,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:27.819783+0000","last_change":"2024-09-11T14:42:38.084302+0000","last_active":"2024-09-11T14:43:27.819783+0000","last_peered":"2024-09-11T14:43:27.819783+0000","last_clean":"2024-09-11T14:43:27.819783+0000","last_became_active":"2024-09-11T14:42:38.060054+0000","last_became_peered":"2024-09-11T14:42:38.060054+0000","last_unstale":"2024-09-11T14:43:27.819783+0000","last_undegraded":"2024-09-11T14:43:27.819783+0000","last_fullsized":"2024-09-11T14:43:27.819783+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13041664,"num_objects":199,"num_object_clones":0,"num_object_copies":597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":12736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"55'212","reported_seq":224,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:27.245622+0000","last_change":"2024-09-11T14:42:38.114647+0000","last_active":"2024-09-11T14:43:27.245622+0000","last_peered":"2024-09-11T14:43:27.245622+0000","last_clean":"2024-09-11T14:43:27.245622+0000","last_became_active":"2024-09-11T14:42:38.075902+0000","last_became_peered":"2024-09-11T14:42:38.075902+0000","last_unstale":"2024-09-11T14:43:27.245622+0000","last_undegraded":"2024-09-11T14:43:27.245622+0000","last_fullsized":"2024-09-11T14:43:27.245622+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13893632,"num_objects":212,"num_object_clones":0,"num_object_copies":636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":13568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"55'215","reported_seq":227,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:28.322897+0000","last_change":"2024-09-11T14:42:38.105488+0000","last_active":"2024-09-11T14:43:28.322897+0000","last_peered":"2024-09-11T14:43:28.322897+0000","last_clean":"2024-09-11T14:43:28.322897+0000","last_became_active":"2024-09-11T14:42:38.071282+0000","last_became_peered":"2024-09-11T14:42:38.071282+0000","last_unstale":"2024-09-11T14:43:28.322897+0000","last_undegraded":"2024-09-11T14:43:28.322897+0000","last_fullsized":"2024-09-11T14:43:28.322897+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14090240,"num_objects":215,"num_object_clones":0,"num_object_copies":645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":13760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"55'210","reported_seq":222,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:27.654485+0000","last_change":"2024-09-11T14:42:38.122969+0000","last_active":"2024-09-11T14:43:27.654485+0000","last_peered":"2024-09-11T14:43:27.654485+0000","last_clean":"2024-09-11T14:43:27.654485+0000","last_became_active":"2024-09-11T14:42:38.109230+0000","last_became_peered":"2024-09-11T14:42:38.109230+0000","last_unstale":"2024-09-11T14:43:27.654485+0000","last_undegraded":"2024-09-11T14:43:27.654485+0000","last_fullsized":"2024-09-11T14:43:27.654485+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13762560,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":13440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"55'218","reported_seq":230,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:28.056689+0000","last_change":"2024-09-11T14:42:38.222378+0000","last_active":"2024-09-11T14:43:28.056689+0000","last_peered":"2024-09-11T14:43:28.056689+0000","last_clean":"2024-09-11T14:43:28.056689+0000","last_became_active":"2024-09-11T14:42:38.204348+0000","last_became_peered":"2024-09-11T14:42:38.204348+0000","last_unstale":"2024-09-11T14:43:28.056689+0000","last_undegraded":"2024-09-11T14:43:28.056689+0000","last_fullsized":"2024-09-11T14:43:28.056689+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14286848,"num_objects":218,"num_object_clones":0,"num_object_copies":654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":13952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":205,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.913572+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:42:38.913572+0000","last_peered":"2024-09-11T14:42:38.913572+0000","last_clean":"2024-09-11T14:42:38.913572+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:42:38.913572+0000","last_undegraded":"2024-09-11T14:42:38.913572+0000","last_fullsized":"2024-09-11T14:42:38.913572+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":134,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.922201+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:42:38.922201+0000","last_peered":"2024-09-11T14:42:38.922201+0000","last_clean":"2024-09-11T14:42:38.922201+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:42:38.922201+0000","last_undegraded":"2024-09-11T14:42:38.922201+0000","last_fullsized":"2024-09-11T14:42:38.922201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"55'202","reported_seq":214,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:28.238557+0000","last_change":"2024-09-11T14:42:38.156444+0000","last_active":"2024-09-11T14:43:28.238557+0000","last_peered":"2024-09-11T14:43:28.238557+0000","last_clean":"2024-09-11T14:43:28.238557+0000","last_became_active":"2024-09-11T14:42:38.142793+0000","last_became_peered":"2024-09-11T14:42:38.142793+0000","last_unstale":"2024-09-11T14:43:28.238557+0000","last_undegraded":"2024-09-11T14:43:28.238557+0000","last_fullsized":"2024-09-11T14:43:28.238557+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13238272,"num_objects":202,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":12928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.926607+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:42:38.926607+0000","last_peered":"2024-09-11T14:42:38.926607+0000","last_clean":"2024-09-11T14:42:38.926607+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:42:38.926607+0000","last_undegraded":"2024-09-11T14:42:38.926607+0000","last_fullsized":"2024-09-11T14:42:38.926607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"55'215","reported_seq":227,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:28.082460+0000","last_change":"2024-09-11T14:42:38.179244+0000","last_active":"2024-09-11T14:43:28.082460+0000","last_peered":"2024-09-11T14:43:28.082460+0000","last_clean":"2024-09-11T14:43:28.082460+0000","last_became_active":"2024-09-11T14:42:38.159043+0000","last_became_peered":"2024-09-11T14:42:38.159043+0000","last_unstale":"2024-09-11T14:43:28.082460+0000","last_undegraded":"2024-09-11T14:43:28.082460+0000","last_fullsized":"2024-09-11T14:43:28.082460+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14090240,"num_objects":215,"num_object_clones":0,"num_object_copies":645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":13760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.915623+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:42:38.915623+0000","last_peered":"2024-09-11T14:42:38.915623+0000","last_clean":"2024-09-11T14:42:38.915623+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:42:38.915623+0000","last_undegraded":"2024-09-11T14:42:38.915623+0000","last_fullsized":"2024-09-11T14:42:38.915623+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"55'214","reported_seq":226,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:28.165007+0000","last_change":"2024-09-11T14:42:38.098677+0000","last_active":"2024-09-11T14:43:28.165007+0000","last_peered":"2024-09-11T14:43:28.165007+0000","last_clean":"2024-09-11T14:43:28.165007+0000","last_became_active":"2024-09-11T14:42:38.060593+0000","last_became_peered":"2024-09-11T14:42:38.060593+0000","last_unstale":"2024-09-11T14:43:28.165007+0000","last_undegraded":"2024-09-11T14:43:28.165007+0000","last_fullsized":"2024-09-11T14:43:28.165007+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":135,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.918644+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:42:38.918644+0000","last_peered":"2024-09-11T14:42:38.918644+0000","last_clean":"2024-09-11T14:42:38.918644+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:42:38.918644+0000","last_undegraded":"2024-09-11T14:42:38.918644+0000","last_fullsized":"2024-09-11T14:42:38.918644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"55'214","reported_seq":226,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:27.914052+0000","last_change":"2024-09-11T14:42:38.108084+0000","last_active":"2024-09-11T14:43:27.914052+0000","last_peered":"2024-09-11T14:43:27.914052+0000","last_clean":"2024-09-11T14:43:27.914052+0000","last_became_active":"2024-09-11T14:42:38.044460+0000","last_became_peered":"2024-09-11T14:42:38.044460+0000","last_unstale":"2024-09-11T14:43:27.914052+0000","last_undegraded":"2024-09-11T14:43:27.914052+0000","last_fullsized":"2024-09-11T14:43:27.914052+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.917356+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:42:38.917356+0000","last_peered":"2024-09-11T14:42:38.917356+0000","last_clean":"2024-09-11T14:42:38.917356+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:42:38.917356+0000","last_undegraded":"2024-09-11T14:42:38.917356+0000","last_fullsized":"2024-09-11T14:42:38.917356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"55'214","reported_seq":226,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:28.313386+0000","last_change":"2024-09-11T14:42:38.096488+0000","last_active":"2024-09-11T14:43:28.313386+0000","last_peered":"2024-09-11T14:43:28.313386+0000","last_clean":"2024-09-11T14:43:28.313386+0000","last_became_active":"2024-09-11T14:42:38.071104+0000","last_became_peered":"2024-09-11T14:42:38.071104+0000","last_unstale":"2024-09-11T14:43:28.313386+0000","last_undegraded":"2024-09-11T14:43:28.313386+0000","last_fullsized":"2024-09-11T14:43:28.313386+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.919824+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:42:38.919824+0000","last_peered":"2024-09-11T14:42:38.919824+0000","last_clean":"2024-09-11T14:42:38.919824+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:42:38.919824+0000","last_undegraded":"2024-09-11T14:42:38.919824+0000","last_fullsized":"2024-09-11T14:42:38.919824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"55'239","reported_seq":251,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:29.062428+0000","last_change":"2024-09-11T14:42:38.132564+0000","last_active":"2024-09-11T14:43:29.062428+0000","last_peered":"2024-09-11T14:43:29.062428+0000","last_clean":"2024-09-11T14:43:29.062428+0000","last_became_active":"2024-09-11T14:42:38.112585+0000","last_became_peered":"2024-09-11T14:42:38.112585+0000","last_unstale":"2024-09-11T14:43:29.062428+0000","last_undegraded":"2024-09-11T14:43:29.062428+0000","last_fullsized":"2024-09-11T14:43:29.062428+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":15296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.917862+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:42:38.917862+0000","last_peered":"2024-09-11T14:42:38.917862+0000","last_clean":"2024-09-11T14:42:38.917862+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:42:38.917862+0000","last_undegraded":"2024-09-11T14:42:38.917862+0000","last_fullsized":"2024-09-11T14:42:38.917862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"55'215","reported_seq":227,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:27.894146+0000","last_change":"2024-09-11T14:42:38.233207+0000","last_active":"2024-09-11T14:43:27.894146+0000","last_peered":"2024-09-11T14:43:27.894146+0000","last_clean":"2024-09-11T14:43:27.894146+0000","last_became_active":"2024-09-11T14:42:38.225462+0000","last_became_peered":"2024-09-11T14:42:38.225462+0000","last_unstale":"2024-09-11T14:43:27.894146+0000","last_undegraded":"2024-09-11T14:43:27.894146+0000","last_fullsized":"2024-09-11T14:43:27.894146+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14090240,"num_objects":215,"num_object_clones":0,"num_object_copies":645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":13760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.925822+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:42:38.925822+0000","last_peered":"2024-09-11T14:42:38.925822+0000","last_clean":"2024-09-11T14:42:38.925822+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:42:38.925822+0000","last_undegraded":"2024-09-11T14:42:38.925822+0000","last_fullsized":"2024-09-11T14:42:38.925822+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":226557952,"num_objects":3457,"num_object_clones":0,"num_object_copies":10371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3457,"num_write_kb":221248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212835262464,"internally_reserved":0,"allocated":1376231424,"data_stored":1376231424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3457,"ondisk_log_size":3457,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212835262464,"internally_reserved":0,"allocated":1376231424,"data_stored":1376231424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53229084672,"internally_reserved":0,"allocated":323788800,"data_stored":323788800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673404,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":311072,"kb_used_data":311072,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51986656,"statfs":{"total":53552873472,"available":53234335744,"internally_reserved":0,"allocated":318537728,"data_stored":318537728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706108,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":389876,"kb_used_data":389876,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51907852,"statfs":{"total":53552873472,"available":53153640448,"internally_reserved":0,"allocated":399233024,"data_stored":399233024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706108,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":360904,"kb_used_data":360904,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51936824,"statfs":{"total":53552873472,"available":53183307776,"internally_reserved":0,"allocated":369565696,"data_stored":369565696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706108,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":269880,"kb_used_data":269880,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52027848,"statfs":{"total":53552873472,"available":53276516352,"internally_reserved":0,"allocated":276357120,"data_stored":276357120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53229084672,"internally_reserved":0,"allocated":323788800,"data_stored":323788800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53181460480,"internally_reserved":0,"allocated":371412992,"data_stored":371412992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53273985024,"internally_reserved":0,"allocated":278888448,"data_stored":278888448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53150732288,"internally_reserved":0,"allocated":402141184,"data_stored":402141184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53229084672,"internally_reserved":0,"allocated":323788800,"data_stored":323788800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53181460480,"internally_reserved":0,"allocated":371412992,"data_stored":371412992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53273985024,"internally_reserved":0,"allocated":278888448,"data_stored":278888448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53150732288,"internally_reserved":0,"allocated":402141184,"data_stored":402141184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53229084672,"internally_reserved":0,"allocated":323788800,"data_stored":323788800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:43:32.881 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:43:33.008 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 54 16 3777 3761 4.35261 4.4375 0.211491 0.229017 2024-09-11T14:43:33.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:33.039+0000 7f8199191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:33.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:33.048+0000 7f8199191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:34.008 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 55 16 3857 3841 4.36438 5 0.136999 0.228644 2024-09-11T14:43:35.008 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 56 16 3916 3900 4.35228 3.6875 0.257244 0.228611 2024-09-11T14:43:35.576 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:43:35.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:35.749+0000 7ff76b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:35.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:35.758+0000 7ff76b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:36.008 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 57 16 3966 3950 4.33075 3.125 0.14326 0.229522 2024-09-11T14:43:37.008 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 58 16 4017 4001 4.31103 3.1875 0.165397 0.230869 2024-09-11T14:43:37.266 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:43:37.266 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:43:37.266 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:43:37.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:37.392+0000 7f530b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:37.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:37.407+0000 7f530b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:37.710 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:43:37.711 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:43:37.725 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":275,"stamp":"2024-09-11T14:43:37.317570+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":250806835,"num_objects":3822,"num_object_clones":0,"num_object_copies":11466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3899,"num_write_kb":245460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3873,"ondisk_log_size":3873,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1471900,"kb_used_data":1471900,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207719012,"statfs":{"total":214211493888,"available":212704268288,"internally_reserved":0,"allocated":1507225600,"data_stored":1507225600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48300032,"num_objects":737,"num_object_clones":0,"num_object_copies":2211,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":737,"num_write_kb":47168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002653"},"pg_stats":[{"pgid":"5.f","version":"55'230","reported_seq":242,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:33.245557+0000","last_change":"2024-09-11T14:42:38.114713+0000","last_active":"2024-09-11T14:43:33.245557+0000","last_peered":"2024-09-11T14:43:33.245557+0000","last_clean":"2024-09-11T14:43:33.245557+0000","last_became_active":"2024-09-11T14:42:38.099767+0000","last_became_peered":"2024-09-11T14:42:38.099767+0000","last_unstale":"2024-09-11T14:43:33.245557+0000","last_undegraded":"2024-09-11T14:43:33.245557+0000","last_fullsized":"2024-09-11T14:43:33.245557+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15073280,"num_objects":230,"num_object_clones":0,"num_object_copies":690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":230,"num_write_kb":14720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"55'254","reported_seq":266,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:32.963632+0000","last_change":"2024-09-11T14:42:38.177741+0000","last_active":"2024-09-11T14:43:32.963632+0000","last_peered":"2024-09-11T14:43:32.963632+0000","last_clean":"2024-09-11T14:43:32.963632+0000","last_became_active":"2024-09-11T14:42:38.170462+0000","last_became_peered":"2024-09-11T14:42:38.170462+0000","last_unstale":"2024-09-11T14:43:32.963632+0000","last_undegraded":"2024-09-11T14:43:32.963632+0000","last_fullsized":"2024-09-11T14:43:32.963632+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16646144,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":254,"num_write_kb":16256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"55'255","reported_seq":267,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:33.028549+0000","last_change":"2024-09-11T14:42:38.204931+0000","last_active":"2024-09-11T14:43:33.028549+0000","last_peered":"2024-09-11T14:43:33.028549+0000","last_clean":"2024-09-11T14:43:33.028549+0000","last_became_active":"2024-09-11T14:42:38.189110+0000","last_became_peered":"2024-09-11T14:42:38.189110+0000","last_unstale":"2024-09-11T14:43:33.028549+0000","last_undegraded":"2024-09-11T14:43:33.028549+0000","last_fullsized":"2024-09-11T14:43:33.028549+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16711680,"num_objects":255,"num_object_clones":0,"num_object_copies":765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":16320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"55'251","reported_seq":263,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:34.033897+0000","last_change":"2024-09-11T14:42:38.097894+0000","last_active":"2024-09-11T14:43:34.033897+0000","last_peered":"2024-09-11T14:43:34.033897+0000","last_clean":"2024-09-11T14:43:34.033897+0000","last_became_active":"2024-09-11T14:42:38.068084+0000","last_became_peered":"2024-09-11T14:42:38.068084+0000","last_unstale":"2024-09-11T14:43:34.033897+0000","last_undegraded":"2024-09-11T14:43:34.033897+0000","last_fullsized":"2024-09-11T14:43:34.033897+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16449536,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":16064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"55'222","reported_seq":234,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:33.162508+0000","last_change":"2024-09-11T14:42:38.084302+0000","last_active":"2024-09-11T14:43:33.162508+0000","last_peered":"2024-09-11T14:43:33.162508+0000","last_clean":"2024-09-11T14:43:33.162508+0000","last_became_active":"2024-09-11T14:42:38.060054+0000","last_became_peered":"2024-09-11T14:42:38.060054+0000","last_unstale":"2024-09-11T14:43:33.162508+0000","last_undegraded":"2024-09-11T14:43:33.162508+0000","last_fullsized":"2024-09-11T14:43:33.162508+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14548992,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":14208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"55'227","reported_seq":239,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:31.414343+0000","last_change":"2024-09-11T14:42:38.114647+0000","last_active":"2024-09-11T14:43:31.414343+0000","last_peered":"2024-09-11T14:43:31.414343+0000","last_clean":"2024-09-11T14:43:31.414343+0000","last_became_active":"2024-09-11T14:42:38.075902+0000","last_became_peered":"2024-09-11T14:42:38.075902+0000","last_unstale":"2024-09-11T14:43:31.414343+0000","last_undegraded":"2024-09-11T14:43:31.414343+0000","last_fullsized":"2024-09-11T14:43:31.414343+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14876672,"num_objects":227,"num_object_clones":0,"num_object_copies":681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":14528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"55'233","reported_seq":245,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:33.252480+0000","last_change":"2024-09-11T14:42:38.105488+0000","last_active":"2024-09-11T14:43:33.252480+0000","last_peered":"2024-09-11T14:43:33.252480+0000","last_clean":"2024-09-11T14:43:33.252480+0000","last_became_active":"2024-09-11T14:42:38.071282+0000","last_became_peered":"2024-09-11T14:42:38.071282+0000","last_unstale":"2024-09-11T14:43:33.252480+0000","last_undegraded":"2024-09-11T14:43:33.252480+0000","last_fullsized":"2024-09-11T14:43:33.252480+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15269888,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":14912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"55'229","reported_seq":241,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:32.925099+0000","last_change":"2024-09-11T14:42:38.122969+0000","last_active":"2024-09-11T14:43:32.925099+0000","last_peered":"2024-09-11T14:43:32.925099+0000","last_clean":"2024-09-11T14:43:32.925099+0000","last_became_active":"2024-09-11T14:42:38.109230+0000","last_became_peered":"2024-09-11T14:42:38.109230+0000","last_unstale":"2024-09-11T14:43:32.925099+0000","last_undegraded":"2024-09-11T14:43:32.925099+0000","last_fullsized":"2024-09-11T14:43:32.925099+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15007744,"num_objects":229,"num_object_clones":0,"num_object_copies":687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":14656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"55'243","reported_seq":255,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:32.830518+0000","last_change":"2024-09-11T14:42:38.222378+0000","last_active":"2024-09-11T14:43:32.830518+0000","last_peered":"2024-09-11T14:43:32.830518+0000","last_clean":"2024-09-11T14:43:32.830518+0000","last_became_active":"2024-09-11T14:42:38.204348+0000","last_became_peered":"2024-09-11T14:42:38.204348+0000","last_unstale":"2024-09-11T14:43:32.830518+0000","last_undegraded":"2024-09-11T14:43:32.830518+0000","last_fullsized":"2024-09-11T14:43:32.830518+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925248,"num_objects":243,"num_object_clones":0,"num_object_copies":729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":15552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":205,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.913572+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:42:38.913572+0000","last_peered":"2024-09-11T14:42:38.913572+0000","last_clean":"2024-09-11T14:42:38.913572+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:42:38.913572+0000","last_undegraded":"2024-09-11T14:42:38.913572+0000","last_fullsized":"2024-09-11T14:42:38.913572+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":134,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.922201+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:42:38.922201+0000","last_peered":"2024-09-11T14:42:38.922201+0000","last_clean":"2024-09-11T14:42:38.922201+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:42:38.922201+0000","last_undegraded":"2024-09-11T14:42:38.922201+0000","last_fullsized":"2024-09-11T14:42:38.922201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"55'228","reported_seq":240,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:32.780947+0000","last_change":"2024-09-11T14:42:38.156444+0000","last_active":"2024-09-11T14:43:32.780947+0000","last_peered":"2024-09-11T14:43:32.780947+0000","last_clean":"2024-09-11T14:43:32.780947+0000","last_became_active":"2024-09-11T14:42:38.142793+0000","last_became_peered":"2024-09-11T14:42:38.142793+0000","last_unstale":"2024-09-11T14:43:32.780947+0000","last_undegraded":"2024-09-11T14:43:32.780947+0000","last_fullsized":"2024-09-11T14:43:32.780947+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14942208,"num_objects":228,"num_object_clones":0,"num_object_copies":684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":14592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.926607+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:42:38.926607+0000","last_peered":"2024-09-11T14:42:38.926607+0000","last_clean":"2024-09-11T14:42:38.926607+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:42:38.926607+0000","last_undegraded":"2024-09-11T14:42:38.926607+0000","last_fullsized":"2024-09-11T14:42:38.926607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"55'239","reported_seq":251,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:33.016918+0000","last_change":"2024-09-11T14:42:38.179244+0000","last_active":"2024-09-11T14:43:33.016918+0000","last_peered":"2024-09-11T14:43:33.016918+0000","last_clean":"2024-09-11T14:43:33.016918+0000","last_became_active":"2024-09-11T14:42:38.159043+0000","last_became_peered":"2024-09-11T14:42:38.159043+0000","last_unstale":"2024-09-11T14:43:33.016918+0000","last_undegraded":"2024-09-11T14:43:33.016918+0000","last_fullsized":"2024-09-11T14:43:33.016918+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":15296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.915623+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:42:38.915623+0000","last_peered":"2024-09-11T14:42:38.915623+0000","last_clean":"2024-09-11T14:42:38.915623+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:42:38.915623+0000","last_undegraded":"2024-09-11T14:42:38.915623+0000","last_fullsized":"2024-09-11T14:42:38.915623+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"55'238","reported_seq":250,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:32.261129+0000","last_change":"2024-09-11T14:42:38.098677+0000","last_active":"2024-09-11T14:43:32.261129+0000","last_peered":"2024-09-11T14:43:32.261129+0000","last_clean":"2024-09-11T14:43:32.261129+0000","last_became_active":"2024-09-11T14:42:38.060593+0000","last_became_peered":"2024-09-11T14:42:38.060593+0000","last_unstale":"2024-09-11T14:43:32.261129+0000","last_undegraded":"2024-09-11T14:43:32.261129+0000","last_fullsized":"2024-09-11T14:43:32.261129+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15597568,"num_objects":238,"num_object_clones":0,"num_object_copies":714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":15232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":135,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.918644+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:42:38.918644+0000","last_peered":"2024-09-11T14:42:38.918644+0000","last_clean":"2024-09-11T14:42:38.918644+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:42:38.918644+0000","last_undegraded":"2024-09-11T14:42:38.918644+0000","last_fullsized":"2024-09-11T14:42:38.918644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"55'235","reported_seq":247,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:33.219791+0000","last_change":"2024-09-11T14:42:38.108084+0000","last_active":"2024-09-11T14:43:33.219791+0000","last_peered":"2024-09-11T14:43:33.219791+0000","last_clean":"2024-09-11T14:43:33.219791+0000","last_became_active":"2024-09-11T14:42:38.044460+0000","last_became_peered":"2024-09-11T14:42:38.044460+0000","last_unstale":"2024-09-11T14:43:33.219791+0000","last_undegraded":"2024-09-11T14:43:33.219791+0000","last_fullsized":"2024-09-11T14:43:33.219791+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":15040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.917356+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:42:38.917356+0000","last_peered":"2024-09-11T14:42:38.917356+0000","last_clean":"2024-09-11T14:42:38.917356+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:42:38.917356+0000","last_undegraded":"2024-09-11T14:42:38.917356+0000","last_fullsized":"2024-09-11T14:42:38.917356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"55'235","reported_seq":247,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:33.082921+0000","last_change":"2024-09-11T14:42:38.096488+0000","last_active":"2024-09-11T14:43:33.082921+0000","last_peered":"2024-09-11T14:43:33.082921+0000","last_clean":"2024-09-11T14:43:33.082921+0000","last_became_active":"2024-09-11T14:42:38.071104+0000","last_became_peered":"2024-09-11T14:42:38.071104+0000","last_unstale":"2024-09-11T14:43:33.082921+0000","last_undegraded":"2024-09-11T14:43:33.082921+0000","last_fullsized":"2024-09-11T14:43:33.082921+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":15040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.919824+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:42:38.919824+0000","last_peered":"2024-09-11T14:42:38.919824+0000","last_clean":"2024-09-11T14:42:38.919824+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:42:38.919824+0000","last_undegraded":"2024-09-11T14:42:38.919824+0000","last_fullsized":"2024-09-11T14:42:38.919824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"55'264","reported_seq":276,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:34.232920+0000","last_change":"2024-09-11T14:42:38.132564+0000","last_active":"2024-09-11T14:43:34.232920+0000","last_peered":"2024-09-11T14:43:34.232920+0000","last_clean":"2024-09-11T14:43:34.232920+0000","last_became_active":"2024-09-11T14:42:38.112585+0000","last_became_peered":"2024-09-11T14:42:38.112585+0000","last_unstale":"2024-09-11T14:43:34.232920+0000","last_undegraded":"2024-09-11T14:43:34.232920+0000","last_fullsized":"2024-09-11T14:43:34.232920+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17301504,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":16896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.917862+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:42:38.917862+0000","last_peered":"2024-09-11T14:42:38.917862+0000","last_clean":"2024-09-11T14:42:38.917862+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:42:38.917862+0000","last_undegraded":"2024-09-11T14:42:38.917862+0000","last_fullsized":"2024-09-11T14:42:38.917862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"55'235","reported_seq":247,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:33.337454+0000","last_change":"2024-09-11T14:42:38.233207+0000","last_active":"2024-09-11T14:43:33.337454+0000","last_peered":"2024-09-11T14:43:33.337454+0000","last_clean":"2024-09-11T14:43:33.337454+0000","last_became_active":"2024-09-11T14:42:38.225462+0000","last_became_peered":"2024-09-11T14:42:38.225462+0000","last_unstale":"2024-09-11T14:43:33.337454+0000","last_undegraded":"2024-09-11T14:43:33.337454+0000","last_fullsized":"2024-09-11T14:43:33.337454+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":15040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.925822+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:42:38.925822+0000","last_peered":"2024-09-11T14:42:38.925822+0000","last_clean":"2024-09-11T14:42:38.925822+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:42:38.925822+0000","last_undegraded":"2024-09-11T14:42:38.925822+0000","last_fullsized":"2024-09-11T14:42:38.925822+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":250216448,"num_objects":3818,"num_object_clones":0,"num_object_copies":11454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3818,"num_write_kb":244352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212689371136,"internally_reserved":0,"allocated":1522122752,"data_stored":1522122752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3818,"ondisk_log_size":3818,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212689371136,"internally_reserved":0,"allocated":1522122752,"data_stored":1522122752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53194686464,"internally_reserved":0,"allocated":358187008,"data_stored":358187008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":344696,"kb_used_data":344696,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51953032,"statfs":{"total":53552873472,"available":53199904768,"internally_reserved":0,"allocated":352968704,"data_stored":352968704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":431384,"kb_used_data":431384,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51866344,"statfs":{"total":53552873472,"available":53111136256,"internally_reserved":0,"allocated":441737216,"data_stored":441737216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":397008,"kb_used_data":397008,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51900720,"statfs":{"total":53552873472,"available":53146337280,"internally_reserved":0,"allocated":406536192,"data_stored":406536192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":298812,"kb_used_data":298812,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51998916,"statfs":{"total":53552873472,"available":53246889984,"internally_reserved":0,"allocated":305983488,"data_stored":305983488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53194686464,"internally_reserved":0,"allocated":358187008,"data_stored":358187008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53142642688,"internally_reserved":0,"allocated":410230784,"data_stored":410230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53243592704,"internally_reserved":0,"allocated":309280768,"data_stored":309280768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53108580352,"internally_reserved":0,"allocated":444293120,"data_stored":444293120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53194555392,"internally_reserved":0,"allocated":358318080,"data_stored":358318080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53142642688,"internally_reserved":0,"allocated":410230784,"data_stored":410230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53243592704,"internally_reserved":0,"allocated":309280768,"data_stored":309280768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53108580352,"internally_reserved":0,"allocated":444293120,"data_stored":444293120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53194555392,"internally_reserved":0,"allocated":358318080,"data_stored":358318080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:43:38.008 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 59 16 4058 4042 4.28139 2.5625 0.303325 0.232285 2024-09-11T14:43:38.064 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:43:38.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:38.182+0000 7f2560474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:38.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:38.191+0000 7f2560474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:39.009 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:43:39.008461+0000 min lat: 0.0325842 max lat: 1.40872 avg lat: 0.233222 2024-09-11T14:43:39.009 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:43:39.009 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 60 16 4121 4105 4.27565 3.9375 0.132969 0.233222 2024-09-11T14:43:40.009 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 61 16 4186 4170 4.27215 4.0625 0.144536 0.233093 2024-09-11T14:43:40.560 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:43:40.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:40.725+0000 7f91f5511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:40.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:40.735+0000 7f91f5511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:41.009 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 62 16 4257 4241 4.27481 4.4375 0.171245 0.233379 2024-09-11T14:43:42.009 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 63 16 4328 4312 4.27738 4.4375 0.254775 0.233216 2024-09-11T14:43:42.726 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:43:42.727 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:43:42.727 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:43:42.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:42.872+0000 7fc1e4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:42.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:42.882+0000 7fc1e4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:43.009 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 64 16 4405 4389 4.28574 4.8125 0.120581 0.232889 2024-09-11T14:43:43.099 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:43:43.099 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:43:43.120 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":277,"stamp":"2024-09-11T14:43:41.318338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":268567091,"num_objects":4093,"num_object_clones":0,"num_object_copies":12279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4170,"num_write_kb":262804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4144,"ondisk_log_size":4144,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1580436,"kb_used_data":1580436,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207610476,"statfs":{"total":214211493888,"available":212593127424,"internally_reserved":0,"allocated":1618366464,"data_stored":1618366464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45154304,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":689,"num_write_kb":44096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002501"},"pg_stats":[{"pgid":"5.f","version":"55'248","reported_seq":260,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:37.508327+0000","last_change":"2024-09-11T14:42:38.114713+0000","last_active":"2024-09-11T14:43:37.508327+0000","last_peered":"2024-09-11T14:43:37.508327+0000","last_clean":"2024-09-11T14:43:37.508327+0000","last_became_active":"2024-09-11T14:42:38.099767+0000","last_became_peered":"2024-09-11T14:42:38.099767+0000","last_unstale":"2024-09-11T14:43:37.508327+0000","last_undegraded":"2024-09-11T14:43:37.508327+0000","last_fullsized":"2024-09-11T14:43:37.508327+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16252928,"num_objects":248,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":15872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"55'270","reported_seq":282,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:37.558023+0000","last_change":"2024-09-11T14:42:38.177741+0000","last_active":"2024-09-11T14:43:37.558023+0000","last_peered":"2024-09-11T14:43:37.558023+0000","last_clean":"2024-09-11T14:43:37.558023+0000","last_became_active":"2024-09-11T14:42:38.170462+0000","last_became_peered":"2024-09-11T14:42:38.170462+0000","last_unstale":"2024-09-11T14:43:37.558023+0000","last_undegraded":"2024-09-11T14:43:37.558023+0000","last_fullsized":"2024-09-11T14:43:37.558023+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"55'274","reported_seq":286,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:37.801846+0000","last_change":"2024-09-11T14:42:38.204931+0000","last_active":"2024-09-11T14:43:37.801846+0000","last_peered":"2024-09-11T14:43:37.801846+0000","last_clean":"2024-09-11T14:43:37.801846+0000","last_became_active":"2024-09-11T14:42:38.189110+0000","last_became_peered":"2024-09-11T14:42:38.189110+0000","last_unstale":"2024-09-11T14:43:37.801846+0000","last_undegraded":"2024-09-11T14:43:37.801846+0000","last_fullsized":"2024-09-11T14:43:37.801846+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17956864,"num_objects":274,"num_object_clones":0,"num_object_copies":822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":274,"num_write_kb":17536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"55'274","reported_seq":286,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:39.226561+0000","last_change":"2024-09-11T14:42:38.097894+0000","last_active":"2024-09-11T14:43:39.226561+0000","last_peered":"2024-09-11T14:43:39.226561+0000","last_clean":"2024-09-11T14:43:39.226561+0000","last_became_active":"2024-09-11T14:42:38.068084+0000","last_became_peered":"2024-09-11T14:42:38.068084+0000","last_unstale":"2024-09-11T14:43:39.226561+0000","last_undegraded":"2024-09-11T14:43:39.226561+0000","last_fullsized":"2024-09-11T14:43:39.226561+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17956864,"num_objects":274,"num_object_clones":0,"num_object_copies":822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":274,"num_write_kb":17536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"55'244","reported_seq":256,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:38.030563+0000","last_change":"2024-09-11T14:42:38.084302+0000","last_active":"2024-09-11T14:43:38.030563+0000","last_peered":"2024-09-11T14:43:38.030563+0000","last_clean":"2024-09-11T14:43:38.030563+0000","last_became_active":"2024-09-11T14:42:38.060054+0000","last_became_peered":"2024-09-11T14:42:38.060054+0000","last_unstale":"2024-09-11T14:43:38.030563+0000","last_undegraded":"2024-09-11T14:43:38.030563+0000","last_fullsized":"2024-09-11T14:43:38.030563+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15990784,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":15616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"55'245","reported_seq":257,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:36.892372+0000","last_change":"2024-09-11T14:42:38.114647+0000","last_active":"2024-09-11T14:43:36.892372+0000","last_peered":"2024-09-11T14:43:36.892372+0000","last_clean":"2024-09-11T14:43:36.892372+0000","last_became_active":"2024-09-11T14:42:38.075902+0000","last_became_peered":"2024-09-11T14:42:38.075902+0000","last_unstale":"2024-09-11T14:43:36.892372+0000","last_undegraded":"2024-09-11T14:43:36.892372+0000","last_fullsized":"2024-09-11T14:43:36.892372+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056320,"num_objects":245,"num_object_clones":0,"num_object_copies":735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":245,"num_write_kb":15680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"55'246","reported_seq":258,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:37.775907+0000","last_change":"2024-09-11T14:42:38.105488+0000","last_active":"2024-09-11T14:43:37.775907+0000","last_peered":"2024-09-11T14:43:37.775907+0000","last_clean":"2024-09-11T14:43:37.775907+0000","last_became_active":"2024-09-11T14:42:38.071282+0000","last_became_peered":"2024-09-11T14:42:38.071282+0000","last_unstale":"2024-09-11T14:43:37.775907+0000","last_undegraded":"2024-09-11T14:43:37.775907+0000","last_fullsized":"2024-09-11T14:43:37.775907+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16121856,"num_objects":246,"num_object_clones":0,"num_object_copies":738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":246,"num_write_kb":15744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"55'239","reported_seq":251,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:37.402535+0000","last_change":"2024-09-11T14:42:38.122969+0000","last_active":"2024-09-11T14:43:37.402535+0000","last_peered":"2024-09-11T14:43:37.402535+0000","last_clean":"2024-09-11T14:43:37.402535+0000","last_became_active":"2024-09-11T14:42:38.109230+0000","last_became_peered":"2024-09-11T14:42:38.109230+0000","last_unstale":"2024-09-11T14:43:37.402535+0000","last_undegraded":"2024-09-11T14:43:37.402535+0000","last_fullsized":"2024-09-11T14:43:37.402535+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":15296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"55'262","reported_seq":274,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:37.963539+0000","last_change":"2024-09-11T14:42:38.222378+0000","last_active":"2024-09-11T14:43:37.963539+0000","last_peered":"2024-09-11T14:43:37.963539+0000","last_clean":"2024-09-11T14:43:37.963539+0000","last_became_active":"2024-09-11T14:42:38.204348+0000","last_became_peered":"2024-09-11T14:42:38.204348+0000","last_unstale":"2024-09-11T14:43:37.963539+0000","last_undegraded":"2024-09-11T14:43:37.963539+0000","last_fullsized":"2024-09-11T14:43:37.963539+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17170432,"num_objects":262,"num_object_clones":0,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":262,"num_write_kb":16768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":205,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.913572+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:42:38.913572+0000","last_peered":"2024-09-11T14:42:38.913572+0000","last_clean":"2024-09-11T14:42:38.913572+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:42:38.913572+0000","last_undegraded":"2024-09-11T14:42:38.913572+0000","last_fullsized":"2024-09-11T14:42:38.913572+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":134,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.922201+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:42:38.922201+0000","last_peered":"2024-09-11T14:42:38.922201+0000","last_clean":"2024-09-11T14:42:38.922201+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:42:38.922201+0000","last_undegraded":"2024-09-11T14:42:38.922201+0000","last_fullsized":"2024-09-11T14:42:38.922201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"55'246","reported_seq":258,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:38.407180+0000","last_change":"2024-09-11T14:42:38.156444+0000","last_active":"2024-09-11T14:43:38.407180+0000","last_peered":"2024-09-11T14:43:38.407180+0000","last_clean":"2024-09-11T14:43:38.407180+0000","last_became_active":"2024-09-11T14:42:38.142793+0000","last_became_peered":"2024-09-11T14:42:38.142793+0000","last_unstale":"2024-09-11T14:43:38.407180+0000","last_undegraded":"2024-09-11T14:43:38.407180+0000","last_fullsized":"2024-09-11T14:43:38.407180+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16121856,"num_objects":246,"num_object_clones":0,"num_object_copies":738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":246,"num_write_kb":15744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.926607+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:42:38.926607+0000","last_peered":"2024-09-11T14:42:38.926607+0000","last_clean":"2024-09-11T14:42:38.926607+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:42:38.926607+0000","last_undegraded":"2024-09-11T14:42:38.926607+0000","last_fullsized":"2024-09-11T14:42:38.926607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"55'252","reported_seq":264,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:37.014592+0000","last_change":"2024-09-11T14:42:38.179244+0000","last_active":"2024-09-11T14:43:37.014592+0000","last_peered":"2024-09-11T14:43:37.014592+0000","last_clean":"2024-09-11T14:43:37.014592+0000","last_became_active":"2024-09-11T14:42:38.159043+0000","last_became_peered":"2024-09-11T14:42:38.159043+0000","last_unstale":"2024-09-11T14:43:37.014592+0000","last_undegraded":"2024-09-11T14:43:37.014592+0000","last_fullsized":"2024-09-11T14:43:37.014592+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16515072,"num_objects":252,"num_object_clones":0,"num_object_copies":756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":16128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.915623+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:42:38.915623+0000","last_peered":"2024-09-11T14:42:38.915623+0000","last_clean":"2024-09-11T14:42:38.915623+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:42:38.915623+0000","last_undegraded":"2024-09-11T14:42:38.915623+0000","last_fullsized":"2024-09-11T14:42:38.915623+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"55'252","reported_seq":264,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:37.223433+0000","last_change":"2024-09-11T14:42:38.098677+0000","last_active":"2024-09-11T14:43:37.223433+0000","last_peered":"2024-09-11T14:43:37.223433+0000","last_clean":"2024-09-11T14:43:37.223433+0000","last_became_active":"2024-09-11T14:42:38.060593+0000","last_became_peered":"2024-09-11T14:42:38.060593+0000","last_unstale":"2024-09-11T14:43:37.223433+0000","last_undegraded":"2024-09-11T14:43:37.223433+0000","last_fullsized":"2024-09-11T14:43:37.223433+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16515072,"num_objects":252,"num_object_clones":0,"num_object_copies":756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":16128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":135,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.918644+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:42:38.918644+0000","last_peered":"2024-09-11T14:42:38.918644+0000","last_clean":"2024-09-11T14:42:38.918644+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:42:38.918644+0000","last_undegraded":"2024-09-11T14:42:38.918644+0000","last_fullsized":"2024-09-11T14:42:38.918644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"55'257","reported_seq":269,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:37.338467+0000","last_change":"2024-09-11T14:42:38.108084+0000","last_active":"2024-09-11T14:43:37.338467+0000","last_peered":"2024-09-11T14:43:37.338467+0000","last_clean":"2024-09-11T14:43:37.338467+0000","last_became_active":"2024-09-11T14:42:38.044460+0000","last_became_peered":"2024-09-11T14:42:38.044460+0000","last_unstale":"2024-09-11T14:43:37.338467+0000","last_undegraded":"2024-09-11T14:43:37.338467+0000","last_fullsized":"2024-09-11T14:43:37.338467+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16842752,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":16448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.917356+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:42:38.917356+0000","last_peered":"2024-09-11T14:42:38.917356+0000","last_clean":"2024-09-11T14:42:38.917356+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:42:38.917356+0000","last_undegraded":"2024-09-11T14:42:38.917356+0000","last_fullsized":"2024-09-11T14:42:38.917356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"55'255","reported_seq":267,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:38.052291+0000","last_change":"2024-09-11T14:42:38.096488+0000","last_active":"2024-09-11T14:43:38.052291+0000","last_peered":"2024-09-11T14:43:38.052291+0000","last_clean":"2024-09-11T14:43:38.052291+0000","last_became_active":"2024-09-11T14:42:38.071104+0000","last_became_peered":"2024-09-11T14:42:38.071104+0000","last_unstale":"2024-09-11T14:43:38.052291+0000","last_undegraded":"2024-09-11T14:43:38.052291+0000","last_fullsized":"2024-09-11T14:43:38.052291+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16711680,"num_objects":255,"num_object_clones":0,"num_object_copies":765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":16320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.919824+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:42:38.919824+0000","last_peered":"2024-09-11T14:42:38.919824+0000","last_clean":"2024-09-11T14:42:38.919824+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:42:38.919824+0000","last_undegraded":"2024-09-11T14:42:38.919824+0000","last_fullsized":"2024-09-11T14:42:38.919824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"55'273","reported_seq":285,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:38.924100+0000","last_change":"2024-09-11T14:42:38.132564+0000","last_active":"2024-09-11T14:43:38.924100+0000","last_peered":"2024-09-11T14:43:38.924100+0000","last_clean":"2024-09-11T14:43:38.924100+0000","last_became_active":"2024-09-11T14:42:38.112585+0000","last_became_peered":"2024-09-11T14:42:38.112585+0000","last_unstale":"2024-09-11T14:43:38.924100+0000","last_undegraded":"2024-09-11T14:43:38.924100+0000","last_fullsized":"2024-09-11T14:43:38.924100+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17891328,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":17472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.917862+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:42:38.917862+0000","last_peered":"2024-09-11T14:42:38.917862+0000","last_clean":"2024-09-11T14:42:38.917862+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:42:38.917862+0000","last_undegraded":"2024-09-11T14:42:38.917862+0000","last_fullsized":"2024-09-11T14:42:38.917862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"55'252","reported_seq":264,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:38.307626+0000","last_change":"2024-09-11T14:42:38.233207+0000","last_active":"2024-09-11T14:43:38.307626+0000","last_peered":"2024-09-11T14:43:38.307626+0000","last_clean":"2024-09-11T14:43:38.307626+0000","last_became_active":"2024-09-11T14:42:38.225462+0000","last_became_peered":"2024-09-11T14:42:38.225462+0000","last_unstale":"2024-09-11T14:43:38.307626+0000","last_undegraded":"2024-09-11T14:43:38.307626+0000","last_fullsized":"2024-09-11T14:43:38.307626+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16515072,"num_objects":252,"num_object_clones":0,"num_object_copies":756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":16128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.925822+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:42:38.925822+0000","last_peered":"2024-09-11T14:42:38.925822+0000","last_clean":"2024-09-11T14:42:38.925822+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:42:38.925822+0000","last_undegraded":"2024-09-11T14:42:38.925822+0000","last_fullsized":"2024-09-11T14:42:38.925822+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":267976704,"num_objects":4089,"num_object_clones":0,"num_object_copies":12267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4089,"num_write_kb":261696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212581433344,"internally_reserved":0,"allocated":1630060544,"data_stored":1630060544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4089,"ondisk_log_size":4089,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212581826560,"internally_reserved":0,"allocated":1629667328,"data_stored":1629667328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53168992256,"internally_reserved":0,"allocated":383881216,"data_stored":383881216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673414,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":369816,"kb_used_data":369816,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51927912,"statfs":{"total":53552873472,"available":53174181888,"internally_reserved":0,"allocated":378691584,"data_stored":378691584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706118,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":462228,"kb_used_data":462228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51835500,"statfs":{"total":53552873472,"available":53079552000,"internally_reserved":0,"allocated":473321472,"data_stored":473321472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706118,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":425408,"kb_used_data":425408,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51872320,"statfs":{"total":53552873472,"available":53117255680,"internally_reserved":0,"allocated":435617792,"data_stored":435617792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706118,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":322984,"kb_used_data":322984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51974744,"statfs":{"total":53552873472,"available":53222137856,"internally_reserved":0,"allocated":330735616,"data_stored":330735616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53168992256,"internally_reserved":0,"allocated":383881216,"data_stored":383881216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53115158528,"internally_reserved":0,"allocated":437714944,"data_stored":437714944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53219438592,"internally_reserved":0,"allocated":333434880,"data_stored":333434880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53078237184,"internally_reserved":0,"allocated":474636288,"data_stored":474636288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53168992256,"internally_reserved":0,"allocated":383881216,"data_stored":383881216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53115027456,"internally_reserved":0,"allocated":437846016,"data_stored":437846016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53219438592,"internally_reserved":0,"allocated":333434880,"data_stored":333434880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53078106112,"internally_reserved":0,"allocated":474767360,"data_stored":474767360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53168861184,"internally_reserved":0,"allocated":384012288,"data_stored":384012288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:43:43.275 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:43:43.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:43.410+0000 7faa92b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:43.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:43.417+0000 7faa92b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:44.009 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 65 16 4485 4469 4.29672 5 0.196019 0.232331 2024-09-11T14:43:45.009 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 66 16 4559 4543 4.30169 4.625 0.390495 0.23191 2024-09-11T14:43:46.009 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 67 16 4642 4626 4.3149 5.1875 0.181537 0.231242 2024-09-11T14:43:46.046 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:43:46.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:46.215+0000 7f138df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:46.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:46.225+0000 7f138df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:47.010 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 68 16 4717 4701 4.32037 4.6875 0.275011 0.230885 2024-09-11T14:43:48.010 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 69 16 4798 4782 4.33112 5.0625 0.109537 0.230467 2024-09-11T14:43:48.122 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:43:48.122 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T14:43:48.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:48.225+0000 7feb9d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:48.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:48.237+0000 7feb9d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:48.746 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:43:48.881 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T14:43:48.906 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T14:43:48.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:48.904+0000 7f234dc7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:48.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:48.915+0000 7f234dc7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:49.010 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 70 16 4864 4848 4.32817 4.125 0.144773 0.23042 2024-09-11T14:43:49.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:49.073+0000 7f2d9b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:49.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:49.089+0000 7f2d9b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:49.889 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T14:43:49.913 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T14:43:50.010 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 71 16 4931 4915 4.32618 4.1875 0.343674 0.230524 2024-09-11T14:43:50.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:50.052+0000 7fec0104f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:50.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:50.072+0000 7fec0104f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:50.895 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T14:43:50.919 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T14:43:51.010 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 72 16 4999 4983 4.32512 4.25 0.278968 0.230613 2024-09-11T14:43:51.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:51.056+0000 7fd832b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:51.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:51.073+0000 7fd832b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:51.313 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:43:51.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:51.445+0000 7f7a5a0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:51.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:51.453+0000 7f7a5a0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:51.904 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T14:43:51.923 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T14:43:51.923 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:43:52.010 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 73 16 5071 5055 4.32751 4.5 0.269404 0.230591 2024-09-11T14:43:52.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:52.077+0000 7f262bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:52.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:52.092+0000 7f262bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:52.391 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:43:52.391 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:43:52.412 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2024-09-11T14:43:51.904486+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":317129267,"num_objects":4834,"num_object_clones":0,"num_object_copies":14502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4911,"num_write_kb":310228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4885,"ondisk_log_size":4885,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1868124,"kb_used_data":1868124,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207322788,"statfs":{"total":214211493888,"available":212298534912,"internally_reserved":0,"allocated":1912958976,"data_stored":1912958976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25034752,"num_objects":382,"num_object_clones":0,"num_object_copies":1146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":24448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.584886"},"pg_stats":[{"pgid":"5.f","version":"55'288","reported_seq":300,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.119940+0000","last_change":"2024-09-11T14:42:38.114713+0000","last_active":"2024-09-11T14:43:48.119940+0000","last_peered":"2024-09-11T14:43:48.119940+0000","last_clean":"2024-09-11T14:43:48.119940+0000","last_became_active":"2024-09-11T14:42:38.099767+0000","last_became_peered":"2024-09-11T14:42:38.099767+0000","last_unstale":"2024-09-11T14:43:48.119940+0000","last_undegraded":"2024-09-11T14:43:48.119940+0000","last_fullsized":"2024-09-11T14:43:48.119940+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"55'317","reported_seq":329,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.380892+0000","last_change":"2024-09-11T14:42:38.177741+0000","last_active":"2024-09-11T14:43:48.380892+0000","last_peered":"2024-09-11T14:43:48.380892+0000","last_clean":"2024-09-11T14:43:48.380892+0000","last_became_active":"2024-09-11T14:42:38.170462+0000","last_became_peered":"2024-09-11T14:42:38.170462+0000","last_unstale":"2024-09-11T14:43:48.380892+0000","last_undegraded":"2024-09-11T14:43:48.380892+0000","last_fullsized":"2024-09-11T14:43:48.380892+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20774912,"num_objects":317,"num_object_clones":0,"num_object_copies":951,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":317,"num_write_kb":20288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"55'319","reported_seq":331,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:47.491120+0000","last_change":"2024-09-11T14:42:38.204931+0000","last_active":"2024-09-11T14:43:47.491120+0000","last_peered":"2024-09-11T14:43:47.491120+0000","last_clean":"2024-09-11T14:43:47.491120+0000","last_became_active":"2024-09-11T14:42:38.189110+0000","last_became_peered":"2024-09-11T14:42:38.189110+0000","last_unstale":"2024-09-11T14:43:47.491120+0000","last_undegraded":"2024-09-11T14:43:47.491120+0000","last_fullsized":"2024-09-11T14:43:47.491120+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20905984,"num_objects":319,"num_object_clones":0,"num_object_copies":957,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":20416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"56'328","reported_seq":343,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-11T14:43:49.399544+0000","last_change":"2024-09-11T14:42:38.097894+0000","last_active":"2024-09-11T14:43:49.399544+0000","last_peered":"2024-09-11T14:43:49.399544+0000","last_clean":"2024-09-11T14:43:49.399544+0000","last_became_active":"2024-09-11T14:42:38.068084+0000","last_became_peered":"2024-09-11T14:42:38.068084+0000","last_unstale":"2024-09-11T14:43:49.399544+0000","last_undegraded":"2024-09-11T14:43:49.399544+0000","last_fullsized":"2024-09-11T14:43:49.399544+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21495808,"num_objects":328,"num_object_clones":0,"num_object_copies":984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":20992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"55'294","reported_seq":306,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.039272+0000","last_change":"2024-09-11T14:42:38.084302+0000","last_active":"2024-09-11T14:43:48.039272+0000","last_peered":"2024-09-11T14:43:48.039272+0000","last_clean":"2024-09-11T14:43:48.039272+0000","last_became_active":"2024-09-11T14:42:38.060054+0000","last_became_peered":"2024-09-11T14:42:38.060054+0000","last_unstale":"2024-09-11T14:43:48.039272+0000","last_undegraded":"2024-09-11T14:43:48.039272+0000","last_fullsized":"2024-09-11T14:43:48.039272+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19267584,"num_objects":294,"num_object_clones":0,"num_object_copies":882,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":18816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"55'297","reported_seq":309,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:47.988669+0000","last_change":"2024-09-11T14:42:38.114647+0000","last_active":"2024-09-11T14:43:47.988669+0000","last_peered":"2024-09-11T14:43:47.988669+0000","last_clean":"2024-09-11T14:43:47.988669+0000","last_became_active":"2024-09-11T14:42:38.075902+0000","last_became_peered":"2024-09-11T14:42:38.075902+0000","last_unstale":"2024-09-11T14:43:47.988669+0000","last_undegraded":"2024-09-11T14:43:47.988669+0000","last_fullsized":"2024-09-11T14:43:47.988669+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":19008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"55'286","reported_seq":298,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:47.484931+0000","last_change":"2024-09-11T14:42:38.105488+0000","last_active":"2024-09-11T14:43:47.484931+0000","last_peered":"2024-09-11T14:43:47.484931+0000","last_clean":"2024-09-11T14:43:47.484931+0000","last_became_active":"2024-09-11T14:42:38.071282+0000","last_became_peered":"2024-09-11T14:42:38.071282+0000","last_unstale":"2024-09-11T14:43:47.484931+0000","last_undegraded":"2024-09-11T14:43:47.484931+0000","last_fullsized":"2024-09-11T14:43:47.484931+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18743296,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":286,"num_write_kb":18304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"55'293","reported_seq":305,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.276176+0000","last_change":"2024-09-11T14:42:38.122969+0000","last_active":"2024-09-11T14:43:48.276176+0000","last_peered":"2024-09-11T14:43:48.276176+0000","last_clean":"2024-09-11T14:43:48.276176+0000","last_became_active":"2024-09-11T14:42:38.109230+0000","last_became_peered":"2024-09-11T14:42:38.109230+0000","last_unstale":"2024-09-11T14:43:48.276176+0000","last_undegraded":"2024-09-11T14:43:48.276176+0000","last_fullsized":"2024-09-11T14:43:48.276176+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":18752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"55'309","reported_seq":321,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.272373+0000","last_change":"2024-09-11T14:42:38.222378+0000","last_active":"2024-09-11T14:43:48.272373+0000","last_peered":"2024-09-11T14:43:48.272373+0000","last_clean":"2024-09-11T14:43:48.272373+0000","last_became_active":"2024-09-11T14:42:38.204348+0000","last_became_peered":"2024-09-11T14:42:38.204348+0000","last_unstale":"2024-09-11T14:43:48.272373+0000","last_undegraded":"2024-09-11T14:43:48.272373+0000","last_fullsized":"2024-09-11T14:43:48.272373+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":19776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.916988+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:43:48.916988+0000","last_peered":"2024-09-11T14:43:48.916988+0000","last_clean":"2024-09-11T14:43:48.916988+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:43:48.916988+0000","last_undegraded":"2024-09-11T14:43:48.916988+0000","last_fullsized":"2024-09-11T14:43:48.916988+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":134,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.922201+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:42:38.922201+0000","last_peered":"2024-09-11T14:42:38.922201+0000","last_clean":"2024-09-11T14:42:38.922201+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:42:38.922201+0000","last_undegraded":"2024-09-11T14:42:38.922201+0000","last_fullsized":"2024-09-11T14:42:38.922201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"55'287","reported_seq":299,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.073420+0000","last_change":"2024-09-11T14:42:38.156444+0000","last_active":"2024-09-11T14:43:48.073420+0000","last_peered":"2024-09-11T14:43:48.073420+0000","last_clean":"2024-09-11T14:43:48.073420+0000","last_became_active":"2024-09-11T14:42:38.142793+0000","last_became_peered":"2024-09-11T14:42:38.142793+0000","last_unstale":"2024-09-11T14:43:48.073420+0000","last_undegraded":"2024-09-11T14:43:48.073420+0000","last_fullsized":"2024-09-11T14:43:48.073420+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18808832,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287,"num_write_kb":18368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.926607+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:42:38.926607+0000","last_peered":"2024-09-11T14:42:38.926607+0000","last_clean":"2024-09-11T14:42:38.926607+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:42:38.926607+0000","last_undegraded":"2024-09-11T14:42:38.926607+0000","last_fullsized":"2024-09-11T14:42:38.926607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"55'303","reported_seq":315,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:47.792618+0000","last_change":"2024-09-11T14:42:38.179244+0000","last_active":"2024-09-11T14:43:47.792618+0000","last_peered":"2024-09-11T14:43:47.792618+0000","last_clean":"2024-09-11T14:43:47.792618+0000","last_became_active":"2024-09-11T14:42:38.159043+0000","last_became_peered":"2024-09-11T14:42:38.159043+0000","last_unstale":"2024-09-11T14:43:47.792618+0000","last_undegraded":"2024-09-11T14:43:47.792618+0000","last_fullsized":"2024-09-11T14:43:47.792618+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":19392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.915623+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:42:38.915623+0000","last_peered":"2024-09-11T14:42:38.915623+0000","last_clean":"2024-09-11T14:42:38.915623+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:42:38.915623+0000","last_undegraded":"2024-09-11T14:42:38.915623+0000","last_fullsized":"2024-09-11T14:42:38.915623+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"55'294","reported_seq":306,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:47.915293+0000","last_change":"2024-09-11T14:42:38.098677+0000","last_active":"2024-09-11T14:43:47.915293+0000","last_peered":"2024-09-11T14:43:47.915293+0000","last_clean":"2024-09-11T14:43:47.915293+0000","last_became_active":"2024-09-11T14:42:38.060593+0000","last_became_peered":"2024-09-11T14:42:38.060593+0000","last_unstale":"2024-09-11T14:43:47.915293+0000","last_undegraded":"2024-09-11T14:43:47.915293+0000","last_fullsized":"2024-09-11T14:43:47.915293+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19267584,"num_objects":294,"num_object_clones":0,"num_object_copies":882,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":18816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":135,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.918644+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:42:38.918644+0000","last_peered":"2024-09-11T14:42:38.918644+0000","last_clean":"2024-09-11T14:42:38.918644+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:42:38.918644+0000","last_undegraded":"2024-09-11T14:42:38.918644+0000","last_fullsized":"2024-09-11T14:42:38.918644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"55'292","reported_seq":304,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.243308+0000","last_change":"2024-09-11T14:42:38.108084+0000","last_active":"2024-09-11T14:43:48.243308+0000","last_peered":"2024-09-11T14:43:48.243308+0000","last_clean":"2024-09-11T14:43:48.243308+0000","last_became_active":"2024-09-11T14:42:38.044460+0000","last_became_peered":"2024-09-11T14:42:38.044460+0000","last_unstale":"2024-09-11T14:43:48.243308+0000","last_undegraded":"2024-09-11T14:43:48.243308+0000","last_fullsized":"2024-09-11T14:43:48.243308+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19136512,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":18688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.917356+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:42:38.917356+0000","last_peered":"2024-09-11T14:42:38.917356+0000","last_clean":"2024-09-11T14:42:38.917356+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:42:38.917356+0000","last_undegraded":"2024-09-11T14:42:38.917356+0000","last_fullsized":"2024-09-11T14:42:38.917356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"55'308","reported_seq":320,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:47.886647+0000","last_change":"2024-09-11T14:42:38.096488+0000","last_active":"2024-09-11T14:43:47.886647+0000","last_peered":"2024-09-11T14:43:47.886647+0000","last_clean":"2024-09-11T14:43:47.886647+0000","last_became_active":"2024-09-11T14:42:38.071104+0000","last_became_peered":"2024-09-11T14:42:38.071104+0000","last_unstale":"2024-09-11T14:43:47.886647+0000","last_undegraded":"2024-09-11T14:43:47.886647+0000","last_fullsized":"2024-09-11T14:43:47.886647+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20185088,"num_objects":308,"num_object_clones":0,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":308,"num_write_kb":19712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":136,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.924475+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:43:48.924475+0000","last_peered":"2024-09-11T14:43:48.924475+0000","last_clean":"2024-09-11T14:43:48.924475+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:43:48.924475+0000","last_undegraded":"2024-09-11T14:43:48.924475+0000","last_fullsized":"2024-09-11T14:43:48.924475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"56'316","reported_seq":331,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.922664+0000","last_change":"2024-09-11T14:42:38.132564+0000","last_active":"2024-09-11T14:43:48.922664+0000","last_peered":"2024-09-11T14:43:48.922664+0000","last_clean":"2024-09-11T14:43:48.922664+0000","last_became_active":"2024-09-11T14:42:38.112585+0000","last_became_peered":"2024-09-11T14:42:38.112585+0000","last_unstale":"2024-09-11T14:43:48.922664+0000","last_undegraded":"2024-09-11T14:43:48.922664+0000","last_fullsized":"2024-09-11T14:43:48.922664+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20709376,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":20224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.917862+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:42:38.917862+0000","last_peered":"2024-09-11T14:42:38.917862+0000","last_clean":"2024-09-11T14:42:38.917862+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:42:38.917862+0000","last_undegraded":"2024-09-11T14:42:38.917862+0000","last_fullsized":"2024-09-11T14:42:38.917862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"55'299","reported_seq":311,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.327867+0000","last_change":"2024-09-11T14:42:38.233207+0000","last_active":"2024-09-11T14:43:48.327867+0000","last_peered":"2024-09-11T14:43:48.327867+0000","last_clean":"2024-09-11T14:43:48.327867+0000","last_became_active":"2024-09-11T14:42:38.225462+0000","last_became_peered":"2024-09-11T14:42:38.225462+0000","last_unstale":"2024-09-11T14:43:48.327867+0000","last_undegraded":"2024-09-11T14:43:48.327867+0000","last_fullsized":"2024-09-11T14:43:48.327867+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":19136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.925822+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:42:38.925822+0000","last_peered":"2024-09-11T14:42:38.925822+0000","last_clean":"2024-09-11T14:42:38.925822+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:42:38.925822+0000","last_undegraded":"2024-09-11T14:42:38.925822+0000","last_fullsized":"2024-09-11T14:42:38.925822+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":316538880,"num_objects":4830,"num_object_clones":0,"num_object_copies":14490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4830,"num_write_kb":309120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212286910464,"internally_reserved":0,"allocated":1924583424,"data_stored":1924583424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4830,"ondisk_log_size":4830,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212287172608,"internally_reserved":0,"allocated":1924321280,"data_stored":1924321280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53102239744,"internally_reserved":0,"allocated":450633728,"data_stored":450633728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673424,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":436324,"kb_used_data":436324,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51861404,"statfs":{"total":53552873472,"available":53106077696,"internally_reserved":0,"allocated":446795776,"data_stored":446795776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706128,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":544132,"kb_used_data":544132,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51753596,"statfs":{"total":53552873472,"available":52995682304,"internally_reserved":0,"allocated":557191168,"data_stored":557191168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706128,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":504580,"kb_used_data":504580,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51793148,"statfs":{"total":53552873472,"available":53036183552,"internally_reserved":0,"allocated":516689920,"data_stored":516689920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706128,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":383088,"kb_used_data":383088,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51914640,"statfs":{"total":53552873472,"available":53160591360,"internally_reserved":0,"allocated":392282112,"data_stored":392282112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53102239744,"internally_reserved":0,"allocated":450633728,"data_stored":450633728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53034610688,"internally_reserved":0,"allocated":518262784,"data_stored":518262784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53157298176,"internally_reserved":0,"allocated":395575296,"data_stored":395575296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52993171456,"internally_reserved":0,"allocated":559702016,"data_stored":559702016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53102092288,"internally_reserved":0,"allocated":450781184,"data_stored":450781184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53034479616,"internally_reserved":0,"allocated":518393856,"data_stored":518393856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53157298176,"internally_reserved":0,"allocated":395575296,"data_stored":395575296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":52993040384,"internally_reserved":0,"allocated":559833088,"data_stored":559833088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53102092288,"internally_reserved":0,"allocated":450781184,"data_stored":450781184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:43:52.413 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:43:52.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:52.591+0000 7f2b2c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:52.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:52.607+0000 7f2b2c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:52.898 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:43:52.899 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:43:52.923 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2024-09-11T14:43:51.904486+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":317129267,"num_objects":4834,"num_object_clones":0,"num_object_copies":14502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4911,"num_write_kb":310228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4885,"ondisk_log_size":4885,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1868124,"kb_used_data":1868124,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207322788,"statfs":{"total":214211493888,"available":212298534912,"internally_reserved":0,"allocated":1912958976,"data_stored":1912958976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25034752,"num_objects":382,"num_object_clones":0,"num_object_copies":1146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":24448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.584886"},"pg_stats":[{"pgid":"5.f","version":"55'288","reported_seq":300,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.119940+0000","last_change":"2024-09-11T14:42:38.114713+0000","last_active":"2024-09-11T14:43:48.119940+0000","last_peered":"2024-09-11T14:43:48.119940+0000","last_clean":"2024-09-11T14:43:48.119940+0000","last_became_active":"2024-09-11T14:42:38.099767+0000","last_became_peered":"2024-09-11T14:42:38.099767+0000","last_unstale":"2024-09-11T14:43:48.119940+0000","last_undegraded":"2024-09-11T14:43:48.119940+0000","last_fullsized":"2024-09-11T14:43:48.119940+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"55'317","reported_seq":329,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.380892+0000","last_change":"2024-09-11T14:42:38.177741+0000","last_active":"2024-09-11T14:43:48.380892+0000","last_peered":"2024-09-11T14:43:48.380892+0000","last_clean":"2024-09-11T14:43:48.380892+0000","last_became_active":"2024-09-11T14:42:38.170462+0000","last_became_peered":"2024-09-11T14:42:38.170462+0000","last_unstale":"2024-09-11T14:43:48.380892+0000","last_undegraded":"2024-09-11T14:43:48.380892+0000","last_fullsized":"2024-09-11T14:43:48.380892+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20774912,"num_objects":317,"num_object_clones":0,"num_object_copies":951,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":317,"num_write_kb":20288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"55'319","reported_seq":331,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:47.491120+0000","last_change":"2024-09-11T14:42:38.204931+0000","last_active":"2024-09-11T14:43:47.491120+0000","last_peered":"2024-09-11T14:43:47.491120+0000","last_clean":"2024-09-11T14:43:47.491120+0000","last_became_active":"2024-09-11T14:42:38.189110+0000","last_became_peered":"2024-09-11T14:42:38.189110+0000","last_unstale":"2024-09-11T14:43:47.491120+0000","last_undegraded":"2024-09-11T14:43:47.491120+0000","last_fullsized":"2024-09-11T14:43:47.491120+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20905984,"num_objects":319,"num_object_clones":0,"num_object_copies":957,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":20416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"56'328","reported_seq":343,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-11T14:43:49.399544+0000","last_change":"2024-09-11T14:42:38.097894+0000","last_active":"2024-09-11T14:43:49.399544+0000","last_peered":"2024-09-11T14:43:49.399544+0000","last_clean":"2024-09-11T14:43:49.399544+0000","last_became_active":"2024-09-11T14:42:38.068084+0000","last_became_peered":"2024-09-11T14:42:38.068084+0000","last_unstale":"2024-09-11T14:43:49.399544+0000","last_undegraded":"2024-09-11T14:43:49.399544+0000","last_fullsized":"2024-09-11T14:43:49.399544+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21495808,"num_objects":328,"num_object_clones":0,"num_object_copies":984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":20992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"55'294","reported_seq":306,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.039272+0000","last_change":"2024-09-11T14:42:38.084302+0000","last_active":"2024-09-11T14:43:48.039272+0000","last_peered":"2024-09-11T14:43:48.039272+0000","last_clean":"2024-09-11T14:43:48.039272+0000","last_became_active":"2024-09-11T14:42:38.060054+0000","last_became_peered":"2024-09-11T14:42:38.060054+0000","last_unstale":"2024-09-11T14:43:48.039272+0000","last_undegraded":"2024-09-11T14:43:48.039272+0000","last_fullsized":"2024-09-11T14:43:48.039272+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19267584,"num_objects":294,"num_object_clones":0,"num_object_copies":882,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":18816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"55'297","reported_seq":309,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:47.988669+0000","last_change":"2024-09-11T14:42:38.114647+0000","last_active":"2024-09-11T14:43:47.988669+0000","last_peered":"2024-09-11T14:43:47.988669+0000","last_clean":"2024-09-11T14:43:47.988669+0000","last_became_active":"2024-09-11T14:42:38.075902+0000","last_became_peered":"2024-09-11T14:42:38.075902+0000","last_unstale":"2024-09-11T14:43:47.988669+0000","last_undegraded":"2024-09-11T14:43:47.988669+0000","last_fullsized":"2024-09-11T14:43:47.988669+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":19008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"55'286","reported_seq":298,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:47.484931+0000","last_change":"2024-09-11T14:42:38.105488+0000","last_active":"2024-09-11T14:43:47.484931+0000","last_peered":"2024-09-11T14:43:47.484931+0000","last_clean":"2024-09-11T14:43:47.484931+0000","last_became_active":"2024-09-11T14:42:38.071282+0000","last_became_peered":"2024-09-11T14:42:38.071282+0000","last_unstale":"2024-09-11T14:43:47.484931+0000","last_undegraded":"2024-09-11T14:43:47.484931+0000","last_fullsized":"2024-09-11T14:43:47.484931+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18743296,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":286,"num_write_kb":18304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"55'293","reported_seq":305,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.276176+0000","last_change":"2024-09-11T14:42:38.122969+0000","last_active":"2024-09-11T14:43:48.276176+0000","last_peered":"2024-09-11T14:43:48.276176+0000","last_clean":"2024-09-11T14:43:48.276176+0000","last_became_active":"2024-09-11T14:42:38.109230+0000","last_became_peered":"2024-09-11T14:42:38.109230+0000","last_unstale":"2024-09-11T14:43:48.276176+0000","last_undegraded":"2024-09-11T14:43:48.276176+0000","last_fullsized":"2024-09-11T14:43:48.276176+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":18752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"55'309","reported_seq":321,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.272373+0000","last_change":"2024-09-11T14:42:38.222378+0000","last_active":"2024-09-11T14:43:48.272373+0000","last_peered":"2024-09-11T14:43:48.272373+0000","last_clean":"2024-09-11T14:43:48.272373+0000","last_became_active":"2024-09-11T14:42:38.204348+0000","last_became_peered":"2024-09-11T14:42:38.204348+0000","last_unstale":"2024-09-11T14:43:48.272373+0000","last_undegraded":"2024-09-11T14:43:48.272373+0000","last_fullsized":"2024-09-11T14:43:48.272373+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":19776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.916988+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:43:48.916988+0000","last_peered":"2024-09-11T14:43:48.916988+0000","last_clean":"2024-09-11T14:43:48.916988+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:43:48.916988+0000","last_undegraded":"2024-09-11T14:43:48.916988+0000","last_fullsized":"2024-09-11T14:43:48.916988+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":134,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.922201+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:42:38.922201+0000","last_peered":"2024-09-11T14:42:38.922201+0000","last_clean":"2024-09-11T14:42:38.922201+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:42:38.922201+0000","last_undegraded":"2024-09-11T14:42:38.922201+0000","last_fullsized":"2024-09-11T14:42:38.922201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"55'287","reported_seq":299,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.073420+0000","last_change":"2024-09-11T14:42:38.156444+0000","last_active":"2024-09-11T14:43:48.073420+0000","last_peered":"2024-09-11T14:43:48.073420+0000","last_clean":"2024-09-11T14:43:48.073420+0000","last_became_active":"2024-09-11T14:42:38.142793+0000","last_became_peered":"2024-09-11T14:42:38.142793+0000","last_unstale":"2024-09-11T14:43:48.073420+0000","last_undegraded":"2024-09-11T14:43:48.073420+0000","last_fullsized":"2024-09-11T14:43:48.073420+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18808832,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287,"num_write_kb":18368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.926607+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:42:38.926607+0000","last_peered":"2024-09-11T14:42:38.926607+0000","last_clean":"2024-09-11T14:42:38.926607+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:42:38.926607+0000","last_undegraded":"2024-09-11T14:42:38.926607+0000","last_fullsized":"2024-09-11T14:42:38.926607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"55'303","reported_seq":315,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:47.792618+0000","last_change":"2024-09-11T14:42:38.179244+0000","last_active":"2024-09-11T14:43:47.792618+0000","last_peered":"2024-09-11T14:43:47.792618+0000","last_clean":"2024-09-11T14:43:47.792618+0000","last_became_active":"2024-09-11T14:42:38.159043+0000","last_became_peered":"2024-09-11T14:42:38.159043+0000","last_unstale":"2024-09-11T14:43:47.792618+0000","last_undegraded":"2024-09-11T14:43:47.792618+0000","last_fullsized":"2024-09-11T14:43:47.792618+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":19392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.915623+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:42:38.915623+0000","last_peered":"2024-09-11T14:42:38.915623+0000","last_clean":"2024-09-11T14:42:38.915623+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:42:38.915623+0000","last_undegraded":"2024-09-11T14:42:38.915623+0000","last_fullsized":"2024-09-11T14:42:38.915623+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"55'294","reported_seq":306,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:47.915293+0000","last_change":"2024-09-11T14:42:38.098677+0000","last_active":"2024-09-11T14:43:47.915293+0000","last_peered":"2024-09-11T14:43:47.915293+0000","last_clean":"2024-09-11T14:43:47.915293+0000","last_became_active":"2024-09-11T14:42:38.060593+0000","last_became_peered":"2024-09-11T14:42:38.060593+0000","last_unstale":"2024-09-11T14:43:47.915293+0000","last_undegraded":"2024-09-11T14:43:47.915293+0000","last_fullsized":"2024-09-11T14:43:47.915293+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19267584,"num_objects":294,"num_object_clones":0,"num_object_copies":882,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":18816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":135,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.918644+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:42:38.918644+0000","last_peered":"2024-09-11T14:42:38.918644+0000","last_clean":"2024-09-11T14:42:38.918644+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:42:38.918644+0000","last_undegraded":"2024-09-11T14:42:38.918644+0000","last_fullsized":"2024-09-11T14:42:38.918644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"55'292","reported_seq":304,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.243308+0000","last_change":"2024-09-11T14:42:38.108084+0000","last_active":"2024-09-11T14:43:48.243308+0000","last_peered":"2024-09-11T14:43:48.243308+0000","last_clean":"2024-09-11T14:43:48.243308+0000","last_became_active":"2024-09-11T14:42:38.044460+0000","last_became_peered":"2024-09-11T14:42:38.044460+0000","last_unstale":"2024-09-11T14:43:48.243308+0000","last_undegraded":"2024-09-11T14:43:48.243308+0000","last_fullsized":"2024-09-11T14:43:48.243308+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19136512,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":18688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.917356+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:42:38.917356+0000","last_peered":"2024-09-11T14:42:38.917356+0000","last_clean":"2024-09-11T14:42:38.917356+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:42:38.917356+0000","last_undegraded":"2024-09-11T14:42:38.917356+0000","last_fullsized":"2024-09-11T14:42:38.917356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"55'308","reported_seq":320,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:47.886647+0000","last_change":"2024-09-11T14:42:38.096488+0000","last_active":"2024-09-11T14:43:47.886647+0000","last_peered":"2024-09-11T14:43:47.886647+0000","last_clean":"2024-09-11T14:43:47.886647+0000","last_became_active":"2024-09-11T14:42:38.071104+0000","last_became_peered":"2024-09-11T14:42:38.071104+0000","last_unstale":"2024-09-11T14:43:47.886647+0000","last_undegraded":"2024-09-11T14:43:47.886647+0000","last_fullsized":"2024-09-11T14:43:47.886647+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20185088,"num_objects":308,"num_object_clones":0,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":308,"num_write_kb":19712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":136,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.924475+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:43:48.924475+0000","last_peered":"2024-09-11T14:43:48.924475+0000","last_clean":"2024-09-11T14:43:48.924475+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:43:48.924475+0000","last_undegraded":"2024-09-11T14:43:48.924475+0000","last_fullsized":"2024-09-11T14:43:48.924475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"56'316","reported_seq":331,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.922664+0000","last_change":"2024-09-11T14:42:38.132564+0000","last_active":"2024-09-11T14:43:48.922664+0000","last_peered":"2024-09-11T14:43:48.922664+0000","last_clean":"2024-09-11T14:43:48.922664+0000","last_became_active":"2024-09-11T14:42:38.112585+0000","last_became_peered":"2024-09-11T14:42:38.112585+0000","last_unstale":"2024-09-11T14:43:48.922664+0000","last_undegraded":"2024-09-11T14:43:48.922664+0000","last_fullsized":"2024-09-11T14:43:48.922664+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20709376,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":20224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.917862+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:42:38.917862+0000","last_peered":"2024-09-11T14:42:38.917862+0000","last_clean":"2024-09-11T14:42:38.917862+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:42:38.917862+0000","last_undegraded":"2024-09-11T14:42:38.917862+0000","last_fullsized":"2024-09-11T14:42:38.917862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"55'299","reported_seq":311,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:43:48.327867+0000","last_change":"2024-09-11T14:42:38.233207+0000","last_active":"2024-09-11T14:43:48.327867+0000","last_peered":"2024-09-11T14:43:48.327867+0000","last_clean":"2024-09-11T14:43:48.327867+0000","last_became_active":"2024-09-11T14:42:38.225462+0000","last_became_peered":"2024-09-11T14:42:38.225462+0000","last_unstale":"2024-09-11T14:43:48.327867+0000","last_undegraded":"2024-09-11T14:43:48.327867+0000","last_fullsized":"2024-09-11T14:43:48.327867+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":19136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-11T14:42:38.925822+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:42:38.925822+0000","last_peered":"2024-09-11T14:42:38.925822+0000","last_clean":"2024-09-11T14:42:38.925822+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:42:38.925822+0000","last_undegraded":"2024-09-11T14:42:38.925822+0000","last_fullsized":"2024-09-11T14:42:38.925822+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":316538880,"num_objects":4830,"num_object_clones":0,"num_object_copies":14490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4830,"num_write_kb":309120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212286910464,"internally_reserved":0,"allocated":1924583424,"data_stored":1924583424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4830,"ondisk_log_size":4830,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212287172608,"internally_reserved":0,"allocated":1924321280,"data_stored":1924321280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53102239744,"internally_reserved":0,"allocated":450633728,"data_stored":450633728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673424,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":436324,"kb_used_data":436324,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51861404,"statfs":{"total":53552873472,"available":53106077696,"internally_reserved":0,"allocated":446795776,"data_stored":446795776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706128,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":544132,"kb_used_data":544132,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51753596,"statfs":{"total":53552873472,"available":52995682304,"internally_reserved":0,"allocated":557191168,"data_stored":557191168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706128,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":504580,"kb_used_data":504580,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51793148,"statfs":{"total":53552873472,"available":53036183552,"internally_reserved":0,"allocated":516689920,"data_stored":516689920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706128,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":383088,"kb_used_data":383088,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51914640,"statfs":{"total":53552873472,"available":53160591360,"internally_reserved":0,"allocated":392282112,"data_stored":392282112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53102239744,"internally_reserved":0,"allocated":450633728,"data_stored":450633728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53034610688,"internally_reserved":0,"allocated":518262784,"data_stored":518262784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53157298176,"internally_reserved":0,"allocated":395575296,"data_stored":395575296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52993171456,"internally_reserved":0,"allocated":559702016,"data_stored":559702016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53102092288,"internally_reserved":0,"allocated":450781184,"data_stored":450781184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53034479616,"internally_reserved":0,"allocated":518393856,"data_stored":518393856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53157298176,"internally_reserved":0,"allocated":395575296,"data_stored":395575296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":52993040384,"internally_reserved":0,"allocated":559833088,"data_stored":559833088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53102092288,"internally_reserved":0,"allocated":450781184,"data_stored":450781184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:43:52.925 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T14:43:52.925 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:43:52.925 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:43:52.925 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:43:53.010 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 74 16 5140 5124 4.3273 4.3125 0.219731 0.230692 2024-09-11T14:43:53.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:53.090+0000 7fb737b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:53.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:53.104+0000 7fb737b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:53.181 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:43:53.181 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:43:53.181 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:43:53.181 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:43:53.181 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:43:53.181 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:43:53.181 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:43:53.181 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:43:53.181 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:43:53.181 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:43:53.182 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:43:53.182 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:43:53.184 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:43:53.184 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:43:53.185 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:43:53.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:53.317+0000 7f55f5c63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:53.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:53.330+0000 7f55f5c63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:53.401 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:43:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:43:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:43:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:43:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:43:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:43:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:43:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:43:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:43:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:43:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:43:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:43:53.406 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:43:53.406 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:43:53.407 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:43:53.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:53.564+0000 7f61dc791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:53.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:53.582+0000 7f61dc791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:53.685 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:43:53.685 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:43:53.685 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:43:53.685 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:43:53.685 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:43:53.685 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:43:53.685 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:43:53.685 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:43:53.685 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:43:53.685 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:43:53.686 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:43:53.686 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:43:53.689 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:43:53.689 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:43:53.689 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:43:53.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:53.850+0000 7f66e9991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:53.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:53.866+0000 7f66e9991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:53.895 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:43:53.895 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:43:53.896 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:43:53.896 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:43:53.896 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:43:53.896 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:43:53.896 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:43:53.896 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:43:53.896 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:43:53.896 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:43:53.896 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:43:53.896 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:43:53.898 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:43:53.899 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:43:53.990 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:43:54.010 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 75 16 5214 5198 4.33127 4.625 0.101785 0.230412 2024-09-11T14:43:54.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:54.164+0000 7f36512fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:54.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:54.172+0000 7f36512fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:55.010 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 76 16 5288 5272 4.33513 4.625 0.0756783 0.230073 2024-09-11T14:43:56.010 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 77 16 5365 5349 4.34132 4.8125 0.0875057 0.229875 2024-09-11T14:43:56.632 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:43:56.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:56.744+0000 7f1b03591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:56.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:56.751+0000 7f1b03591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:57.010 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 78 16 5436 5420 4.34255 4.4375 0.161069 0.22983 2024-09-11T14:43:58.010 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 79 16 5505 5489 4.34216 4.3125 0.576199 0.229888 2024-09-11T14:43:58.900 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:43:58.901 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:43:58.901 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:43:58.901 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:43:59.010 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:43:59.010427+0000 min lat: 0.0325842 max lat: 1.40872 avg lat: 0.229696 2024-09-11T14:43:59.011 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:43:59.011 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 80 16 5580 5564 4.34647 4.6875 0.264953 0.229696 2024-09-11T14:43:59.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:59.066+0000 7f9e36b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:59.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:59.084+0000 7f9e36b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:59.096 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:43:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:43:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:43:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:43:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:43:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:43:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:43:59.220 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:43:59.220 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:43:59.220 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:43:59.220 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:43:59.220 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:43:59.220 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:43:59.223 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:43:59.223 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:43:59.223 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:43:59.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:59.261+0000 7fd5a9711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:59.273+0000 7fd5a9711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:59.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:59.399+0000 7f5a27191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:59.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:59.411+0000 7f5a27191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:59.438 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:43:59.438 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:43:59.439 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:43:59.439 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:43:59.439 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:43:59.439 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:43:59.439 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:43:59.439 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:43:59.439 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:43:59.439 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:43:59.439 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:43:59.440 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:43:59.442 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:43:59.442 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:43:59.442 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:43:59.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:59.628+0000 7fd5b8591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:59.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:59.644+0000 7fd5b8591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:59.698 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:43:59.698 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:43:59.698 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:43:59.698 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:43:59.698 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:43:59.698 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:43:59.698 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:43:59.698 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:43:59.699 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:43:59.699 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:43:59.699 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:43:59.699 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:43:59.701 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:43:59.702 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:43:59.702 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:43:59.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:59.865+0000 7fd41b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:59.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:43:59.883+0000 7fd41b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:43:59.935 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:43:59.935 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:43:59.935 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:43:59.935 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:43:59.935 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:43:59.935 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:43:59.936 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:43:59.936 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:43:59.936 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:43:59.936 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:43:59.936 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:43:59.937 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:43:59.938 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:43:59.939 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:00.011 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 81 16 5657 5641 4.35222 4.8125 0.226545 0.229415 2024-09-11T14:44:01.011 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 82 16 5731 5715 4.35554 4.625 0.133793 0.229225 2024-09-11T14:44:01.852 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:44:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:01.986+0000 7f0334f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:01.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:01.997+0000 7f0334f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:02.011 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 83 16 5803 5787 4.35728 4.5 0.120722 0.228972 2024-09-11T14:44:03.011 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 84 16 5872 5856 4.35674 4.3125 0.0843173 0.229054 2024-09-11T14:44:04.011 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 85 16 5950 5934 4.36283 4.875 0.308971 0.228845 2024-09-11T14:44:04.370 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:44:04.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:04.500+0000 7ff0ac4a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:04.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:04.507+0000 7ff0ac4a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:04.939 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:44:04.940 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:44:04.940 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:44:04.940 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:44:05.011 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 86 16 6024 6008 4.36587 4.625 0.138731 0.228775 2024-09-11T14:44:05.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:05.096+0000 7fdb4e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:05.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:05.107+0000 7fdb4e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:05.210 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:05.210 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:05.210 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:05.210 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:05.210 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:05.211 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:05.211 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:05.211 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:05.211 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:05.211 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:05.211 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:05.211 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:05.214 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:05.215 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:05.215 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:44:05.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:05.365+0000 7fda31f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:05.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:05.378+0000 7fda31f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:05.485 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:05.485 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:05.485 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:05.485 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:05.486 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:05.486 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:05.486 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:05.486 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:05.486 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:05.486 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:05.486 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:05.486 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:05.489 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:05.489 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:05.490 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:44:05.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:05.638+0000 7f6511591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:05.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:05.649+0000 7f6511591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:05.792 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:05.792 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:05.792 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:05.792 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:05.792 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:05.792 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:05.792 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:05.792 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:05.792 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:05.793 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:05.793 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:05.793 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:05.794 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:05.795 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:05.795 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:44:05.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:05.909+0000 7f35fb791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:05.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:05.919+0000 7f35fb791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:06.011 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 87 16 6094 6078 4.36597 4.375 0.137046 0.228456 2024-09-11T14:44:06.026 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:06.026 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:06.026 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:06.026 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:06.026 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:06.026 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:06.026 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:06.026 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:06.027 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:06.027 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:06.027 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:06.027 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:06.030 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:06.030 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:06.875 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:44:07.011 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 88 16 6160 6144 4.36323 4.125 0.471526 0.228902 2024-09-11T14:44:07.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:07.037+0000 7f15a9cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:07.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:07.044+0000 7f15a9cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:08.011 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 89 16 6242 6226 4.37178 5.125 0.283918 0.228482 2024-09-11T14:44:09.012 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 90 16 6325 6309 4.38084 5.1875 0.164535 0.228025 2024-09-11T14:44:09.381 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:44:09.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:09.487+0000 7fc80906c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:09.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:09.492+0000 7fc80906c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:10.012 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total time run: 90.2051 2024-09-11T14:44:10.012 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total writes made: 6325 2024-09-11T14:44:10.012 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Write size: 65536 2024-09-11T14:44:10.012 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object size: 65536 2024-09-11T14:44:10.012 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Bandwidth (MB/sec): 4.38237 2024-09-11T14:44:10.012 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Bandwidth: 0.482402 2024-09-11T14:44:10.012 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max bandwidth (MB/sec): 5.1875 2024-09-11T14:44:10.012 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min bandwidth (MB/sec): 2.5625 2024-09-11T14:44:10.012 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average IOPS: 70 2024-09-11T14:44:10.012 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev IOPS: 7.71843 2024-09-11T14:44:10.013 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max IOPS: 83 2024-09-11T14:44:10.013 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min IOPS: 41 2024-09-11T14:44:10.013 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average Latency(s): 0.22792 2024-09-11T14:44:10.013 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Latency(s): 0.163682 2024-09-11T14:44:10.013 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max latency(s): 1.40872 2024-09-11T14:44:10.013 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min latency(s): 0.0325842 2024-09-11T14:44:10.054 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Cleaning up (deleting benchmark objects) 2024-09-11T14:44:11.031 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:44:11.031 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:44:11.032 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:44:11.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:11.183+0000 7fb18a548640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:11.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:11.197+0000 7fb18a548640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:11.462 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:44:11.462 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:44:11.479 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2024-09-11T14:44:11.324950+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":412156467,"num_objects":6284,"num_object_clones":0,"num_object_copies":18852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6361,"num_write_kb":403028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6335,"ondisk_log_size":6335,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2429964,"kb_used_data":2429964,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206760948,"statfs":{"total":214211493888,"available":211723210752,"internally_reserved":0,"allocated":2488283136,"data_stored":2488283136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":50921472,"num_objects":777,"num_object_clones":0,"num_object_copies":2331,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":49728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002787"},"pg_stats":[{"pgid":"5.f","version":"59'388","reported_seq":412,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:08.065522+0000","last_change":"2024-09-11T14:42:38.114713+0000","last_active":"2024-09-11T14:44:08.065522+0000","last_peered":"2024-09-11T14:44:08.065522+0000","last_clean":"2024-09-11T14:44:08.065522+0000","last_became_active":"2024-09-11T14:42:38.099767+0000","last_became_peered":"2024-09-11T14:42:38.099767+0000","last_unstale":"2024-09-11T14:44:08.065522+0000","last_undegraded":"2024-09-11T14:44:08.065522+0000","last_fullsized":"2024-09-11T14:44:08.065522+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25427968,"num_objects":388,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":24832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"59'415","reported_seq":439,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:08.441647+0000","last_change":"2024-09-11T14:42:38.177741+0000","last_active":"2024-09-11T14:44:08.441647+0000","last_peered":"2024-09-11T14:44:08.441647+0000","last_clean":"2024-09-11T14:44:08.441647+0000","last_became_active":"2024-09-11T14:42:38.170462+0000","last_became_peered":"2024-09-11T14:42:38.170462+0000","last_unstale":"2024-09-11T14:44:08.441647+0000","last_undegraded":"2024-09-11T14:44:08.441647+0000","last_fullsized":"2024-09-11T14:44:08.441647+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27197440,"num_objects":415,"num_object_clones":0,"num_object_copies":1245,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":26560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"59'417","reported_seq":441,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:07.479206+0000","last_change":"2024-09-11T14:42:38.204931+0000","last_active":"2024-09-11T14:44:07.479206+0000","last_peered":"2024-09-11T14:44:07.479206+0000","last_clean":"2024-09-11T14:44:07.479206+0000","last_became_active":"2024-09-11T14:42:38.189110+0000","last_became_peered":"2024-09-11T14:42:38.189110+0000","last_unstale":"2024-09-11T14:44:07.479206+0000","last_undegraded":"2024-09-11T14:44:07.479206+0000","last_fullsized":"2024-09-11T14:44:07.479206+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27328512,"num_objects":417,"num_object_clones":0,"num_object_copies":1251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":26688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"59'408","reported_seq":432,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:08.922226+0000","last_change":"2024-09-11T14:42:38.097894+0000","last_active":"2024-09-11T14:44:08.922226+0000","last_peered":"2024-09-11T14:44:08.922226+0000","last_clean":"2024-09-11T14:44:08.922226+0000","last_became_active":"2024-09-11T14:42:38.068084+0000","last_became_peered":"2024-09-11T14:42:38.068084+0000","last_unstale":"2024-09-11T14:44:08.922226+0000","last_undegraded":"2024-09-11T14:44:08.922226+0000","last_fullsized":"2024-09-11T14:44:08.922226+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26738688,"num_objects":408,"num_object_clones":0,"num_object_copies":1224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"59'374","reported_seq":398,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:08.140588+0000","last_change":"2024-09-11T14:42:38.084302+0000","last_active":"2024-09-11T14:44:08.140588+0000","last_peered":"2024-09-11T14:44:08.140588+0000","last_clean":"2024-09-11T14:44:08.140588+0000","last_became_active":"2024-09-11T14:42:38.060054+0000","last_became_peered":"2024-09-11T14:42:38.060054+0000","last_unstale":"2024-09-11T14:44:08.140588+0000","last_undegraded":"2024-09-11T14:44:08.140588+0000","last_fullsized":"2024-09-11T14:44:08.140588+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24510464,"num_objects":374,"num_object_clones":0,"num_object_copies":1122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"59'382","reported_seq":406,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:08.262413+0000","last_change":"2024-09-11T14:42:38.114647+0000","last_active":"2024-09-11T14:44:08.262413+0000","last_peered":"2024-09-11T14:44:08.262413+0000","last_clean":"2024-09-11T14:44:08.262413+0000","last_became_active":"2024-09-11T14:42:38.075902+0000","last_became_peered":"2024-09-11T14:42:38.075902+0000","last_unstale":"2024-09-11T14:44:08.262413+0000","last_undegraded":"2024-09-11T14:44:08.262413+0000","last_fullsized":"2024-09-11T14:44:08.262413+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25034752,"num_objects":382,"num_object_clones":0,"num_object_copies":1146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":24448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"59'373","reported_seq":397,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:07.965549+0000","last_change":"2024-09-11T14:42:38.105488+0000","last_active":"2024-09-11T14:44:07.965549+0000","last_peered":"2024-09-11T14:44:07.965549+0000","last_clean":"2024-09-11T14:44:07.965549+0000","last_became_active":"2024-09-11T14:42:38.071282+0000","last_became_peered":"2024-09-11T14:42:38.071282+0000","last_unstale":"2024-09-11T14:44:07.965549+0000","last_undegraded":"2024-09-11T14:44:07.965549+0000","last_fullsized":"2024-09-11T14:44:07.965549+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24444928,"num_objects":373,"num_object_clones":0,"num_object_copies":1119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":373,"num_write_kb":23872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"59'365","reported_seq":389,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:08.224962+0000","last_change":"2024-09-11T14:42:38.122969+0000","last_active":"2024-09-11T14:44:08.224962+0000","last_peered":"2024-09-11T14:44:08.224962+0000","last_clean":"2024-09-11T14:44:08.224962+0000","last_became_active":"2024-09-11T14:42:38.109230+0000","last_became_peered":"2024-09-11T14:42:38.109230+0000","last_unstale":"2024-09-11T14:44:08.224962+0000","last_undegraded":"2024-09-11T14:44:08.224962+0000","last_fullsized":"2024-09-11T14:44:08.224962+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":23360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"59'393","reported_seq":417,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:07.602554+0000","last_change":"2024-09-11T14:42:38.222378+0000","last_active":"2024-09-11T14:44:07.602554+0000","last_peered":"2024-09-11T14:44:07.602554+0000","last_clean":"2024-09-11T14:44:07.602554+0000","last_became_active":"2024-09-11T14:42:38.204348+0000","last_became_peered":"2024-09-11T14:42:38.204348+0000","last_unstale":"2024-09-11T14:44:07.602554+0000","last_undegraded":"2024-09-11T14:44:07.602554+0000","last_fullsized":"2024-09-11T14:44:07.602554+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":25152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":217,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:43:51.940699+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:43:51.940699+0000","last_peered":"2024-09-11T14:43:51.940699+0000","last_clean":"2024-09-11T14:43:51.940699+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:43:51.940699+0000","last_undegraded":"2024-09-11T14:43:51.940699+0000","last_fullsized":"2024-09-11T14:43:51.940699+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":146,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:43:51.947383+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:43:51.947383+0000","last_peered":"2024-09-11T14:43:51.947383+0000","last_clean":"2024-09-11T14:43:51.947383+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:43:51.947383+0000","last_undegraded":"2024-09-11T14:43:51.947383+0000","last_fullsized":"2024-09-11T14:43:51.947383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"59'369","reported_seq":393,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:08.230266+0000","last_change":"2024-09-11T14:42:38.156444+0000","last_active":"2024-09-11T14:44:08.230266+0000","last_peered":"2024-09-11T14:44:08.230266+0000","last_clean":"2024-09-11T14:44:08.230266+0000","last_became_active":"2024-09-11T14:42:38.142793+0000","last_became_peered":"2024-09-11T14:42:38.142793+0000","last_unstale":"2024-09-11T14:44:08.230266+0000","last_undegraded":"2024-09-11T14:44:08.230266+0000","last_fullsized":"2024-09-11T14:44:08.230266+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24182784,"num_objects":369,"num_object_clones":0,"num_object_copies":1107,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":23616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:43:51.988060+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:43:51.988060+0000","last_peered":"2024-09-11T14:43:51.988060+0000","last_clean":"2024-09-11T14:43:51.988060+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:43:51.988060+0000","last_undegraded":"2024-09-11T14:43:51.988060+0000","last_fullsized":"2024-09-11T14:43:51.988060+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"59'399","reported_seq":423,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:08.031979+0000","last_change":"2024-09-11T14:42:38.179244+0000","last_active":"2024-09-11T14:44:08.031979+0000","last_peered":"2024-09-11T14:44:08.031979+0000","last_clean":"2024-09-11T14:44:08.031979+0000","last_became_active":"2024-09-11T14:42:38.159043+0000","last_became_peered":"2024-09-11T14:42:38.159043+0000","last_unstale":"2024-09-11T14:44:08.031979+0000","last_undegraded":"2024-09-11T14:44:08.031979+0000","last_fullsized":"2024-09-11T14:44:08.031979+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26148864,"num_objects":399,"num_object_clones":0,"num_object_copies":1197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":25536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":145,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:43:51.944592+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:43:51.944592+0000","last_peered":"2024-09-11T14:43:51.944592+0000","last_clean":"2024-09-11T14:43:51.944592+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:43:51.944592+0000","last_undegraded":"2024-09-11T14:43:51.944592+0000","last_fullsized":"2024-09-11T14:43:51.944592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"59'389","reported_seq":413,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:08.379445+0000","last_change":"2024-09-11T14:42:38.098677+0000","last_active":"2024-09-11T14:44:08.379445+0000","last_peered":"2024-09-11T14:44:08.379445+0000","last_clean":"2024-09-11T14:44:08.379445+0000","last_became_active":"2024-09-11T14:42:38.060593+0000","last_became_peered":"2024-09-11T14:42:38.060593+0000","last_unstale":"2024-09-11T14:44:08.379445+0000","last_undegraded":"2024-09-11T14:44:08.379445+0000","last_fullsized":"2024-09-11T14:44:08.379445+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":24896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":147,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:43:51.974043+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:43:51.974043+0000","last_peered":"2024-09-11T14:43:51.974043+0000","last_clean":"2024-09-11T14:43:51.974043+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:43:51.974043+0000","last_undegraded":"2024-09-11T14:43:51.974043+0000","last_fullsized":"2024-09-11T14:43:51.974043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"59'396","reported_seq":420,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:08.115090+0000","last_change":"2024-09-11T14:42:38.108084+0000","last_active":"2024-09-11T14:44:08.115090+0000","last_peered":"2024-09-11T14:44:08.115090+0000","last_clean":"2024-09-11T14:44:08.115090+0000","last_became_active":"2024-09-11T14:42:38.044460+0000","last_became_peered":"2024-09-11T14:42:38.044460+0000","last_unstale":"2024-09-11T14:44:08.115090+0000","last_undegraded":"2024-09-11T14:44:08.115090+0000","last_fullsized":"2024-09-11T14:44:08.115090+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25952256,"num_objects":396,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":145,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:43:52.278166+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:43:52.278166+0000","last_peered":"2024-09-11T14:43:52.278166+0000","last_clean":"2024-09-11T14:43:52.278166+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:43:52.278166+0000","last_undegraded":"2024-09-11T14:43:52.278166+0000","last_fullsized":"2024-09-11T14:43:52.278166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"59'421","reported_seq":445,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:08.257864+0000","last_change":"2024-09-11T14:42:38.096488+0000","last_active":"2024-09-11T14:44:08.257864+0000","last_peered":"2024-09-11T14:44:08.257864+0000","last_clean":"2024-09-11T14:44:08.257864+0000","last_became_active":"2024-09-11T14:42:38.071104+0000","last_became_peered":"2024-09-11T14:42:38.071104+0000","last_unstale":"2024-09-11T14:44:08.257864+0000","last_undegraded":"2024-09-11T14:44:08.257864+0000","last_fullsized":"2024-09-11T14:44:08.257864+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":145,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:43:51.946644+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:43:51.946644+0000","last_peered":"2024-09-11T14:43:51.946644+0000","last_clean":"2024-09-11T14:43:51.946644+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:43:51.946644+0000","last_undegraded":"2024-09-11T14:43:51.946644+0000","last_fullsized":"2024-09-11T14:43:51.946644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"59'390","reported_seq":414,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:08.381400+0000","last_change":"2024-09-11T14:42:38.132564+0000","last_active":"2024-09-11T14:44:08.381400+0000","last_peered":"2024-09-11T14:44:08.381400+0000","last_clean":"2024-09-11T14:44:08.381400+0000","last_became_active":"2024-09-11T14:42:38.112585+0000","last_became_peered":"2024-09-11T14:42:38.112585+0000","last_unstale":"2024-09-11T14:44:08.381400+0000","last_undegraded":"2024-09-11T14:44:08.381400+0000","last_fullsized":"2024-09-11T14:44:08.381400+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25559040,"num_objects":390,"num_object_clones":0,"num_object_copies":1170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":24960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":145,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:43:52.268889+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:43:52.268889+0000","last_peered":"2024-09-11T14:43:52.268889+0000","last_clean":"2024-09-11T14:43:52.268889+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:43:52.268889+0000","last_undegraded":"2024-09-11T14:43:52.268889+0000","last_fullsized":"2024-09-11T14:43:52.268889+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"59'401","reported_seq":425,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:07.833687+0000","last_change":"2024-09-11T14:42:38.233207+0000","last_active":"2024-09-11T14:44:07.833687+0000","last_peered":"2024-09-11T14:44:07.833687+0000","last_clean":"2024-09-11T14:44:07.833687+0000","last_became_active":"2024-09-11T14:42:38.225462+0000","last_became_peered":"2024-09-11T14:42:38.225462+0000","last_unstale":"2024-09-11T14:44:07.833687+0000","last_undegraded":"2024-09-11T14:44:07.833687+0000","last_fullsized":"2024-09-11T14:44:07.833687+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26279936,"num_objects":401,"num_object_clones":0,"num_object_copies":1203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":401,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":145,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:43:51.950284+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:43:51.950284+0000","last_peered":"2024-09-11T14:43:51.950284+0000","last_clean":"2024-09-11T14:43:51.950284+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:43:51.950284+0000","last_undegraded":"2024-09-11T14:43:51.950284+0000","last_fullsized":"2024-09-11T14:43:51.950284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":411566080,"num_objects":6280,"num_object_clones":0,"num_object_copies":18840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6280,"num_write_kb":401920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211710636032,"internally_reserved":0,"allocated":2500857856,"data_stored":2500857856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6280,"ondisk_log_size":6280,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211710636032,"internally_reserved":0,"allocated":2500857856,"data_stored":2500857856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52967034880,"internally_reserved":0,"allocated":585838592,"data_stored":585838592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":569252,"kb_used_data":569252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51728476,"statfs":{"total":53552873472,"available":52969959424,"internally_reserved":0,"allocated":582914048,"data_stored":582914048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":706064,"kb_used_data":706064,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51591664,"statfs":{"total":53552873472,"available":52829863936,"internally_reserved":0,"allocated":723009536,"data_stored":723009536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":656264,"kb_used_data":656264,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51641464,"statfs":{"total":53552873472,"available":52880859136,"internally_reserved":0,"allocated":672014336,"data_stored":672014336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":498384,"kb_used_data":498384,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51799344,"statfs":{"total":53552873472,"available":53042528256,"internally_reserved":0,"allocated":510345216,"data_stored":510345216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52967034880,"internally_reserved":0,"allocated":585838592,"data_stored":585838592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52878499840,"internally_reserved":0,"allocated":674373632,"data_stored":674373632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53038178304,"internally_reserved":0,"allocated":514695168,"data_stored":514695168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52826923008,"internally_reserved":0,"allocated":725950464,"data_stored":725950464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52967034880,"internally_reserved":0,"allocated":585838592,"data_stored":585838592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":52878499840,"internally_reserved":0,"allocated":674373632,"data_stored":674373632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53038178304,"internally_reserved":0,"allocated":514695168,"data_stored":514695168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":52826923008,"internally_reserved":0,"allocated":725950464,"data_stored":725950464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":52967034880,"internally_reserved":0,"allocated":585838592,"data_stored":585838592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:44:11.592 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:44:11.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:11.756+0000 7f27e1d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:11.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:11.763+0000 7f27e1d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:14.225 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:44:14.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:14.355+0000 7f41f1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:14.365+0000 7f41f1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:16.481 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:44:16.481 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:44:16.482 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:44:16.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:16.636+0000 7f929c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:16.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:16.646+0000 7f929c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:16.734 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:44:16.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:16.869+0000 7f5a3a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:16.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:16.883+0000 7f5a3a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:16.886 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:44:16.886 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:44:16.905 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2024-09-11T14:44:15.325685+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391381579,"num_objects":5968,"num_object_clones":0,"num_object_copies":17904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":6769,"num_write_kb":405909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6743,"ondisk_log_size":6743,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2333620,"kb_used_data":2333620,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206857292,"statfs":{"total":214211493888,"available":211821867008,"internally_reserved":0,"allocated":2389626880,"data_stored":2389626880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27656216,"num_objects":423,"num_object_clones":0,"num_object_copies":1269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1147,"num_write_kb":50177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002672"},"pg_stats":[{"pgid":"5.f","version":"59'413","reported_seq":437,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:13.044715+0000","last_change":"2024-09-11T14:42:38.114713+0000","last_active":"2024-09-11T14:44:13.044715+0000","last_peered":"2024-09-11T14:44:13.044715+0000","last_clean":"2024-09-11T14:44:13.044715+0000","last_became_active":"2024-09-11T14:42:38.099767+0000","last_became_peered":"2024-09-11T14:42:38.099767+0000","last_unstale":"2024-09-11T14:44:13.044715+0000","last_undegraded":"2024-09-11T14:44:13.044715+0000","last_fullsized":"2024-09-11T14:44:13.044715+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24313856,"num_objects":371,"num_object_clones":0,"num_object_copies":1113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":413,"num_write_kb":25088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"59'441","reported_seq":465,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:12.874253+0000","last_change":"2024-09-11T14:42:38.177741+0000","last_active":"2024-09-11T14:44:12.874253+0000","last_peered":"2024-09-11T14:44:12.874253+0000","last_clean":"2024-09-11T14:44:12.874253+0000","last_became_active":"2024-09-11T14:42:38.170462+0000","last_became_peered":"2024-09-11T14:42:38.170462+0000","last_unstale":"2024-09-11T14:44:12.874253+0000","last_undegraded":"2024-09-11T14:44:12.874253+0000","last_fullsized":"2024-09-11T14:44:12.874253+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26279936,"num_objects":401,"num_object_clones":0,"num_object_copies":1203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":441,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"59'447","reported_seq":472,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:13.148066+0000","last_change":"2024-09-11T14:42:38.204931+0000","last_active":"2024-09-11T14:44:13.148066+0000","last_peered":"2024-09-11T14:44:13.148066+0000","last_clean":"2024-09-11T14:44:13.148066+0000","last_became_active":"2024-09-11T14:42:38.189110+0000","last_became_peered":"2024-09-11T14:42:38.189110+0000","last_unstale":"2024-09-11T14:44:13.148066+0000","last_undegraded":"2024-09-11T14:44:13.148066+0000","last_fullsized":"2024-09-11T14:44:13.148066+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25690136,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":447,"num_write_kb":26817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"59'435","reported_seq":459,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:14.176173+0000","last_change":"2024-09-11T14:42:38.097894+0000","last_active":"2024-09-11T14:44:14.176173+0000","last_peered":"2024-09-11T14:44:14.176173+0000","last_clean":"2024-09-11T14:44:14.176173+0000","last_became_active":"2024-09-11T14:42:38.068084+0000","last_became_peered":"2024-09-11T14:42:38.068084+0000","last_unstale":"2024-09-11T14:44:14.176173+0000","last_undegraded":"2024-09-11T14:44:14.176173+0000","last_fullsized":"2024-09-11T14:44:14.176173+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24969216,"num_objects":381,"num_object_clones":0,"num_object_copies":1143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"59'396","reported_seq":420,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:12.614014+0000","last_change":"2024-09-11T14:42:38.084302+0000","last_active":"2024-09-11T14:44:12.614014+0000","last_peered":"2024-09-11T14:44:12.614014+0000","last_clean":"2024-09-11T14:44:12.614014+0000","last_became_active":"2024-09-11T14:42:38.060054+0000","last_became_peered":"2024-09-11T14:42:38.060054+0000","last_unstale":"2024-09-11T14:44:12.614014+0000","last_undegraded":"2024-09-11T14:44:12.614014+0000","last_fullsized":"2024-09-11T14:44:12.614014+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23724032,"num_objects":362,"num_object_clones":0,"num_object_copies":1086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"59'407","reported_seq":431,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:12.880462+0000","last_change":"2024-09-11T14:42:38.114647+0000","last_active":"2024-09-11T14:44:12.880462+0000","last_peered":"2024-09-11T14:44:12.880462+0000","last_clean":"2024-09-11T14:44:12.880462+0000","last_became_active":"2024-09-11T14:42:38.075902+0000","last_became_peered":"2024-09-11T14:42:38.075902+0000","last_unstale":"2024-09-11T14:44:12.880462+0000","last_undegraded":"2024-09-11T14:44:12.880462+0000","last_fullsized":"2024-09-11T14:44:12.880462+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":24704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"59'389","reported_seq":413,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:12.151541+0000","last_change":"2024-09-11T14:42:38.105488+0000","last_active":"2024-09-11T14:44:12.151541+0000","last_peered":"2024-09-11T14:44:12.151541+0000","last_clean":"2024-09-11T14:44:12.151541+0000","last_became_active":"2024-09-11T14:42:38.071282+0000","last_became_peered":"2024-09-11T14:42:38.071282+0000","last_unstale":"2024-09-11T14:44:12.151541+0000","last_undegraded":"2024-09-11T14:44:12.151541+0000","last_fullsized":"2024-09-11T14:44:12.151541+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23527424,"num_objects":359,"num_object_clones":0,"num_object_copies":1077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"59'394","reported_seq":418,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:12.746543+0000","last_change":"2024-09-11T14:42:38.122969+0000","last_active":"2024-09-11T14:44:12.746543+0000","last_peered":"2024-09-11T14:44:12.746543+0000","last_clean":"2024-09-11T14:44:12.746543+0000","last_became_active":"2024-09-11T14:42:38.109230+0000","last_became_peered":"2024-09-11T14:42:38.109230+0000","last_unstale":"2024-09-11T14:44:12.746543+0000","last_undegraded":"2024-09-11T14:44:12.746543+0000","last_fullsized":"2024-09-11T14:44:12.746543+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22413312,"num_objects":342,"num_object_clones":0,"num_object_copies":1026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":394,"num_write_kb":23552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"59'430","reported_seq":454,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:13.294537+0000","last_change":"2024-09-11T14:42:38.222378+0000","last_active":"2024-09-11T14:44:13.294537+0000","last_peered":"2024-09-11T14:44:13.294537+0000","last_clean":"2024-09-11T14:44:13.294537+0000","last_became_active":"2024-09-11T14:42:38.204348+0000","last_became_peered":"2024-09-11T14:42:38.204348+0000","last_unstale":"2024-09-11T14:44:13.294537+0000","last_undegraded":"2024-09-11T14:44:13.294537+0000","last_fullsized":"2024-09-11T14:44:13.294537+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":430,"num_write_kb":25408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":217,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:43:51.940699+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:43:51.940699+0000","last_peered":"2024-09-11T14:43:51.940699+0000","last_clean":"2024-09-11T14:43:51.940699+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:43:51.940699+0000","last_undegraded":"2024-09-11T14:43:51.940699+0000","last_fullsized":"2024-09-11T14:43:51.940699+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":146,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:43:51.947383+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:43:51.947383+0000","last_peered":"2024-09-11T14:43:51.947383+0000","last_clean":"2024-09-11T14:43:51.947383+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:43:51.947383+0000","last_undegraded":"2024-09-11T14:43:51.947383+0000","last_fullsized":"2024-09-11T14:43:51.947383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"59'398","reported_seq":422,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:12.907075+0000","last_change":"2024-09-11T14:42:38.156444+0000","last_active":"2024-09-11T14:44:12.907075+0000","last_peered":"2024-09-11T14:44:12.907075+0000","last_clean":"2024-09-11T14:44:12.907075+0000","last_became_active":"2024-09-11T14:42:38.142793+0000","last_became_peered":"2024-09-11T14:42:38.142793+0000","last_unstale":"2024-09-11T14:44:12.907075+0000","last_undegraded":"2024-09-11T14:44:12.907075+0000","last_fullsized":"2024-09-11T14:44:12.907075+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22544384,"num_objects":344,"num_object_clones":0,"num_object_copies":1032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":398,"num_write_kb":23744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:43:51.988060+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:43:51.988060+0000","last_peered":"2024-09-11T14:43:51.988060+0000","last_clean":"2024-09-11T14:43:51.988060+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:43:51.988060+0000","last_undegraded":"2024-09-11T14:43:51.988060+0000","last_fullsized":"2024-09-11T14:43:51.988060+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"59'425","reported_seq":449,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:12.966503+0000","last_change":"2024-09-11T14:42:38.179244+0000","last_active":"2024-09-11T14:44:12.966503+0000","last_peered":"2024-09-11T14:44:12.966503+0000","last_clean":"2024-09-11T14:44:12.966503+0000","last_became_active":"2024-09-11T14:42:38.159043+0000","last_became_peered":"2024-09-11T14:42:38.159043+0000","last_unstale":"2024-09-11T14:44:12.966503+0000","last_undegraded":"2024-09-11T14:44:12.966503+0000","last_fullsized":"2024-09-11T14:44:12.966503+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25100288,"num_objects":383,"num_object_clones":0,"num_object_copies":1149,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":145,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:43:51.944592+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:43:51.944592+0000","last_peered":"2024-09-11T14:43:51.944592+0000","last_clean":"2024-09-11T14:43:51.944592+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:43:51.944592+0000","last_undegraded":"2024-09-11T14:43:51.944592+0000","last_fullsized":"2024-09-11T14:43:51.944592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"59'415","reported_seq":439,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:13.383559+0000","last_change":"2024-09-11T14:42:38.098677+0000","last_active":"2024-09-11T14:44:13.383559+0000","last_peered":"2024-09-11T14:44:13.383559+0000","last_clean":"2024-09-11T14:44:13.383559+0000","last_became_active":"2024-09-11T14:42:38.060593+0000","last_became_peered":"2024-09-11T14:42:38.060593+0000","last_unstale":"2024-09-11T14:44:13.383559+0000","last_undegraded":"2024-09-11T14:44:13.383559+0000","last_fullsized":"2024-09-11T14:44:13.383559+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24051712,"num_objects":367,"num_object_clones":0,"num_object_copies":1101,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":25024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":147,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:43:51.974043+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:43:51.974043+0000","last_peered":"2024-09-11T14:43:51.974043+0000","last_clean":"2024-09-11T14:43:51.974043+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:43:51.974043+0000","last_undegraded":"2024-09-11T14:43:51.974043+0000","last_fullsized":"2024-09-11T14:43:51.974043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"59'419","reported_seq":443,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:13.374243+0000","last_change":"2024-09-11T14:42:38.108084+0000","last_active":"2024-09-11T14:44:13.374243+0000","last_peered":"2024-09-11T14:44:13.374243+0000","last_clean":"2024-09-11T14:44:13.374243+0000","last_became_active":"2024-09-11T14:42:38.044460+0000","last_became_peered":"2024-09-11T14:42:38.044460+0000","last_unstale":"2024-09-11T14:44:13.374243+0000","last_undegraded":"2024-09-11T14:44:13.374243+0000","last_fullsized":"2024-09-11T14:44:13.374243+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24969216,"num_objects":381,"num_object_clones":0,"num_object_copies":1143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":145,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:43:52.278166+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:43:52.278166+0000","last_peered":"2024-09-11T14:43:52.278166+0000","last_clean":"2024-09-11T14:43:52.278166+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:43:52.278166+0000","last_undegraded":"2024-09-11T14:43:52.278166+0000","last_fullsized":"2024-09-11T14:43:52.278166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"59'433","reported_seq":457,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:13.317196+0000","last_change":"2024-09-11T14:42:38.096488+0000","last_active":"2024-09-11T14:44:13.317196+0000","last_peered":"2024-09-11T14:44:13.317196+0000","last_clean":"2024-09-11T14:44:13.317196+0000","last_became_active":"2024-09-11T14:42:38.071104+0000","last_became_peered":"2024-09-11T14:42:38.071104+0000","last_unstale":"2024-09-11T14:44:13.317196+0000","last_undegraded":"2024-09-11T14:44:13.317196+0000","last_fullsized":"2024-09-11T14:44:13.317196+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26935296,"num_objects":411,"num_object_clones":0,"num_object_copies":1233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":27008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":145,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:43:51.946644+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:43:51.946644+0000","last_peered":"2024-09-11T14:43:51.946644+0000","last_clean":"2024-09-11T14:43:51.946644+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:43:51.946644+0000","last_undegraded":"2024-09-11T14:43:51.946644+0000","last_fullsized":"2024-09-11T14:43:51.946644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"59'419","reported_seq":443,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:14.024055+0000","last_change":"2024-09-11T14:42:38.132564+0000","last_active":"2024-09-11T14:44:14.024055+0000","last_peered":"2024-09-11T14:44:14.024055+0000","last_clean":"2024-09-11T14:44:14.024055+0000","last_became_active":"2024-09-11T14:42:38.112585+0000","last_became_peered":"2024-09-11T14:42:38.112585+0000","last_unstale":"2024-09-11T14:44:14.024055+0000","last_undegraded":"2024-09-11T14:44:14.024055+0000","last_fullsized":"2024-09-11T14:44:14.024055+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23658496,"num_objects":361,"num_object_clones":0,"num_object_copies":1083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":24960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":145,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:43:52.268889+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:43:52.268889+0000","last_peered":"2024-09-11T14:43:52.268889+0000","last_clean":"2024-09-11T14:43:52.268889+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:43:52.268889+0000","last_undegraded":"2024-09-11T14:43:52.268889+0000","last_fullsized":"2024-09-11T14:43:52.268889+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"59'427","reported_seq":451,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:44:13.115613+0000","last_change":"2024-09-11T14:42:38.233207+0000","last_active":"2024-09-11T14:44:13.115613+0000","last_peered":"2024-09-11T14:44:13.115613+0000","last_clean":"2024-09-11T14:44:13.115613+0000","last_became_active":"2024-09-11T14:42:38.225462+0000","last_became_peered":"2024-09-11T14:42:38.225462+0000","last_unstale":"2024-09-11T14:44:13.115613+0000","last_undegraded":"2024-09-11T14:44:13.115613+0000","last_fullsized":"2024-09-11T14:44:13.115613+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24838144,"num_objects":379,"num_object_clones":0,"num_object_copies":1137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":145,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T14:43:51.950284+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:43:51.950284+0000","last_peered":"2024-09-11T14:43:51.950284+0000","last_clean":"2024-09-11T14:43:51.950284+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:43:51.950284+0000","last_undegraded":"2024-09-11T14:43:51.950284+0000","last_fullsized":"2024-09-11T14:43:51.950284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":390791192,"num_objects":5964,"num_object_clones":0,"num_object_copies":17892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6688,"num_write_kb":404801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211835777024,"internally_reserved":0,"allocated":2375716864,"data_stored":2375716864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6688,"ondisk_log_size":6688,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211835777024,"internally_reserved":0,"allocated":2375716864,"data_stored":2375716864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53004226560,"internally_reserved":0,"allocated":548646912,"data_stored":548646912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673449,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":541048,"kb_used_data":541048,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51756680,"statfs":{"total":53552873472,"available":52998840320,"internally_reserved":0,"allocated":554033152,"data_stored":554033152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706153,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":678904,"kb_used_data":678904,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51618824,"statfs":{"total":53552873472,"available":52857675776,"internally_reserved":0,"allocated":695197696,"data_stored":695197696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706153,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":629588,"kb_used_data":629588,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51668140,"statfs":{"total":53552873472,"available":52908175360,"internally_reserved":0,"allocated":644698112,"data_stored":644698112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706153,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":484080,"kb_used_data":484080,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51813648,"statfs":{"total":53552873472,"available":53057175552,"internally_reserved":0,"allocated":495697920,"data_stored":495697920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53004226560,"internally_reserved":0,"allocated":548646912,"data_stored":548646912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52909879296,"internally_reserved":0,"allocated":642994176,"data_stored":642994176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53061632000,"internally_reserved":0,"allocated":491241472,"data_stored":491241472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52860039168,"internally_reserved":0,"allocated":692834304,"data_stored":692834304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53004226560,"internally_reserved":0,"allocated":548646912,"data_stored":548646912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":52909879296,"internally_reserved":0,"allocated":642994176,"data_stored":642994176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53061632000,"internally_reserved":0,"allocated":491241472,"data_stored":491241472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":52860039168,"internally_reserved":0,"allocated":692834304,"data_stored":692834304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53004226560,"internally_reserved":0,"allocated":548646912,"data_stored":548646912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:44:19.341 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:44:19.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:19.486+0000 7fea5df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:19.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:19.495+0000 7fea5df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:21.771 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:44:21.907 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:44:21.908 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T14:44:21.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:21.915+0000 7f0577d08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:21.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:21.925+0000 7f0577d08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:22.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:22.047+0000 7f0a92cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:22.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:22.067+0000 7f0a92cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:22.894 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T14:44:22.916 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T14:44:23.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:23.064+0000 7f1952a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:23.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:23.081+0000 7f1952a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:23.902 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T14:44:23.920 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T14:44:24.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:24.075+0000 7fea95b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:24.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:24.089+0000 7fea95b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:24.417 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:44:24.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:24.566+0000 7f79b2c46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:24.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:24.574+0000 7f79b2c46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:24.903 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T14:44:24.931 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T14:44:25.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:25.103+0000 7fa041b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:25.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:25.118+0000 7fa041b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:25.916 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T14:44:25.935 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T14:44:25.935 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:44:26.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:26.100+0000 7f7b20b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:26.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:26.113+0000 7f7b20b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:26.438 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:44:26.439 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:44:26.457 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-09-11T14:44:25.914032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":328008267,"num_objects":5001,"num_object_clones":0,"num_object_copies":15003,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":7736,"num_write_kb":405909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7710,"ondisk_log_size":7710,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1963400,"kb_used_data":1963400,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207227512,"statfs":{"total":214211493888,"available":212200972288,"internally_reserved":0,"allocated":2010521600,"data_stored":2010521600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-31326208,"num_objects":-478,"num_object_clones":0,"num_object_copies":-1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":478,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.586911"},"pg_stats":[{"pgid":"5.f","version":"60'472","reported_seq":499,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.006295+0000","last_change":"2024-09-11T14:42:38.114713+0000","last_active":"2024-09-11T14:44:23.006295+0000","last_peered":"2024-09-11T14:44:23.006295+0000","last_clean":"2024-09-11T14:44:23.006295+0000","last_became_active":"2024-09-11T14:42:38.099767+0000","last_became_peered":"2024-09-11T14:42:38.099767+0000","last_unstale":"2024-09-11T14:44:23.006295+0000","last_undegraded":"2024-09-11T14:44:23.006295+0000","last_fullsized":"2024-09-11T14:44:23.006295+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20447232,"num_objects":312,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":25088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"60'507","reported_seq":534,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.161170+0000","last_change":"2024-09-11T14:42:38.177741+0000","last_active":"2024-09-11T14:44:23.161170+0000","last_peered":"2024-09-11T14:44:23.161170+0000","last_clean":"2024-09-11T14:44:23.161170+0000","last_became_active":"2024-09-11T14:42:38.170462+0000","last_became_peered":"2024-09-11T14:42:38.170462+0000","last_unstale":"2024-09-11T14:44:23.161170+0000","last_undegraded":"2024-09-11T14:44:23.161170+0000","last_fullsized":"2024-09-11T14:44:23.161170+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"59'506","reported_seq":534,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:22.956102+0000","last_change":"2024-09-11T14:42:38.204931+0000","last_active":"2024-09-11T14:44:22.956102+0000","last_peered":"2024-09-11T14:44:22.956102+0000","last_clean":"2024-09-11T14:44:22.956102+0000","last_became_active":"2024-09-11T14:42:38.189110+0000","last_became_peered":"2024-09-11T14:42:38.189110+0000","last_unstale":"2024-09-11T14:44:22.956102+0000","last_undegraded":"2024-09-11T14:44:22.956102+0000","last_fullsized":"2024-09-11T14:44:22.956102+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21823512,"num_objects":334,"num_object_clones":0,"num_object_copies":1002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":506,"num_write_kb":26817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"61'504","reported_seq":534,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T14:44:24.109364+0000","last_change":"2024-09-11T14:42:38.097894+0000","last_active":"2024-09-11T14:44:24.109364+0000","last_peered":"2024-09-11T14:44:24.109364+0000","last_clean":"2024-09-11T14:44:24.109364+0000","last_became_active":"2024-09-11T14:42:38.068084+0000","last_became_peered":"2024-09-11T14:42:38.068084+0000","last_unstale":"2024-09-11T14:44:24.109364+0000","last_undegraded":"2024-09-11T14:44:24.109364+0000","last_fullsized":"2024-09-11T14:44:24.109364+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20447232,"num_objects":312,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"60'444","reported_seq":471,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.200082+0000","last_change":"2024-09-11T14:42:38.084302+0000","last_active":"2024-09-11T14:44:23.200082+0000","last_peered":"2024-09-11T14:44:23.200082+0000","last_clean":"2024-09-11T14:44:23.200082+0000","last_became_active":"2024-09-11T14:42:38.060054+0000","last_became_peered":"2024-09-11T14:42:38.060054+0000","last_unstale":"2024-09-11T14:44:23.200082+0000","last_undegraded":"2024-09-11T14:44:23.200082+0000","last_fullsized":"2024-09-11T14:44:23.200082+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20578304,"num_objects":314,"num_object_clones":0,"num_object_copies":942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":444,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"60'473","reported_seq":500,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.208744+0000","last_change":"2024-09-11T14:42:38.114647+0000","last_active":"2024-09-11T14:44:23.208744+0000","last_peered":"2024-09-11T14:44:23.208744+0000","last_clean":"2024-09-11T14:44:23.208744+0000","last_became_active":"2024-09-11T14:42:38.075902+0000","last_became_peered":"2024-09-11T14:42:38.075902+0000","last_unstale":"2024-09-11T14:44:23.208744+0000","last_undegraded":"2024-09-11T14:44:23.208744+0000","last_fullsized":"2024-09-11T14:44:23.208744+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":473,"num_write_kb":24704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"60'451","reported_seq":478,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.198488+0000","last_change":"2024-09-11T14:42:38.105488+0000","last_active":"2024-09-11T14:44:23.198488+0000","last_peered":"2024-09-11T14:44:23.198488+0000","last_clean":"2024-09-11T14:44:23.198488+0000","last_became_active":"2024-09-11T14:42:38.071282+0000","last_became_peered":"2024-09-11T14:42:38.071282+0000","last_unstale":"2024-09-11T14:44:23.198488+0000","last_undegraded":"2024-09-11T14:44:23.198488+0000","last_fullsized":"2024-09-11T14:44:23.198488+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"60'455","reported_seq":482,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.415874+0000","last_change":"2024-09-11T14:42:38.122969+0000","last_active":"2024-09-11T14:44:23.415874+0000","last_peered":"2024-09-11T14:44:23.415874+0000","last_clean":"2024-09-11T14:44:23.415874+0000","last_became_active":"2024-09-11T14:42:38.109230+0000","last_became_peered":"2024-09-11T14:42:38.109230+0000","last_unstale":"2024-09-11T14:44:23.415874+0000","last_undegraded":"2024-09-11T14:44:23.415874+0000","last_fullsized":"2024-09-11T14:44:23.415874+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18415616,"num_objects":281,"num_object_clones":0,"num_object_copies":843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":23552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"60'485","reported_seq":512,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.203457+0000","last_change":"2024-09-11T14:42:38.222378+0000","last_active":"2024-09-11T14:44:23.203457+0000","last_peered":"2024-09-11T14:44:23.203457+0000","last_clean":"2024-09-11T14:44:23.203457+0000","last_became_active":"2024-09-11T14:42:38.204348+0000","last_became_peered":"2024-09-11T14:42:38.204348+0000","last_unstale":"2024-09-11T14:44:23.203457+0000","last_undegraded":"2024-09-11T14:44:23.203457+0000","last_fullsized":"2024-09-11T14:44:23.203457+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":25408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":223,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.954645+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:44:23.954645+0000","last_peered":"2024-09-11T14:44:23.954645+0000","last_clean":"2024-09-11T14:44:23.954645+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:44:23.954645+0000","last_undegraded":"2024-09-11T14:44:23.954645+0000","last_fullsized":"2024-09-11T14:44:23.954645+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":149,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:22.991718+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:44:22.991718+0000","last_peered":"2024-09-11T14:44:22.991718+0000","last_clean":"2024-09-11T14:44:22.991718+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:44:22.991718+0000","last_undegraded":"2024-09-11T14:44:22.991718+0000","last_fullsized":"2024-09-11T14:44:22.991718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"60'453","reported_seq":480,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.320767+0000","last_change":"2024-09-11T14:42:38.156444+0000","last_active":"2024-09-11T14:44:23.320767+0000","last_peered":"2024-09-11T14:44:23.320767+0000","last_clean":"2024-09-11T14:44:23.320767+0000","last_became_active":"2024-09-11T14:42:38.142793+0000","last_became_peered":"2024-09-11T14:42:38.142793+0000","last_unstale":"2024-09-11T14:44:23.320767+0000","last_undegraded":"2024-09-11T14:44:23.320767+0000","last_fullsized":"2024-09-11T14:44:23.320767+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18939904,"num_objects":289,"num_object_clones":0,"num_object_copies":867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":23744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:22.975303+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:44:22.975303+0000","last_peered":"2024-09-11T14:44:22.975303+0000","last_clean":"2024-09-11T14:44:22.975303+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:44:22.975303+0000","last_undegraded":"2024-09-11T14:44:22.975303+0000","last_fullsized":"2024-09-11T14:44:22.975303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"60'488","reported_seq":515,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.290110+0000","last_change":"2024-09-11T14:42:38.179244+0000","last_active":"2024-09-11T14:44:23.290110+0000","last_peered":"2024-09-11T14:44:23.290110+0000","last_clean":"2024-09-11T14:44:23.290110+0000","last_became_active":"2024-09-11T14:42:38.159043+0000","last_became_peered":"2024-09-11T14:42:38.159043+0000","last_unstale":"2024-09-11T14:44:23.290110+0000","last_undegraded":"2024-09-11T14:44:23.290110+0000","last_fullsized":"2024-09-11T14:44:23.290110+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":320,"num_object_clones":0,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:22.982069+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:44:22.982069+0000","last_peered":"2024-09-11T14:44:22.982069+0000","last_clean":"2024-09-11T14:44:22.982069+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:44:22.982069+0000","last_undegraded":"2024-09-11T14:44:22.982069+0000","last_fullsized":"2024-09-11T14:44:22.982069+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"59'470","reported_seq":497,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.008214+0000","last_change":"2024-09-11T14:42:38.098677+0000","last_active":"2024-09-11T14:44:23.008214+0000","last_peered":"2024-09-11T14:44:23.008214+0000","last_clean":"2024-09-11T14:44:23.008214+0000","last_became_active":"2024-09-11T14:42:38.060593+0000","last_became_peered":"2024-09-11T14:42:38.060593+0000","last_unstale":"2024-09-11T14:44:23.008214+0000","last_undegraded":"2024-09-11T14:44:23.008214+0000","last_fullsized":"2024-09-11T14:44:23.008214+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20447232,"num_objects":312,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":470,"num_write_kb":25024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":150,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:22.957727+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:44:22.957727+0000","last_peered":"2024-09-11T14:44:22.957727+0000","last_clean":"2024-09-11T14:44:22.957727+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:44:22.957727+0000","last_undegraded":"2024-09-11T14:44:22.957727+0000","last_fullsized":"2024-09-11T14:44:22.957727+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"60'483","reported_seq":510,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.009196+0000","last_change":"2024-09-11T14:42:38.108084+0000","last_active":"2024-09-11T14:44:23.009196+0000","last_peered":"2024-09-11T14:44:23.009196+0000","last_clean":"2024-09-11T14:44:23.009196+0000","last_became_active":"2024-09-11T14:42:38.044460+0000","last_became_peered":"2024-09-11T14:42:38.044460+0000","last_unstale":"2024-09-11T14:44:23.009196+0000","last_undegraded":"2024-09-11T14:44:23.009196+0000","last_fullsized":"2024-09-11T14:44:23.009196+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20774912,"num_objects":317,"num_object_clones":0,"num_object_copies":951,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":483,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.017209+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:44:23.017209+0000","last_peered":"2024-09-11T14:44:23.017209+0000","last_clean":"2024-09-11T14:44:23.017209+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:44:23.017209+0000","last_undegraded":"2024-09-11T14:44:23.017209+0000","last_fullsized":"2024-09-11T14:44:23.017209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"60'491","reported_seq":518,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.025433+0000","last_change":"2024-09-11T14:42:38.096488+0000","last_active":"2024-09-11T14:44:23.025433+0000","last_peered":"2024-09-11T14:44:23.025433+0000","last_clean":"2024-09-11T14:44:23.025433+0000","last_became_active":"2024-09-11T14:42:38.071104+0000","last_became_peered":"2024-09-11T14:42:38.071104+0000","last_unstale":"2024-09-11T14:44:23.025433+0000","last_undegraded":"2024-09-11T14:44:23.025433+0000","last_fullsized":"2024-09-11T14:44:23.025433+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":491,"num_write_kb":27008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.962966+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:44:23.962966+0000","last_peered":"2024-09-11T14:44:23.962966+0000","last_clean":"2024-09-11T14:44:23.962966+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:44:23.962966+0000","last_undegraded":"2024-09-11T14:44:23.962966+0000","last_fullsized":"2024-09-11T14:44:23.962966+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"61'484","reported_seq":514,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.962094+0000","last_change":"2024-09-11T14:42:38.132564+0000","last_active":"2024-09-11T14:44:23.962094+0000","last_peered":"2024-09-11T14:44:23.962094+0000","last_clean":"2024-09-11T14:44:23.962094+0000","last_became_active":"2024-09-11T14:42:38.112585+0000","last_became_peered":"2024-09-11T14:42:38.112585+0000","last_unstale":"2024-09-11T14:44:23.962094+0000","last_undegraded":"2024-09-11T14:44:23.962094+0000","last_fullsized":"2024-09-11T14:44:23.962094+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19398656,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":484,"num_write_kb":24960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.007041+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:44:23.007041+0000","last_peered":"2024-09-11T14:44:23.007041+0000","last_clean":"2024-09-11T14:44:23.007041+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:44:23.007041+0000","last_undegraded":"2024-09-11T14:44:23.007041+0000","last_fullsized":"2024-09-11T14:44:23.007041+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"60'489","reported_seq":516,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.081292+0000","last_change":"2024-09-11T14:42:38.233207+0000","last_active":"2024-09-11T14:44:23.081292+0000","last_peered":"2024-09-11T14:44:23.081292+0000","last_clean":"2024-09-11T14:44:23.081292+0000","last_became_active":"2024-09-11T14:42:38.225462+0000","last_became_peered":"2024-09-11T14:42:38.225462+0000","last_unstale":"2024-09-11T14:44:23.081292+0000","last_undegraded":"2024-09-11T14:44:23.081292+0000","last_fullsized":"2024-09-11T14:44:23.081292+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20774912,"num_objects":317,"num_object_clones":0,"num_object_copies":951,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:22.990542+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:44:22.990542+0000","last_peered":"2024-09-11T14:44:22.990542+0000","last_clean":"2024-09-11T14:44:22.990542+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:44:22.990542+0000","last_undegraded":"2024-09-11T14:44:22.990542+0000","last_fullsized":"2024-09-11T14:44:22.990542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":327417880,"num_objects":4997,"num_object_clones":0,"num_object_copies":14991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7655,"num_write_kb":404801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212215984128,"internally_reserved":0,"allocated":1995509760,"data_stored":1995509760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7655,"ondisk_log_size":7655,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212215721984,"internally_reserved":0,"allocated":1995771904,"data_stored":1995771904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53092900864,"internally_reserved":0,"allocated":459972608,"data_stored":459972608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":454256,"kb_used_data":454256,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51843472,"statfs":{"total":53552873472,"available":53087715328,"internally_reserved":0,"allocated":465158144,"data_stored":465158144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":568184,"kb_used_data":568184,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51729544,"statfs":{"total":53552873472,"available":52971053056,"internally_reserved":0,"allocated":581820416,"data_stored":581820416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":531952,"kb_used_data":531952,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51765776,"statfs":{"total":53552873472,"available":53008154624,"internally_reserved":0,"allocated":544718848,"data_stored":544718848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":409008,"kb_used_data":409008,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51888720,"statfs":{"total":53552873472,"available":53134049280,"internally_reserved":0,"allocated":418824192,"data_stored":418824192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53092900864,"internally_reserved":0,"allocated":459972608,"data_stored":459972608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53011042304,"internally_reserved":0,"allocated":541831168,"data_stored":541831168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53138104320,"internally_reserved":0,"allocated":414769152,"data_stored":414769152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52973674496,"internally_reserved":0,"allocated":579198976,"data_stored":579198976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53092900864,"internally_reserved":0,"allocated":459972608,"data_stored":459972608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53011173376,"internally_reserved":0,"allocated":541700096,"data_stored":541700096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53138104320,"internally_reserved":0,"allocated":414769152,"data_stored":414769152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":52973674496,"internally_reserved":0,"allocated":579198976,"data_stored":579198976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53093031936,"internally_reserved":0,"allocated":459841536,"data_stored":459841536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:44:26.458 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:44:26.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:26.590+0000 7f062629c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:26.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:26.599+0000 7f062629c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:26.871 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:44:26.871 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:44:26.889 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-09-11T14:44:25.914032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":328008267,"num_objects":5001,"num_object_clones":0,"num_object_copies":15003,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":7736,"num_write_kb":405909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7710,"ondisk_log_size":7710,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1963400,"kb_used_data":1963400,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207227512,"statfs":{"total":214211493888,"available":212200972288,"internally_reserved":0,"allocated":2010521600,"data_stored":2010521600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-31326208,"num_objects":-478,"num_object_clones":0,"num_object_copies":-1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":478,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.586911"},"pg_stats":[{"pgid":"5.f","version":"60'472","reported_seq":499,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.006295+0000","last_change":"2024-09-11T14:42:38.114713+0000","last_active":"2024-09-11T14:44:23.006295+0000","last_peered":"2024-09-11T14:44:23.006295+0000","last_clean":"2024-09-11T14:44:23.006295+0000","last_became_active":"2024-09-11T14:42:38.099767+0000","last_became_peered":"2024-09-11T14:42:38.099767+0000","last_unstale":"2024-09-11T14:44:23.006295+0000","last_undegraded":"2024-09-11T14:44:23.006295+0000","last_fullsized":"2024-09-11T14:44:23.006295+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20447232,"num_objects":312,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":25088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"60'507","reported_seq":534,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.161170+0000","last_change":"2024-09-11T14:42:38.177741+0000","last_active":"2024-09-11T14:44:23.161170+0000","last_peered":"2024-09-11T14:44:23.161170+0000","last_clean":"2024-09-11T14:44:23.161170+0000","last_became_active":"2024-09-11T14:42:38.170462+0000","last_became_peered":"2024-09-11T14:42:38.170462+0000","last_unstale":"2024-09-11T14:44:23.161170+0000","last_undegraded":"2024-09-11T14:44:23.161170+0000","last_fullsized":"2024-09-11T14:44:23.161170+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"59'506","reported_seq":534,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:22.956102+0000","last_change":"2024-09-11T14:42:38.204931+0000","last_active":"2024-09-11T14:44:22.956102+0000","last_peered":"2024-09-11T14:44:22.956102+0000","last_clean":"2024-09-11T14:44:22.956102+0000","last_became_active":"2024-09-11T14:42:38.189110+0000","last_became_peered":"2024-09-11T14:42:38.189110+0000","last_unstale":"2024-09-11T14:44:22.956102+0000","last_undegraded":"2024-09-11T14:44:22.956102+0000","last_fullsized":"2024-09-11T14:44:22.956102+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21823512,"num_objects":334,"num_object_clones":0,"num_object_copies":1002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":506,"num_write_kb":26817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"61'504","reported_seq":534,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T14:44:24.109364+0000","last_change":"2024-09-11T14:42:38.097894+0000","last_active":"2024-09-11T14:44:24.109364+0000","last_peered":"2024-09-11T14:44:24.109364+0000","last_clean":"2024-09-11T14:44:24.109364+0000","last_became_active":"2024-09-11T14:42:38.068084+0000","last_became_peered":"2024-09-11T14:42:38.068084+0000","last_unstale":"2024-09-11T14:44:24.109364+0000","last_undegraded":"2024-09-11T14:44:24.109364+0000","last_fullsized":"2024-09-11T14:44:24.109364+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20447232,"num_objects":312,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"60'444","reported_seq":471,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.200082+0000","last_change":"2024-09-11T14:42:38.084302+0000","last_active":"2024-09-11T14:44:23.200082+0000","last_peered":"2024-09-11T14:44:23.200082+0000","last_clean":"2024-09-11T14:44:23.200082+0000","last_became_active":"2024-09-11T14:42:38.060054+0000","last_became_peered":"2024-09-11T14:42:38.060054+0000","last_unstale":"2024-09-11T14:44:23.200082+0000","last_undegraded":"2024-09-11T14:44:23.200082+0000","last_fullsized":"2024-09-11T14:44:23.200082+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20578304,"num_objects":314,"num_object_clones":0,"num_object_copies":942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":444,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"60'473","reported_seq":500,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.208744+0000","last_change":"2024-09-11T14:42:38.114647+0000","last_active":"2024-09-11T14:44:23.208744+0000","last_peered":"2024-09-11T14:44:23.208744+0000","last_clean":"2024-09-11T14:44:23.208744+0000","last_became_active":"2024-09-11T14:42:38.075902+0000","last_became_peered":"2024-09-11T14:42:38.075902+0000","last_unstale":"2024-09-11T14:44:23.208744+0000","last_undegraded":"2024-09-11T14:44:23.208744+0000","last_fullsized":"2024-09-11T14:44:23.208744+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":473,"num_write_kb":24704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"60'451","reported_seq":478,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.198488+0000","last_change":"2024-09-11T14:42:38.105488+0000","last_active":"2024-09-11T14:44:23.198488+0000","last_peered":"2024-09-11T14:44:23.198488+0000","last_clean":"2024-09-11T14:44:23.198488+0000","last_became_active":"2024-09-11T14:42:38.071282+0000","last_became_peered":"2024-09-11T14:42:38.071282+0000","last_unstale":"2024-09-11T14:44:23.198488+0000","last_undegraded":"2024-09-11T14:44:23.198488+0000","last_fullsized":"2024-09-11T14:44:23.198488+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"60'455","reported_seq":482,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.415874+0000","last_change":"2024-09-11T14:42:38.122969+0000","last_active":"2024-09-11T14:44:23.415874+0000","last_peered":"2024-09-11T14:44:23.415874+0000","last_clean":"2024-09-11T14:44:23.415874+0000","last_became_active":"2024-09-11T14:42:38.109230+0000","last_became_peered":"2024-09-11T14:42:38.109230+0000","last_unstale":"2024-09-11T14:44:23.415874+0000","last_undegraded":"2024-09-11T14:44:23.415874+0000","last_fullsized":"2024-09-11T14:44:23.415874+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18415616,"num_objects":281,"num_object_clones":0,"num_object_copies":843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":23552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"60'485","reported_seq":512,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.203457+0000","last_change":"2024-09-11T14:42:38.222378+0000","last_active":"2024-09-11T14:44:23.203457+0000","last_peered":"2024-09-11T14:44:23.203457+0000","last_clean":"2024-09-11T14:44:23.203457+0000","last_became_active":"2024-09-11T14:42:38.204348+0000","last_became_peered":"2024-09-11T14:42:38.204348+0000","last_unstale":"2024-09-11T14:44:23.203457+0000","last_undegraded":"2024-09-11T14:44:23.203457+0000","last_fullsized":"2024-09-11T14:44:23.203457+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":25408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":223,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.954645+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:44:23.954645+0000","last_peered":"2024-09-11T14:44:23.954645+0000","last_clean":"2024-09-11T14:44:23.954645+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:44:23.954645+0000","last_undegraded":"2024-09-11T14:44:23.954645+0000","last_fullsized":"2024-09-11T14:44:23.954645+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":149,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:22.991718+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:44:22.991718+0000","last_peered":"2024-09-11T14:44:22.991718+0000","last_clean":"2024-09-11T14:44:22.991718+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:44:22.991718+0000","last_undegraded":"2024-09-11T14:44:22.991718+0000","last_fullsized":"2024-09-11T14:44:22.991718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"60'453","reported_seq":480,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.320767+0000","last_change":"2024-09-11T14:42:38.156444+0000","last_active":"2024-09-11T14:44:23.320767+0000","last_peered":"2024-09-11T14:44:23.320767+0000","last_clean":"2024-09-11T14:44:23.320767+0000","last_became_active":"2024-09-11T14:42:38.142793+0000","last_became_peered":"2024-09-11T14:42:38.142793+0000","last_unstale":"2024-09-11T14:44:23.320767+0000","last_undegraded":"2024-09-11T14:44:23.320767+0000","last_fullsized":"2024-09-11T14:44:23.320767+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18939904,"num_objects":289,"num_object_clones":0,"num_object_copies":867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":23744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:22.975303+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:44:22.975303+0000","last_peered":"2024-09-11T14:44:22.975303+0000","last_clean":"2024-09-11T14:44:22.975303+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:44:22.975303+0000","last_undegraded":"2024-09-11T14:44:22.975303+0000","last_fullsized":"2024-09-11T14:44:22.975303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"60'488","reported_seq":515,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.290110+0000","last_change":"2024-09-11T14:42:38.179244+0000","last_active":"2024-09-11T14:44:23.290110+0000","last_peered":"2024-09-11T14:44:23.290110+0000","last_clean":"2024-09-11T14:44:23.290110+0000","last_became_active":"2024-09-11T14:42:38.159043+0000","last_became_peered":"2024-09-11T14:42:38.159043+0000","last_unstale":"2024-09-11T14:44:23.290110+0000","last_undegraded":"2024-09-11T14:44:23.290110+0000","last_fullsized":"2024-09-11T14:44:23.290110+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":320,"num_object_clones":0,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:22.982069+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:44:22.982069+0000","last_peered":"2024-09-11T14:44:22.982069+0000","last_clean":"2024-09-11T14:44:22.982069+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:44:22.982069+0000","last_undegraded":"2024-09-11T14:44:22.982069+0000","last_fullsized":"2024-09-11T14:44:22.982069+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"59'470","reported_seq":497,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.008214+0000","last_change":"2024-09-11T14:42:38.098677+0000","last_active":"2024-09-11T14:44:23.008214+0000","last_peered":"2024-09-11T14:44:23.008214+0000","last_clean":"2024-09-11T14:44:23.008214+0000","last_became_active":"2024-09-11T14:42:38.060593+0000","last_became_peered":"2024-09-11T14:42:38.060593+0000","last_unstale":"2024-09-11T14:44:23.008214+0000","last_undegraded":"2024-09-11T14:44:23.008214+0000","last_fullsized":"2024-09-11T14:44:23.008214+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20447232,"num_objects":312,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":470,"num_write_kb":25024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":150,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:22.957727+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:44:22.957727+0000","last_peered":"2024-09-11T14:44:22.957727+0000","last_clean":"2024-09-11T14:44:22.957727+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:44:22.957727+0000","last_undegraded":"2024-09-11T14:44:22.957727+0000","last_fullsized":"2024-09-11T14:44:22.957727+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"60'483","reported_seq":510,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.009196+0000","last_change":"2024-09-11T14:42:38.108084+0000","last_active":"2024-09-11T14:44:23.009196+0000","last_peered":"2024-09-11T14:44:23.009196+0000","last_clean":"2024-09-11T14:44:23.009196+0000","last_became_active":"2024-09-11T14:42:38.044460+0000","last_became_peered":"2024-09-11T14:42:38.044460+0000","last_unstale":"2024-09-11T14:44:23.009196+0000","last_undegraded":"2024-09-11T14:44:23.009196+0000","last_fullsized":"2024-09-11T14:44:23.009196+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20774912,"num_objects":317,"num_object_clones":0,"num_object_copies":951,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":483,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.017209+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:44:23.017209+0000","last_peered":"2024-09-11T14:44:23.017209+0000","last_clean":"2024-09-11T14:44:23.017209+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:44:23.017209+0000","last_undegraded":"2024-09-11T14:44:23.017209+0000","last_fullsized":"2024-09-11T14:44:23.017209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"60'491","reported_seq":518,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.025433+0000","last_change":"2024-09-11T14:42:38.096488+0000","last_active":"2024-09-11T14:44:23.025433+0000","last_peered":"2024-09-11T14:44:23.025433+0000","last_clean":"2024-09-11T14:44:23.025433+0000","last_became_active":"2024-09-11T14:42:38.071104+0000","last_became_peered":"2024-09-11T14:42:38.071104+0000","last_unstale":"2024-09-11T14:44:23.025433+0000","last_undegraded":"2024-09-11T14:44:23.025433+0000","last_fullsized":"2024-09-11T14:44:23.025433+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":491,"num_write_kb":27008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.962966+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:44:23.962966+0000","last_peered":"2024-09-11T14:44:23.962966+0000","last_clean":"2024-09-11T14:44:23.962966+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:44:23.962966+0000","last_undegraded":"2024-09-11T14:44:23.962966+0000","last_fullsized":"2024-09-11T14:44:23.962966+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"61'484","reported_seq":514,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.962094+0000","last_change":"2024-09-11T14:42:38.132564+0000","last_active":"2024-09-11T14:44:23.962094+0000","last_peered":"2024-09-11T14:44:23.962094+0000","last_clean":"2024-09-11T14:44:23.962094+0000","last_became_active":"2024-09-11T14:42:38.112585+0000","last_became_peered":"2024-09-11T14:42:38.112585+0000","last_unstale":"2024-09-11T14:44:23.962094+0000","last_undegraded":"2024-09-11T14:44:23.962094+0000","last_fullsized":"2024-09-11T14:44:23.962094+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19398656,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":484,"num_write_kb":24960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.007041+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:44:23.007041+0000","last_peered":"2024-09-11T14:44:23.007041+0000","last_clean":"2024-09-11T14:44:23.007041+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:44:23.007041+0000","last_undegraded":"2024-09-11T14:44:23.007041+0000","last_fullsized":"2024-09-11T14:44:23.007041+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"60'489","reported_seq":516,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:23.081292+0000","last_change":"2024-09-11T14:42:38.233207+0000","last_active":"2024-09-11T14:44:23.081292+0000","last_peered":"2024-09-11T14:44:23.081292+0000","last_clean":"2024-09-11T14:44:23.081292+0000","last_became_active":"2024-09-11T14:42:38.225462+0000","last_became_peered":"2024-09-11T14:42:38.225462+0000","last_unstale":"2024-09-11T14:44:23.081292+0000","last_undegraded":"2024-09-11T14:44:23.081292+0000","last_fullsized":"2024-09-11T14:44:23.081292+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20774912,"num_objects":317,"num_object_clones":0,"num_object_copies":951,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-11T14:44:22.990542+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:44:22.990542+0000","last_peered":"2024-09-11T14:44:22.990542+0000","last_clean":"2024-09-11T14:44:22.990542+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:44:22.990542+0000","last_undegraded":"2024-09-11T14:44:22.990542+0000","last_fullsized":"2024-09-11T14:44:22.990542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":327417880,"num_objects":4997,"num_object_clones":0,"num_object_copies":14991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7655,"num_write_kb":404801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212215984128,"internally_reserved":0,"allocated":1995509760,"data_stored":1995509760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7655,"ondisk_log_size":7655,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212215721984,"internally_reserved":0,"allocated":1995771904,"data_stored":1995771904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53092900864,"internally_reserved":0,"allocated":459972608,"data_stored":459972608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":454256,"kb_used_data":454256,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51843472,"statfs":{"total":53552873472,"available":53087715328,"internally_reserved":0,"allocated":465158144,"data_stored":465158144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":568184,"kb_used_data":568184,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51729544,"statfs":{"total":53552873472,"available":52971053056,"internally_reserved":0,"allocated":581820416,"data_stored":581820416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":531952,"kb_used_data":531952,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51765776,"statfs":{"total":53552873472,"available":53008154624,"internally_reserved":0,"allocated":544718848,"data_stored":544718848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":409008,"kb_used_data":409008,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51888720,"statfs":{"total":53552873472,"available":53134049280,"internally_reserved":0,"allocated":418824192,"data_stored":418824192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53092900864,"internally_reserved":0,"allocated":459972608,"data_stored":459972608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53011042304,"internally_reserved":0,"allocated":541831168,"data_stored":541831168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53138104320,"internally_reserved":0,"allocated":414769152,"data_stored":414769152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52973674496,"internally_reserved":0,"allocated":579198976,"data_stored":579198976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53092900864,"internally_reserved":0,"allocated":459972608,"data_stored":459972608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53011173376,"internally_reserved":0,"allocated":541700096,"data_stored":541700096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53138104320,"internally_reserved":0,"allocated":414769152,"data_stored":414769152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":52973674496,"internally_reserved":0,"allocated":579198976,"data_stored":579198976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53093031936,"internally_reserved":0,"allocated":459841536,"data_stored":459841536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:44:26.891 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T14:44:26.891 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:44:26.891 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:44:26.891 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:44:26.953 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:44:27.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:27.069+0000 7fae1f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:27.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:27.086+0000 7fae1f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:27.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:27.120+0000 7f982c148640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:27.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:27.130+0000 7f982c148640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:27.212 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:27.212 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:27.212 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:27.213 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:27.213 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:27.213 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:27.213 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:27.213 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:27.213 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:27.213 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:27.213 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:27.213 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:27.216 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:27.216 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:27.217 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:44:27.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:27.361+0000 7f6236991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:27.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:27.374+0000 7f6236991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:27.538 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:27.539 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:27.539 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:27.539 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:27.539 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:27.539 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:27.539 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:27.539 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:27.539 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:27.539 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:27.539 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:27.539 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:27.542 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:27.542 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:27.543 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:44:27.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:27.676+0000 7f6bc8e93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:27.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:27.689+0000 7f6bc8e93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:27.715 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:27.715 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:27.715 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:27.715 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:27.715 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:27.716 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:27.716 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:27.716 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:27.716 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:27.716 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:27.716 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:27.716 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:27.719 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:27.719 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:27.720 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:44:27.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:27.844+0000 7f5003151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:27.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:27.856+0000 7f5003151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:27.877 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:27.877 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:27.877 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:27.878 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:27.878 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:27.878 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:27.878 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:27.878 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:27.878 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:27.878 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:27.878 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:27.878 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:27.880 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:27.881 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:29.460 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:44:29.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:29.584+0000 7f43b7311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:29.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:29.591+0000 7f43b7311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:31.851 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:44:31.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:31.994+0000 7f7e05591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:32.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:32.002+0000 7f7e05591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:32.885 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:44:32.885 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:44:32.885 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:44:32.886 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:44:33.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:33.018+0000 7f3fb6151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:33.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:33.030+0000 7f3fb6151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:33.168 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:33.168 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:33.168 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:33.168 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:33.168 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:33.168 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:33.168 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:33.168 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:33.169 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:33.169 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:33.169 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:33.169 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:33.172 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:33.173 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:33.173 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:44:33.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:33.304+0000 7f802af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:33.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:33.315+0000 7f802af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:33.394 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:33.394 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:33.394 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:33.394 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:33.394 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:33.394 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:33.394 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:33.395 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:33.395 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:33.395 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:33.395 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:33.395 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:33.397 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:33.397 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:33.398 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:44:33.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:33.525+0000 7fe77e497640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:33.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:33.542+0000 7fe77e497640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:33.585 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:33.585 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:33.585 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:33.585 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:33.585 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:33.585 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:33.586 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:33.586 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:33.586 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:33.586 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:33.586 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:33.586 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:33.586 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:33.587 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:33.587 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:44:33.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:33.714+0000 7fef578bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:33.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:33.725+0000 7fef578bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:33.745 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:33.745 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:33.745 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:33.745 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:33.745 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:33.745 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:33.745 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:33.745 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:33.745 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:33.745 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:33.746 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:33.746 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:33.748 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:33.748 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:34.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:44:34.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:34.558+0000 7f6ede888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:34.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:34.566+0000 7f6ede888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:36.838 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:44:36.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:36.985+0000 7f724a951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:36.992+0000 7f724a951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:38.749 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:44:38.750 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:44:38.750 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:44:38.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:38.880+0000 7f54d4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:38.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:38.892+0000 7f54d4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:39.177 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:44:39.177 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:44:39.198 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-09-11T14:44:37.330522+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":271450699,"num_objects":4138,"num_object_clones":0,"num_object_copies":12414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":8599,"num_write_kb":405909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8573,"ondisk_log_size":8573,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1631760,"kb_used_data":1631760,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207559152,"statfs":{"total":214211493888,"available":212540571648,"internally_reserved":0,"allocated":1670922240,"data_stored":1670922240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-56557568,"num_objects":-863,"num_object_clones":0,"num_object_copies":-2589,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":863,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.416490"},"pg_stats":[{"pgid":"5.f","version":"63'530","reported_seq":566,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:31.834866+0000","last_change":"2024-09-11T14:42:38.114713+0000","last_active":"2024-09-11T14:44:31.834866+0000","last_peered":"2024-09-11T14:44:31.834866+0000","last_clean":"2024-09-11T14:44:31.834866+0000","last_became_active":"2024-09-11T14:42:38.099767+0000","last_became_peered":"2024-09-11T14:42:38.099767+0000","last_unstale":"2024-09-11T14:44:31.834866+0000","last_undegraded":"2024-09-11T14:44:31.834866+0000","last_fullsized":"2024-09-11T14:44:31.834866+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16646144,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":530,"num_write_kb":25088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"63'566","reported_seq":602,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:33.436027+0000","last_change":"2024-09-11T14:42:38.177741+0000","last_active":"2024-09-11T14:44:33.436027+0000","last_peered":"2024-09-11T14:44:33.436027+0000","last_clean":"2024-09-11T14:44:33.436027+0000","last_became_active":"2024-09-11T14:42:38.170462+0000","last_became_peered":"2024-09-11T14:42:38.170462+0000","last_unstale":"2024-09-11T14:44:33.436027+0000","last_undegraded":"2024-09-11T14:44:33.436027+0000","last_fullsized":"2024-09-11T14:44:33.436027+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18087936,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":566,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"63'559","reported_seq":596,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:33.130128+0000","last_change":"2024-09-11T14:42:38.204931+0000","last_active":"2024-09-11T14:44:33.130128+0000","last_peered":"2024-09-11T14:44:33.130128+0000","last_clean":"2024-09-11T14:44:33.130128+0000","last_became_active":"2024-09-11T14:42:38.189110+0000","last_became_peered":"2024-09-11T14:42:38.189110+0000","last_unstale":"2024-09-11T14:44:33.130128+0000","last_undegraded":"2024-09-11T14:44:33.130128+0000","last_fullsized":"2024-09-11T14:44:33.130128+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18350104,"num_objects":281,"num_object_clones":0,"num_object_copies":843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":559,"num_write_kb":26817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"63'555","reported_seq":591,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:33.612297+0000","last_change":"2024-09-11T14:42:38.097894+0000","last_active":"2024-09-11T14:44:33.612297+0000","last_peered":"2024-09-11T14:44:33.612297+0000","last_clean":"2024-09-11T14:44:33.612297+0000","last_became_active":"2024-09-11T14:42:38.068084+0000","last_became_peered":"2024-09-11T14:42:38.068084+0000","last_unstale":"2024-09-11T14:44:33.612297+0000","last_undegraded":"2024-09-11T14:44:33.612297+0000","last_fullsized":"2024-09-11T14:44:33.612297+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104896,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"63'502","reported_seq":538,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:33.039924+0000","last_change":"2024-09-11T14:42:38.084302+0000","last_active":"2024-09-11T14:44:33.039924+0000","last_peered":"2024-09-11T14:44:33.039924+0000","last_clean":"2024-09-11T14:44:33.039924+0000","last_became_active":"2024-09-11T14:42:38.060054+0000","last_became_peered":"2024-09-11T14:42:38.060054+0000","last_unstale":"2024-09-11T14:44:33.039924+0000","last_undegraded":"2024-09-11T14:44:33.039924+0000","last_fullsized":"2024-09-11T14:44:33.039924+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"63'527","reported_seq":563,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:33.097965+0000","last_change":"2024-09-11T14:42:38.114647+0000","last_active":"2024-09-11T14:44:33.097965+0000","last_peered":"2024-09-11T14:44:33.097965+0000","last_clean":"2024-09-11T14:44:33.097965+0000","last_became_active":"2024-09-11T14:42:38.075902+0000","last_became_peered":"2024-09-11T14:42:38.075902+0000","last_unstale":"2024-09-11T14:44:33.097965+0000","last_undegraded":"2024-09-11T14:44:33.097965+0000","last_fullsized":"2024-09-11T14:44:33.097965+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056320,"num_objects":245,"num_object_clones":0,"num_object_copies":735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":527,"num_write_kb":24704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"63'507","reported_seq":543,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:32.794170+0000","last_change":"2024-09-11T14:42:38.105488+0000","last_active":"2024-09-11T14:44:32.794170+0000","last_peered":"2024-09-11T14:44:32.794170+0000","last_clean":"2024-09-11T14:44:32.794170+0000","last_became_active":"2024-09-11T14:42:38.071282+0000","last_became_peered":"2024-09-11T14:42:38.071282+0000","last_unstale":"2024-09-11T14:44:32.794170+0000","last_undegraded":"2024-09-11T14:44:32.794170+0000","last_fullsized":"2024-09-11T14:44:32.794170+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15794176,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"63'508","reported_seq":544,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:32.942197+0000","last_change":"2024-09-11T14:42:38.122969+0000","last_active":"2024-09-11T14:44:32.942197+0000","last_peered":"2024-09-11T14:44:32.942197+0000","last_clean":"2024-09-11T14:44:32.942197+0000","last_became_active":"2024-09-11T14:42:38.109230+0000","last_became_peered":"2024-09-11T14:42:38.109230+0000","last_unstale":"2024-09-11T14:44:32.942197+0000","last_undegraded":"2024-09-11T14:44:32.942197+0000","last_fullsized":"2024-09-11T14:44:32.942197+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14942208,"num_objects":228,"num_object_clones":0,"num_object_copies":684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":23552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"63'540","reported_seq":576,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:33.129759+0000","last_change":"2024-09-11T14:42:38.222378+0000","last_active":"2024-09-11T14:44:33.129759+0000","last_peered":"2024-09-11T14:44:33.129759+0000","last_clean":"2024-09-11T14:44:33.129759+0000","last_became_active":"2024-09-11T14:42:38.204348+0000","last_became_peered":"2024-09-11T14:42:38.204348+0000","last_unstale":"2024-09-11T14:44:33.129759+0000","last_undegraded":"2024-09-11T14:44:33.129759+0000","last_fullsized":"2024-09-11T14:44:33.129759+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16646144,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":25408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":229,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.952940+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:44:25.952940+0000","last_peered":"2024-09-11T14:44:25.952940+0000","last_clean":"2024-09-11T14:44:25.952940+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:44:25.952940+0000","last_undegraded":"2024-09-11T14:44:25.952940+0000","last_fullsized":"2024-09-11T14:44:25.952940+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":158,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.961289+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:44:25.961289+0000","last_peered":"2024-09-11T14:44:25.961289+0000","last_clean":"2024-09-11T14:44:25.961289+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:44:25.961289+0000","last_undegraded":"2024-09-11T14:44:25.961289+0000","last_fullsized":"2024-09-11T14:44:25.961289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"63'503","reported_seq":539,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:33.133146+0000","last_change":"2024-09-11T14:42:38.156444+0000","last_active":"2024-09-11T14:44:33.133146+0000","last_peered":"2024-09-11T14:44:33.133146+0000","last_clean":"2024-09-11T14:44:33.133146+0000","last_became_active":"2024-09-11T14:42:38.142793+0000","last_became_peered":"2024-09-11T14:42:38.142793+0000","last_unstale":"2024-09-11T14:44:33.133146+0000","last_undegraded":"2024-09-11T14:44:33.133146+0000","last_fullsized":"2024-09-11T14:44:33.133146+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":23744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:26.015117+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:44:26.015117+0000","last_peered":"2024-09-11T14:44:26.015117+0000","last_clean":"2024-09-11T14:44:26.015117+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:44:26.015117+0000","last_undegraded":"2024-09-11T14:44:26.015117+0000","last_fullsized":"2024-09-11T14:44:26.015117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"63'539","reported_seq":575,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:33.054895+0000","last_change":"2024-09-11T14:42:38.179244+0000","last_active":"2024-09-11T14:44:33.054895+0000","last_peered":"2024-09-11T14:44:33.054895+0000","last_clean":"2024-09-11T14:44:33.054895+0000","last_became_active":"2024-09-11T14:42:38.159043+0000","last_became_peered":"2024-09-11T14:42:38.159043+0000","last_unstale":"2024-09-11T14:44:33.054895+0000","last_undegraded":"2024-09-11T14:44:33.054895+0000","last_fullsized":"2024-09-11T14:44:33.054895+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.956440+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:44:25.956440+0000","last_peered":"2024-09-11T14:44:25.956440+0000","last_clean":"2024-09-11T14:44:25.956440+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:44:25.956440+0000","last_undegraded":"2024-09-11T14:44:25.956440+0000","last_fullsized":"2024-09-11T14:44:25.956440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"63'515","reported_seq":551,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:33.153636+0000","last_change":"2024-09-11T14:42:38.098677+0000","last_active":"2024-09-11T14:44:33.153636+0000","last_peered":"2024-09-11T14:44:33.153636+0000","last_clean":"2024-09-11T14:44:33.153636+0000","last_became_active":"2024-09-11T14:42:38.060593+0000","last_became_peered":"2024-09-11T14:42:38.060593+0000","last_unstale":"2024-09-11T14:44:33.153636+0000","last_undegraded":"2024-09-11T14:44:33.153636+0000","last_fullsized":"2024-09-11T14:44:33.153636+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17498112,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":25024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":159,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:26.007609+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:44:26.007609+0000","last_peered":"2024-09-11T14:44:26.007609+0000","last_clean":"2024-09-11T14:44:26.007609+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:44:26.007609+0000","last_undegraded":"2024-09-11T14:44:26.007609+0000","last_fullsized":"2024-09-11T14:44:26.007609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"63'538","reported_seq":574,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:32.949363+0000","last_change":"2024-09-11T14:42:38.108084+0000","last_active":"2024-09-11T14:44:32.949363+0000","last_peered":"2024-09-11T14:44:32.949363+0000","last_clean":"2024-09-11T14:44:32.949363+0000","last_became_active":"2024-09-11T14:42:38.044460+0000","last_became_peered":"2024-09-11T14:42:38.044460+0000","last_unstale":"2024-09-11T14:44:32.949363+0000","last_undegraded":"2024-09-11T14:44:32.949363+0000","last_fullsized":"2024-09-11T14:44:32.949363+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17170432,"num_objects":262,"num_object_clones":0,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:26.008718+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:44:26.008718+0000","last_peered":"2024-09-11T14:44:26.008718+0000","last_clean":"2024-09-11T14:44:26.008718+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:44:26.008718+0000","last_undegraded":"2024-09-11T14:44:26.008718+0000","last_fullsized":"2024-09-11T14:44:26.008718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"63'558","reported_seq":594,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:33.344506+0000","last_change":"2024-09-11T14:42:38.096488+0000","last_active":"2024-09-11T14:44:33.344506+0000","last_peered":"2024-09-11T14:44:33.344506+0000","last_clean":"2024-09-11T14:44:33.344506+0000","last_became_active":"2024-09-11T14:42:38.071104+0000","last_became_peered":"2024-09-11T14:42:38.071104+0000","last_unstale":"2024-09-11T14:44:33.344506+0000","last_undegraded":"2024-09-11T14:44:33.344506+0000","last_fullsized":"2024-09-11T14:44:33.344506+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18743296,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":558,"num_write_kb":27008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.958911+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:44:25.958911+0000","last_peered":"2024-09-11T14:44:25.958911+0000","last_clean":"2024-09-11T14:44:25.958911+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:44:25.958911+0000","last_undegraded":"2024-09-11T14:44:25.958911+0000","last_fullsized":"2024-09-11T14:44:25.958911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"63'535","reported_seq":571,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:34.012986+0000","last_change":"2024-09-11T14:42:38.132564+0000","last_active":"2024-09-11T14:44:34.012986+0000","last_peered":"2024-09-11T14:44:34.012986+0000","last_clean":"2024-09-11T14:44:34.012986+0000","last_became_active":"2024-09-11T14:42:38.112585+0000","last_became_peered":"2024-09-11T14:42:38.112585+0000","last_unstale":"2024-09-11T14:44:34.012986+0000","last_undegraded":"2024-09-11T14:44:34.012986+0000","last_fullsized":"2024-09-11T14:44:34.012986+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056320,"num_objects":245,"num_object_clones":0,"num_object_copies":735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":24960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.998918+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:44:25.998918+0000","last_peered":"2024-09-11T14:44:25.998918+0000","last_clean":"2024-09-11T14:44:25.998918+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:44:25.998918+0000","last_undegraded":"2024-09-11T14:44:25.998918+0000","last_fullsized":"2024-09-11T14:44:25.998918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"63'536","reported_seq":572,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:32.694238+0000","last_change":"2024-09-11T14:42:38.233207+0000","last_active":"2024-09-11T14:44:32.694238+0000","last_peered":"2024-09-11T14:44:32.694238+0000","last_clean":"2024-09-11T14:44:32.694238+0000","last_became_active":"2024-09-11T14:42:38.225462+0000","last_became_peered":"2024-09-11T14:42:38.225462+0000","last_unstale":"2024-09-11T14:44:32.694238+0000","last_undegraded":"2024-09-11T14:44:32.694238+0000","last_fullsized":"2024-09-11T14:44:32.694238+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.961911+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:44:25.961911+0000","last_peered":"2024-09-11T14:44:25.961911+0000","last_clean":"2024-09-11T14:44:25.961911+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:44:25.961911+0000","last_undegraded":"2024-09-11T14:44:25.961911+0000","last_fullsized":"2024-09-11T14:44:25.961911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":270860312,"num_objects":4134,"num_object_clones":0,"num_object_copies":12402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8518,"num_write_kb":404801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212552491008,"internally_reserved":0,"allocated":1659002880,"data_stored":1659002880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8518,"ondisk_log_size":8518,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212552359936,"internally_reserved":0,"allocated":1659133952,"data_stored":1659133952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53169528832,"internally_reserved":0,"allocated":383344640,"data_stored":383344640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":377952,"kb_used_data":377952,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51919776,"statfs":{"total":53552873472,"available":53165850624,"internally_reserved":0,"allocated":387022848,"data_stored":387022848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":472820,"kb_used_data":472820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51824908,"statfs":{"total":53552873472,"available":53068705792,"internally_reserved":0,"allocated":484167680,"data_stored":484167680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":440876,"kb_used_data":440876,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51856852,"statfs":{"total":53552873472,"available":53101416448,"internally_reserved":0,"allocated":451457024,"data_stored":451457024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":340112,"kb_used_data":340112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51957616,"statfs":{"total":53552873472,"available":53204598784,"internally_reserved":0,"allocated":348274688,"data_stored":348274688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53169528832,"internally_reserved":0,"allocated":383344640,"data_stored":383344640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53103603712,"internally_reserved":0,"allocated":449269760,"data_stored":449269760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53208670208,"internally_reserved":0,"allocated":344203264,"data_stored":344203264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53070557184,"internally_reserved":0,"allocated":482316288,"data_stored":482316288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53169528832,"internally_reserved":0,"allocated":383344640,"data_stored":383344640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53103734784,"internally_reserved":0,"allocated":449138688,"data_stored":449138688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53208670208,"internally_reserved":0,"allocated":344203264,"data_stored":344203264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53070557184,"internally_reserved":0,"allocated":482316288,"data_stored":482316288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53169528832,"internally_reserved":0,"allocated":383344640,"data_stored":383344640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:44:39.486 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:44:39.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:39.628+0000 7efe50151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:39.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:39.636+0000 7efe50151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:42.309 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:44:42.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:42.439+0000 7fbd4b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:42.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:42.446+0000 7fbd4b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:44.200 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:44:44.201 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:44:44.201 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:44:44.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:44.357+0000 7f6f95311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:44.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:44.366+0000 7f6f95311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:44.745 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:44:44.746 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:44:44.769 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-09-11T14:44:43.331975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":244515403,"num_objects":3727,"num_object_clones":0,"num_object_copies":11181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":9010,"num_write_kb":405909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8984,"ondisk_log_size":8984,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1473060,"kb_used_data":1473060,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207717852,"statfs":{"total":214211493888,"available":212703080448,"internally_reserved":0,"allocated":1508413440,"data_stored":1508413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-54329344,"num_objects":-829,"num_object_clones":0,"num_object_copies":-2487,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":829,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002714"},"pg_stats":[{"pgid":"5.f","version":"63'565","reported_seq":601,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:38.345084+0000","last_change":"2024-09-11T14:42:38.114713+0000","last_active":"2024-09-11T14:44:38.345084+0000","last_peered":"2024-09-11T14:44:38.345084+0000","last_clean":"2024-09-11T14:44:38.345084+0000","last_became_active":"2024-09-11T14:42:38.099767+0000","last_became_peered":"2024-09-11T14:42:38.099767+0000","last_unstale":"2024-09-11T14:44:38.345084+0000","last_undegraded":"2024-09-11T14:44:38.345084+0000","last_fullsized":"2024-09-11T14:44:38.345084+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14352384,"num_objects":219,"num_object_clones":0,"num_object_copies":657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":565,"num_write_kb":25088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"63'599","reported_seq":635,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:38.290700+0000","last_change":"2024-09-11T14:42:38.177741+0000","last_active":"2024-09-11T14:44:38.290700+0000","last_peered":"2024-09-11T14:44:38.290700+0000","last_clean":"2024-09-11T14:44:38.290700+0000","last_became_active":"2024-09-11T14:42:38.170462+0000","last_became_peered":"2024-09-11T14:42:38.170462+0000","last_unstale":"2024-09-11T14:44:38.290700+0000","last_undegraded":"2024-09-11T14:44:38.290700+0000","last_fullsized":"2024-09-11T14:44:38.290700+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925248,"num_objects":243,"num_object_clones":0,"num_object_copies":729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":599,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"63'584","reported_seq":621,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:38.243053+0000","last_change":"2024-09-11T14:42:38.204931+0000","last_active":"2024-09-11T14:44:38.243053+0000","last_peered":"2024-09-11T14:44:38.243053+0000","last_clean":"2024-09-11T14:44:38.243053+0000","last_became_active":"2024-09-11T14:42:38.189110+0000","last_became_peered":"2024-09-11T14:42:38.189110+0000","last_unstale":"2024-09-11T14:44:38.243053+0000","last_undegraded":"2024-09-11T14:44:38.243053+0000","last_fullsized":"2024-09-11T14:44:38.243053+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16711704,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":584,"num_write_kb":26817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"63'583","reported_seq":619,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:38.992630+0000","last_change":"2024-09-11T14:42:38.097894+0000","last_active":"2024-09-11T14:44:38.992630+0000","last_peered":"2024-09-11T14:44:38.992630+0000","last_clean":"2024-09-11T14:44:38.992630+0000","last_became_active":"2024-09-11T14:42:38.068084+0000","last_became_peered":"2024-09-11T14:42:38.068084+0000","last_unstale":"2024-09-11T14:44:38.992630+0000","last_undegraded":"2024-09-11T14:44:38.992630+0000","last_fullsized":"2024-09-11T14:44:38.992630+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15269888,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":583,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"63'527","reported_seq":563,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:37.933153+0000","last_change":"2024-09-11T14:42:38.084302+0000","last_active":"2024-09-11T14:44:37.933153+0000","last_peered":"2024-09-11T14:44:37.933153+0000","last_clean":"2024-09-11T14:44:37.933153+0000","last_became_active":"2024-09-11T14:42:38.060054+0000","last_became_peered":"2024-09-11T14:42:38.060054+0000","last_unstale":"2024-09-11T14:44:37.933153+0000","last_undegraded":"2024-09-11T14:44:37.933153+0000","last_fullsized":"2024-09-11T14:44:37.933153+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15138816,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":527,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"63'547","reported_seq":583,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:37.584171+0000","last_change":"2024-09-11T14:42:38.114647+0000","last_active":"2024-09-11T14:44:37.584171+0000","last_peered":"2024-09-11T14:44:37.584171+0000","last_clean":"2024-09-11T14:44:37.584171+0000","last_became_active":"2024-09-11T14:42:38.075902+0000","last_became_peered":"2024-09-11T14:42:38.075902+0000","last_unstale":"2024-09-11T14:44:37.584171+0000","last_undegraded":"2024-09-11T14:44:37.584171+0000","last_fullsized":"2024-09-11T14:44:37.584171+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":547,"num_write_kb":24704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"63'529","reported_seq":565,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:37.740220+0000","last_change":"2024-09-11T14:42:38.105488+0000","last_active":"2024-09-11T14:44:37.740220+0000","last_peered":"2024-09-11T14:44:37.740220+0000","last_clean":"2024-09-11T14:44:37.740220+0000","last_became_active":"2024-09-11T14:42:38.071282+0000","last_became_peered":"2024-09-11T14:42:38.071282+0000","last_unstale":"2024-09-11T14:44:37.740220+0000","last_undegraded":"2024-09-11T14:44:37.740220+0000","last_fullsized":"2024-09-11T14:44:37.740220+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14352384,"num_objects":219,"num_object_clones":0,"num_object_copies":657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"63'539","reported_seq":575,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:38.111508+0000","last_change":"2024-09-11T14:42:38.122969+0000","last_active":"2024-09-11T14:44:38.111508+0000","last_peered":"2024-09-11T14:44:38.111508+0000","last_clean":"2024-09-11T14:44:38.111508+0000","last_became_active":"2024-09-11T14:42:38.109230+0000","last_became_peered":"2024-09-11T14:42:38.109230+0000","last_unstale":"2024-09-11T14:44:38.111508+0000","last_undegraded":"2024-09-11T14:44:38.111508+0000","last_fullsized":"2024-09-11T14:44:38.111508+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12910592,"num_objects":197,"num_object_clones":0,"num_object_copies":591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":23552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"63'563","reported_seq":599,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:37.907913+0000","last_change":"2024-09-11T14:42:38.222378+0000","last_active":"2024-09-11T14:44:37.907913+0000","last_peered":"2024-09-11T14:44:37.907913+0000","last_clean":"2024-09-11T14:44:37.907913+0000","last_became_active":"2024-09-11T14:42:38.204348+0000","last_became_peered":"2024-09-11T14:42:38.204348+0000","last_unstale":"2024-09-11T14:44:37.907913+0000","last_undegraded":"2024-09-11T14:44:37.907913+0000","last_fullsized":"2024-09-11T14:44:37.907913+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15138816,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":563,"num_write_kb":25408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":229,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.952940+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:44:25.952940+0000","last_peered":"2024-09-11T14:44:25.952940+0000","last_clean":"2024-09-11T14:44:25.952940+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:44:25.952940+0000","last_undegraded":"2024-09-11T14:44:25.952940+0000","last_fullsized":"2024-09-11T14:44:25.952940+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":158,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.961289+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:44:25.961289+0000","last_peered":"2024-09-11T14:44:25.961289+0000","last_clean":"2024-09-11T14:44:25.961289+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:44:25.961289+0000","last_undegraded":"2024-09-11T14:44:25.961289+0000","last_fullsized":"2024-09-11T14:44:25.961289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"63'524","reported_seq":560,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:38.153177+0000","last_change":"2024-09-11T14:42:38.156444+0000","last_active":"2024-09-11T14:44:38.153177+0000","last_peered":"2024-09-11T14:44:38.153177+0000","last_clean":"2024-09-11T14:44:38.153177+0000","last_became_active":"2024-09-11T14:42:38.142793+0000","last_became_peered":"2024-09-11T14:42:38.142793+0000","last_unstale":"2024-09-11T14:44:38.153177+0000","last_undegraded":"2024-09-11T14:44:38.153177+0000","last_fullsized":"2024-09-11T14:44:38.153177+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14286848,"num_objects":218,"num_object_clones":0,"num_object_copies":654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":524,"num_write_kb":23744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:26.015117+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:44:26.015117+0000","last_peered":"2024-09-11T14:44:26.015117+0000","last_clean":"2024-09-11T14:44:26.015117+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:44:26.015117+0000","last_undegraded":"2024-09-11T14:44:26.015117+0000","last_fullsized":"2024-09-11T14:44:26.015117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"63'561","reported_seq":597,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:37.407412+0000","last_change":"2024-09-11T14:42:38.179244+0000","last_active":"2024-09-11T14:44:37.407412+0000","last_peered":"2024-09-11T14:44:37.407412+0000","last_clean":"2024-09-11T14:44:37.407412+0000","last_became_active":"2024-09-11T14:42:38.159043+0000","last_became_peered":"2024-09-11T14:42:38.159043+0000","last_unstale":"2024-09-11T14:44:37.407412+0000","last_undegraded":"2024-09-11T14:44:37.407412+0000","last_fullsized":"2024-09-11T14:44:37.407412+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16187392,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":561,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.956440+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:44:25.956440+0000","last_peered":"2024-09-11T14:44:25.956440+0000","last_clean":"2024-09-11T14:44:25.956440+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:44:25.956440+0000","last_undegraded":"2024-09-11T14:44:25.956440+0000","last_fullsized":"2024-09-11T14:44:25.956440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"63'538","reported_seq":574,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:38.003344+0000","last_change":"2024-09-11T14:42:38.098677+0000","last_active":"2024-09-11T14:44:38.003344+0000","last_peered":"2024-09-11T14:44:38.003344+0000","last_clean":"2024-09-11T14:44:38.003344+0000","last_became_active":"2024-09-11T14:42:38.060593+0000","last_became_peered":"2024-09-11T14:42:38.060593+0000","last_unstale":"2024-09-11T14:44:38.003344+0000","last_undegraded":"2024-09-11T14:44:38.003344+0000","last_fullsized":"2024-09-11T14:44:38.003344+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15990784,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":25024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":159,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:26.007609+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:44:26.007609+0000","last_peered":"2024-09-11T14:44:26.007609+0000","last_clean":"2024-09-11T14:44:26.007609+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:44:26.007609+0000","last_undegraded":"2024-09-11T14:44:26.007609+0000","last_fullsized":"2024-09-11T14:44:26.007609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"63'554","reported_seq":590,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:38.141736+0000","last_change":"2024-09-11T14:42:38.108084+0000","last_active":"2024-09-11T14:44:38.141736+0000","last_peered":"2024-09-11T14:44:38.141736+0000","last_clean":"2024-09-11T14:44:38.141736+0000","last_became_active":"2024-09-11T14:42:38.044460+0000","last_became_peered":"2024-09-11T14:42:38.044460+0000","last_unstale":"2024-09-11T14:44:38.141736+0000","last_undegraded":"2024-09-11T14:44:38.141736+0000","last_fullsized":"2024-09-11T14:44:38.141736+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16121856,"num_objects":246,"num_object_clones":0,"num_object_copies":738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":554,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:26.008718+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:44:26.008718+0000","last_peered":"2024-09-11T14:44:26.008718+0000","last_clean":"2024-09-11T14:44:26.008718+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:44:26.008718+0000","last_undegraded":"2024-09-11T14:44:26.008718+0000","last_fullsized":"2024-09-11T14:44:26.008718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"63'589","reported_seq":625,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:38.259103+0000","last_change":"2024-09-11T14:42:38.096488+0000","last_active":"2024-09-11T14:44:38.259103+0000","last_peered":"2024-09-11T14:44:38.259103+0000","last_clean":"2024-09-11T14:44:38.259103+0000","last_became_active":"2024-09-11T14:42:38.071104+0000","last_became_peered":"2024-09-11T14:42:38.071104+0000","last_unstale":"2024-09-11T14:44:38.259103+0000","last_undegraded":"2024-09-11T14:44:38.259103+0000","last_fullsized":"2024-09-11T14:44:38.259103+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16711680,"num_objects":255,"num_object_clones":0,"num_object_copies":765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":589,"num_write_kb":27008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.958911+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:44:25.958911+0000","last_peered":"2024-09-11T14:44:25.958911+0000","last_clean":"2024-09-11T14:44:25.958911+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:44:25.958911+0000","last_undegraded":"2024-09-11T14:44:25.958911+0000","last_fullsized":"2024-09-11T14:44:25.958911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"63'562","reported_seq":598,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:39.182289+0000","last_change":"2024-09-11T14:42:38.132564+0000","last_active":"2024-09-11T14:44:39.182289+0000","last_peered":"2024-09-11T14:44:39.182289+0000","last_clean":"2024-09-11T14:44:39.182289+0000","last_became_active":"2024-09-11T14:42:38.112585+0000","last_became_peered":"2024-09-11T14:42:38.112585+0000","last_unstale":"2024-09-11T14:44:39.182289+0000","last_undegraded":"2024-09-11T14:44:39.182289+0000","last_fullsized":"2024-09-11T14:44:39.182289+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14286848,"num_objects":218,"num_object_clones":0,"num_object_copies":654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":24960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.998918+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:44:25.998918+0000","last_peered":"2024-09-11T14:44:25.998918+0000","last_clean":"2024-09-11T14:44:25.998918+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:44:25.998918+0000","last_undegraded":"2024-09-11T14:44:25.998918+0000","last_fullsized":"2024-09-11T14:44:25.998918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"63'565","reported_seq":601,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:38.054033+0000","last_change":"2024-09-11T14:42:38.233207+0000","last_active":"2024-09-11T14:44:38.054033+0000","last_peered":"2024-09-11T14:44:38.054033+0000","last_clean":"2024-09-11T14:44:38.054033+0000","last_became_active":"2024-09-11T14:42:38.225462+0000","last_became_peered":"2024-09-11T14:42:38.225462+0000","last_unstale":"2024-09-11T14:44:38.054033+0000","last_undegraded":"2024-09-11T14:44:38.054033+0000","last_fullsized":"2024-09-11T14:44:38.054033+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15794176,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":565,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.961911+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:44:25.961911+0000","last_peered":"2024-09-11T14:44:25.961911+0000","last_clean":"2024-09-11T14:44:25.961911+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:44:25.961911+0000","last_undegraded":"2024-09-11T14:44:25.961911+0000","last_fullsized":"2024-09-11T14:44:25.961911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":243925016,"num_objects":3723,"num_object_clones":0,"num_object_copies":11169,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8929,"num_write_kb":404801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212716920832,"internally_reserved":0,"allocated":1494573056,"data_stored":1494573056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8929,"ondisk_log_size":8929,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212716920832,"internally_reserved":0,"allocated":1494573056,"data_stored":1494573056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53208518656,"internally_reserved":0,"allocated":344354816,"data_stored":344354816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":340672,"kb_used_data":340672,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51957056,"statfs":{"total":53552873472,"available":53204025344,"internally_reserved":0,"allocated":348848128,"data_stored":348848128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":428644,"kb_used_data":428644,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51869084,"statfs":{"total":53552873472,"available":53113942016,"internally_reserved":0,"allocated":438931456,"data_stored":438931456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":395644,"kb_used_data":395644,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51902084,"statfs":{"total":53552873472,"available":53147734016,"internally_reserved":0,"allocated":405139456,"data_stored":405139456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":308100,"kb_used_data":308100,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51989628,"statfs":{"total":53552873472,"available":53237379072,"internally_reserved":0,"allocated":315494400,"data_stored":315494400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53208518656,"internally_reserved":0,"allocated":344354816,"data_stored":344354816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53150502912,"internally_reserved":0,"allocated":402370560,"data_stored":402370560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53241184256,"internally_reserved":0,"allocated":311689216,"data_stored":311689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53116583936,"internally_reserved":0,"allocated":436289536,"data_stored":436289536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53208649728,"internally_reserved":0,"allocated":344223744,"data_stored":344223744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53150502912,"internally_reserved":0,"allocated":402370560,"data_stored":402370560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53241184256,"internally_reserved":0,"allocated":311689216,"data_stored":311689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53116583936,"internally_reserved":0,"allocated":436289536,"data_stored":436289536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53208649728,"internally_reserved":0,"allocated":344223744,"data_stored":344223744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:44:44.931 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:44:45.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:45.052+0000 7f5e6e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:45.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:45.059+0000 7f5e6e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:47.446 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:44:47.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:47.577+0000 7f9ae60fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:47.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:47.584+0000 7f9ae60fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:49.771 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:44:49.771 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:44:49.771 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:44:49.772 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:44:49.893 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:44:49.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:49.902+0000 7f314f474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:49.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:49.922+0000 7f314f474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:49.960 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:49.960 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:49.960 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:49.960 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:49.960 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:49.960 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:49.960 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:49.960 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:49.960 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:49.963 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:49.963 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:49.964 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:44:50.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:50.051+0000 7f32e5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:50.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:50.059+0000 7f32e5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:50.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:50.153+0000 7f8d27511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:50.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:50.164+0000 7f8d27511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:50.341 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:50.341 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:50.341 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:50.342 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:50.342 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:50.342 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:50.342 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:50.342 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:50.342 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:50.342 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:50.342 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:50.342 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:50.344 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:50.344 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:50.345 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:44:50.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:50.465+0000 7f55bd6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:50.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:50.476+0000 7f55bd6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:50.595 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:50.595 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:50.595 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:50.597 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:50.597 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:50.598 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:44:50.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:50.716+0000 7f6b67d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:50.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:50.727+0000 7f6b67d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:50.847 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:50.847 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:50.847 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:50.847 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:50.847 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:50.850 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:50.850 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:52.408 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:44:52.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:52.536+0000 7f4f1c511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:52.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:52.543+0000 7f4f1c511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:54.872 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:44:55.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:55.009+0000 7fcf37311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:55.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:55.015+0000 7fcf37311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:55.851 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:44:55.852 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:44:55.852 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:44:55.852 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:44:55.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:55.972+0000 7f151d111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:55.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:55.982+0000 7f151d111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:56.003 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:56.003 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:56.003 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:56.003 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:56.003 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:56.003 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:56.003 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:56.004 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:56.004 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:56.004 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:56.004 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:56.004 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:56.006 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:56.006 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:56.007 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:44:56.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:56.145+0000 7f4274511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:56.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:56.156+0000 7f4274511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:56.178 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:56.178 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:56.178 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:56.178 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:56.178 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:56.178 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:56.178 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:56.179 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:56.179 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:56.179 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:56.179 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:56.179 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:56.182 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:56.182 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:56.182 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:44:56.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:56.309+0000 7fc695351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:56.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:56.322+0000 7fc695351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:56.441 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:56.441 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:56.445 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:56.446 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:56.446 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:44:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:56.579+0000 7f0a09f48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:56.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:56.591+0000 7f0a09f48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:56.620 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:44:56.620 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:44:56.620 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:44:56.620 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:44:56.620 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:44:56.621 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:44:56.621 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:44:56.621 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:44:56.621 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:44:56.621 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:44:56.621 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:44:56.621 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:44:56.623 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:44:56.624 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:44:57.333 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:44:57.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:57.479+0000 7fb574d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:57.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:57.486+0000 7fb574d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:59.773 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:44:59.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:59.908+0000 7f4516d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:59.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:44:59.914+0000 7f4516d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:01.624 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:45:01.625 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:45:01.625 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:45:01.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:01.748+0000 7fa4ebf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:01.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:01.759+0000 7fa4ebf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:02.073 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:45:02.074 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:45:02.097 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":325,"stamp":"2024-09-11T14:45:01.335771+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":161677899,"num_objects":2463,"num_object_clones":0,"num_object_copies":7389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":10274,"num_write_kb":405909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10248,"ondisk_log_size":10248,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":983568,"kb_used_data":983568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208207344,"statfs":{"total":214211493888,"available":213204320256,"internally_reserved":0,"allocated":1007173632,"data_stored":1007173632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-41287680,"num_objects":-630,"num_object_clones":0,"num_object_copies":-1890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":630,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002460"},"pg_stats":[{"pgid":"5.f","version":"63'624","reported_seq":660,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:57.777315+0000","last_change":"2024-09-11T14:42:38.114713+0000","last_active":"2024-09-11T14:44:57.777315+0000","last_peered":"2024-09-11T14:44:57.777315+0000","last_clean":"2024-09-11T14:44:57.777315+0000","last_became_active":"2024-09-11T14:42:38.099767+0000","last_became_peered":"2024-09-11T14:42:38.099767+0000","last_unstale":"2024-09-11T14:44:57.777315+0000","last_undegraded":"2024-09-11T14:44:57.777315+0000","last_fullsized":"2024-09-11T14:44:57.777315+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":160,"num_object_clones":0,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":25088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"63'678","reported_seq":714,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:58.149309+0000","last_change":"2024-09-11T14:42:38.177741+0000","last_active":"2024-09-11T14:44:58.149309+0000","last_peered":"2024-09-11T14:44:58.149309+0000","last_clean":"2024-09-11T14:44:58.149309+0000","last_became_active":"2024-09-11T14:42:38.170462+0000","last_became_peered":"2024-09-11T14:42:38.170462+0000","last_unstale":"2024-09-11T14:44:58.149309+0000","last_undegraded":"2024-09-11T14:44:58.149309+0000","last_fullsized":"2024-09-11T14:44:58.149309+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747904,"num_objects":164,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":678,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"63'680","reported_seq":717,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:58.376838+0000","last_change":"2024-09-11T14:42:38.204931+0000","last_active":"2024-09-11T14:44:58.376838+0000","last_peered":"2024-09-11T14:44:58.376838+0000","last_clean":"2024-09-11T14:44:58.376838+0000","last_became_active":"2024-09-11T14:42:38.189110+0000","last_became_peered":"2024-09-11T14:42:38.189110+0000","last_unstale":"2024-09-11T14:44:58.376838+0000","last_undegraded":"2024-09-11T14:44:58.376838+0000","last_fullsized":"2024-09-11T14:44:58.376838+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420248,"num_objects":160,"num_object_clones":0,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":680,"num_write_kb":26817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"63'661","reported_seq":697,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:59.118246+0000","last_change":"2024-09-11T14:42:38.097894+0000","last_active":"2024-09-11T14:44:59.118246+0000","last_peered":"2024-09-11T14:44:59.118246+0000","last_clean":"2024-09-11T14:44:59.118246+0000","last_became_active":"2024-09-11T14:42:38.068084+0000","last_became_peered":"2024-09-11T14:42:38.068084+0000","last_unstale":"2024-09-11T14:44:59.118246+0000","last_undegraded":"2024-09-11T14:44:59.118246+0000","last_fullsized":"2024-09-11T14:44:59.118246+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"63'604","reported_seq":640,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:58.438247+0000","last_change":"2024-09-11T14:42:38.084302+0000","last_active":"2024-09-11T14:44:58.438247+0000","last_peered":"2024-09-11T14:44:58.438247+0000","last_clean":"2024-09-11T14:44:58.438247+0000","last_became_active":"2024-09-11T14:42:38.060054+0000","last_became_peered":"2024-09-11T14:42:38.060054+0000","last_unstale":"2024-09-11T14:44:58.438247+0000","last_undegraded":"2024-09-11T14:44:58.438247+0000","last_fullsized":"2024-09-11T14:44:58.438247+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":604,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"63'615","reported_seq":651,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:58.208056+0000","last_change":"2024-09-11T14:42:38.114647+0000","last_active":"2024-09-11T14:44:58.208056+0000","last_peered":"2024-09-11T14:44:58.208056+0000","last_clean":"2024-09-11T14:44:58.208056+0000","last_became_active":"2024-09-11T14:42:38.075902+0000","last_became_peered":"2024-09-11T14:42:38.075902+0000","last_unstale":"2024-09-11T14:44:58.208056+0000","last_undegraded":"2024-09-11T14:44:58.208056+0000","last_fullsized":"2024-09-11T14:44:58.208056+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":615,"num_write_kb":24704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"63'610","reported_seq":646,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:57.743523+0000","last_change":"2024-09-11T14:42:38.105488+0000","last_active":"2024-09-11T14:44:57.743523+0000","last_peered":"2024-09-11T14:44:57.743523+0000","last_clean":"2024-09-11T14:44:57.743523+0000","last_became_active":"2024-09-11T14:42:38.071282+0000","last_became_peered":"2024-09-11T14:42:38.071282+0000","last_unstale":"2024-09-11T14:44:57.743523+0000","last_undegraded":"2024-09-11T14:44:57.743523+0000","last_fullsized":"2024-09-11T14:44:57.743523+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":610,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"63'602","reported_seq":638,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:58.294029+0000","last_change":"2024-09-11T14:42:38.122969+0000","last_active":"2024-09-11T14:44:58.294029+0000","last_peered":"2024-09-11T14:44:58.294029+0000","last_clean":"2024-09-11T14:44:58.294029+0000","last_became_active":"2024-09-11T14:42:38.109230+0000","last_became_peered":"2024-09-11T14:42:38.109230+0000","last_unstale":"2024-09-11T14:44:58.294029+0000","last_undegraded":"2024-09-11T14:44:58.294029+0000","last_fullsized":"2024-09-11T14:44:58.294029+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":602,"num_write_kb":23552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"63'642","reported_seq":678,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:57.817804+0000","last_change":"2024-09-11T14:42:38.222378+0000","last_active":"2024-09-11T14:44:57.817804+0000","last_peered":"2024-09-11T14:44:57.817804+0000","last_clean":"2024-09-11T14:44:57.817804+0000","last_became_active":"2024-09-11T14:42:38.204348+0000","last_became_peered":"2024-09-11T14:42:38.204348+0000","last_unstale":"2024-09-11T14:44:57.817804+0000","last_undegraded":"2024-09-11T14:44:57.817804+0000","last_fullsized":"2024-09-11T14:44:57.817804+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":25408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":229,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.952940+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:44:25.952940+0000","last_peered":"2024-09-11T14:44:25.952940+0000","last_clean":"2024-09-11T14:44:25.952940+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:44:25.952940+0000","last_undegraded":"2024-09-11T14:44:25.952940+0000","last_fullsized":"2024-09-11T14:44:25.952940+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":158,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.961289+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:44:25.961289+0000","last_peered":"2024-09-11T14:44:25.961289+0000","last_clean":"2024-09-11T14:44:25.961289+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:44:25.961289+0000","last_undegraded":"2024-09-11T14:44:25.961289+0000","last_fullsized":"2024-09-11T14:44:25.961289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"63'602","reported_seq":638,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:57.996106+0000","last_change":"2024-09-11T14:42:38.156444+0000","last_active":"2024-09-11T14:44:57.996106+0000","last_peered":"2024-09-11T14:44:57.996106+0000","last_clean":"2024-09-11T14:44:57.996106+0000","last_became_active":"2024-09-11T14:42:38.142793+0000","last_became_peered":"2024-09-11T14:42:38.142793+0000","last_unstale":"2024-09-11T14:44:57.996106+0000","last_undegraded":"2024-09-11T14:44:57.996106+0000","last_fullsized":"2024-09-11T14:44:57.996106+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":602,"num_write_kb":23744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:26.015117+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:44:26.015117+0000","last_peered":"2024-09-11T14:44:26.015117+0000","last_clean":"2024-09-11T14:44:26.015117+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:44:26.015117+0000","last_undegraded":"2024-09-11T14:44:26.015117+0000","last_fullsized":"2024-09-11T14:44:26.015117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"63'647","reported_seq":683,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:58.251638+0000","last_change":"2024-09-11T14:42:38.179244+0000","last_active":"2024-09-11T14:44:58.251638+0000","last_peered":"2024-09-11T14:44:58.251638+0000","last_clean":"2024-09-11T14:44:58.251638+0000","last_became_active":"2024-09-11T14:42:38.159043+0000","last_became_peered":"2024-09-11T14:42:38.159043+0000","last_unstale":"2024-09-11T14:44:58.251638+0000","last_undegraded":"2024-09-11T14:44:58.251638+0000","last_fullsized":"2024-09-11T14:44:58.251638+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":647,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.956440+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:44:25.956440+0000","last_peered":"2024-09-11T14:44:25.956440+0000","last_clean":"2024-09-11T14:44:25.956440+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:44:25.956440+0000","last_undegraded":"2024-09-11T14:44:25.956440+0000","last_fullsized":"2024-09-11T14:44:25.956440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"63'630","reported_seq":666,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:56.611797+0000","last_change":"2024-09-11T14:42:38.098677+0000","last_active":"2024-09-11T14:44:56.611797+0000","last_peered":"2024-09-11T14:44:56.611797+0000","last_clean":"2024-09-11T14:44:56.611797+0000","last_became_active":"2024-09-11T14:42:38.060593+0000","last_became_peered":"2024-09-11T14:42:38.060593+0000","last_unstale":"2024-09-11T14:44:56.611797+0000","last_undegraded":"2024-09-11T14:44:56.611797+0000","last_fullsized":"2024-09-11T14:44:56.611797+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":630,"num_write_kb":25024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":159,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:26.007609+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:44:26.007609+0000","last_peered":"2024-09-11T14:44:26.007609+0000","last_clean":"2024-09-11T14:44:26.007609+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:44:26.007609+0000","last_undegraded":"2024-09-11T14:44:26.007609+0000","last_fullsized":"2024-09-11T14:44:26.007609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"63'644","reported_seq":680,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:58.136542+0000","last_change":"2024-09-11T14:42:38.108084+0000","last_active":"2024-09-11T14:44:58.136542+0000","last_peered":"2024-09-11T14:44:58.136542+0000","last_clean":"2024-09-11T14:44:58.136542+0000","last_became_active":"2024-09-11T14:42:38.044460+0000","last_became_peered":"2024-09-11T14:42:38.044460+0000","last_unstale":"2024-09-11T14:44:58.136542+0000","last_undegraded":"2024-09-11T14:44:58.136542+0000","last_fullsized":"2024-09-11T14:44:58.136542+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:26.008718+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:44:26.008718+0000","last_peered":"2024-09-11T14:44:26.008718+0000","last_clean":"2024-09-11T14:44:26.008718+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:44:26.008718+0000","last_undegraded":"2024-09-11T14:44:26.008718+0000","last_fullsized":"2024-09-11T14:44:26.008718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"63'658","reported_seq":694,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:57.310990+0000","last_change":"2024-09-11T14:42:38.096488+0000","last_active":"2024-09-11T14:44:57.310990+0000","last_peered":"2024-09-11T14:44:57.310990+0000","last_clean":"2024-09-11T14:44:57.310990+0000","last_became_active":"2024-09-11T14:42:38.071104+0000","last_became_peered":"2024-09-11T14:42:38.071104+0000","last_unstale":"2024-09-11T14:44:57.310990+0000","last_undegraded":"2024-09-11T14:44:57.310990+0000","last_fullsized":"2024-09-11T14:44:57.310990+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":658,"num_write_kb":27008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.958911+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:44:25.958911+0000","last_peered":"2024-09-11T14:44:25.958911+0000","last_clean":"2024-09-11T14:44:25.958911+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:44:25.958911+0000","last_undegraded":"2024-09-11T14:44:25.958911+0000","last_fullsized":"2024-09-11T14:44:25.958911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"63'656","reported_seq":692,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:59.017137+0000","last_change":"2024-09-11T14:42:38.132564+0000","last_active":"2024-09-11T14:44:59.017137+0000","last_peered":"2024-09-11T14:44:59.017137+0000","last_clean":"2024-09-11T14:44:59.017137+0000","last_became_active":"2024-09-11T14:42:38.112585+0000","last_became_peered":"2024-09-11T14:42:38.112585+0000","last_unstale":"2024-09-11T14:44:59.017137+0000","last_undegraded":"2024-09-11T14:44:59.017137+0000","last_fullsized":"2024-09-11T14:44:59.017137+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":24960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.998918+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:44:25.998918+0000","last_peered":"2024-09-11T14:44:25.998918+0000","last_clean":"2024-09-11T14:44:25.998918+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:44:25.998918+0000","last_undegraded":"2024-09-11T14:44:25.998918+0000","last_fullsized":"2024-09-11T14:44:25.998918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"63'640","reported_seq":676,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:57.706295+0000","last_change":"2024-09-11T14:42:38.233207+0000","last_active":"2024-09-11T14:44:57.706295+0000","last_peered":"2024-09-11T14:44:57.706295+0000","last_clean":"2024-09-11T14:44:57.706295+0000","last_became_active":"2024-09-11T14:42:38.225462+0000","last_became_peered":"2024-09-11T14:42:38.225462+0000","last_unstale":"2024-09-11T14:44:57.706295+0000","last_undegraded":"2024-09-11T14:44:57.706295+0000","last_fullsized":"2024-09-11T14:44:57.706295+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.961911+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:44:25.961911+0000","last_peered":"2024-09-11T14:44:25.961911+0000","last_clean":"2024-09-11T14:44:25.961911+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:44:25.961911+0000","last_undegraded":"2024-09-11T14:44:25.961911+0000","last_fullsized":"2024-09-11T14:44:25.961911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":161087512,"num_objects":2459,"num_object_clones":0,"num_object_copies":7377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10193,"num_write_kb":404801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213214306304,"internally_reserved":0,"allocated":997187584,"data_stored":997187584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10193,"ondisk_log_size":10193,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213214306304,"internally_reserved":0,"allocated":997187584,"data_stored":997187584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53323816960,"internally_reserved":0,"allocated":229056512,"data_stored":229056512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":227080,"kb_used_data":227080,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52070648,"statfs":{"total":53552873472,"available":53320343552,"internally_reserved":0,"allocated":232529920,"data_stored":232529920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706198,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":283524,"kb_used_data":283524,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52014204,"statfs":{"total":53552873472,"available":53262544896,"internally_reserved":0,"allocated":290328576,"data_stored":290328576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706198,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":266056,"kb_used_data":266056,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52031672,"statfs":{"total":53552873472,"available":53280432128,"internally_reserved":0,"allocated":272441344,"data_stored":272441344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706198,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":206908,"kb_used_data":206908,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52090820,"statfs":{"total":53552873472,"available":53340999680,"internally_reserved":0,"allocated":211873792,"data_stored":211873792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53323816960,"internally_reserved":0,"allocated":229056512,"data_stored":229056512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53282029568,"internally_reserved":0,"allocated":270843904,"data_stored":270843904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53343932416,"internally_reserved":0,"allocated":208941056,"data_stored":208941056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53264527360,"internally_reserved":0,"allocated":288346112,"data_stored":288346112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53323816960,"internally_reserved":0,"allocated":229056512,"data_stored":229056512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53282029568,"internally_reserved":0,"allocated":270843904,"data_stored":270843904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53343932416,"internally_reserved":0,"allocated":208941056,"data_stored":208941056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53264527360,"internally_reserved":0,"allocated":288346112,"data_stored":288346112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53323816960,"internally_reserved":0,"allocated":229056512,"data_stored":229056512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:45:02.121 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:45:02.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:02.261+0000 7f2e48591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:02.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:02.267+0000 7f2e48591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:04.526 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:45:04.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:04.668+0000 7f2f8d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:04.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:04.676+0000 7f2f8d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:06.971 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:45:07.099 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:45:07.099 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:45:07.099 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:45:07.100 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:45:07.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:07.109+0000 7f015924f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:07.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:07.117+0000 7f015924f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:07.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:07.242+0000 7f3b15191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:07.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:07.258+0000 7f3b15191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:07.298 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:07.298 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:07.298 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:07.298 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:07.298 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:07.298 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:07.298 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:07.298 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:07.298 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:07.298 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:07.298 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:07.299 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:07.301 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:07.301 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:07.302 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:45:07.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:07.472+0000 7f31aaea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:07.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:07.484+0000 7f31aaea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:07.517 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:07.518 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:07.518 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:07.518 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:07.518 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:07.518 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:07.518 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:07.519 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:07.519 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:07.519 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:07.519 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:07.519 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:07.521 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:07.521 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:07.522 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:45:07.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:07.719+0000 7f4f85ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:07.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:07.732+0000 7f4f85ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:07.837 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:07.837 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:07.837 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:07.837 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:07.837 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:07.837 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:07.837 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:07.837 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:07.838 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:07.838 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:07.838 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:07.838 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:07.842 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:07.842 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:07.842 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:45:07.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:07.985+0000 7fea6f711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:08.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:08.002+0000 7fea6f711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:08.023 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:08.024 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:08.024 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:08.024 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:08.024 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:08.024 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:08.024 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:08.024 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:08.024 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:08.024 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:08.024 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:08.024 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:08.027 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:08.027 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:09.477 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:45:09.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:09.617+0000 7f64200fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:09.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:09.625+0000 7f64200fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:12.080 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:45:12.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:12.218+0000 7f4effafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:12.233+0000 7f4effafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:13.028 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:45:13.028 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:45:13.028 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:45:13.028 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:45:13.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:13.160+0000 7f40b9191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:13.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:13.170+0000 7f40b9191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:13.194 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:13.195 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:13.195 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:45:13.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:13.332+0000 7fb26e2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:13.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:13.347+0000 7fb26e2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:13.372 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:13.372 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:13.372 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:13.372 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:13.373 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:13.373 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:13.373 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:13.373 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:13.373 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:13.373 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:13.373 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:13.373 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:13.377 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:13.377 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:13.377 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:45:13.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:13.516+0000 7f69c7791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:13.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:13.527+0000 7f69c7791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:13.656 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:13.657 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:13.657 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:13.657 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:13.657 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:13.657 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:13.658 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:13.658 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:13.658 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:13.658 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:13.658 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:13.658 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:13.661 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:13.662 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:13.662 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:45:13.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:13.801+0000 7fc41fb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:13.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:13.812+0000 7fc41fb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:13.834 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:13.834 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:13.835 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:13.835 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:13.835 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:13.835 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:13.835 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:13.836 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:13.836 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:13.836 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:13.836 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:13.836 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:13.839 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:13.839 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:14.518 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:45:14.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:14.643+0000 7f5f9ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:14.651+0000 7f5f9ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:16.900 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:45:17.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:17.032+0000 7f9540d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:17.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:17.039+0000 7f9540d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:18.840 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:45:18.840 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:45:18.841 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:45:18.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:18.970+0000 7f7164948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:18.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:18.984+0000 7f7164948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:19.327 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:45:19.328 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:45:19.343 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-11T14:45:17.338930+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":95814219,"num_objects":1458,"num_object_clones":0,"num_object_copies":4374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":11279,"num_write_kb":405909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11253,"ondisk_log_size":11253,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":598356,"kb_used_data":598356,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208592556,"statfs":{"total":214211493888,"available":213598777344,"internally_reserved":0,"allocated":612716544,"data_stored":612716544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-46006272,"num_objects":-702,"num_object_clones":0,"num_object_copies":-2106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":702,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002404"},"pg_stats":[{"pgid":"5.f","version":"63'684","reported_seq":720,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:45:13.281451+0000","last_change":"2024-09-11T14:42:38.114713+0000","last_active":"2024-09-11T14:45:13.281451+0000","last_peered":"2024-09-11T14:45:13.281451+0000","last_clean":"2024-09-11T14:45:13.281451+0000","last_became_active":"2024-09-11T14:42:38.099767+0000","last_became_peered":"2024-09-11T14:42:38.099767+0000","last_unstale":"2024-09-11T14:45:13.281451+0000","last_undegraded":"2024-09-11T14:45:13.281451+0000","last_fullsized":"2024-09-11T14:45:13.281451+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":684,"num_write_kb":25088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"63'740","reported_seq":776,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:45:12.908858+0000","last_change":"2024-09-11T14:42:38.177741+0000","last_active":"2024-09-11T14:45:12.908858+0000","last_peered":"2024-09-11T14:45:12.908858+0000","last_clean":"2024-09-11T14:45:12.908858+0000","last_became_active":"2024-09-11T14:42:38.170462+0000","last_became_peered":"2024-09-11T14:42:38.170462+0000","last_unstale":"2024-09-11T14:45:12.908858+0000","last_undegraded":"2024-09-11T14:45:12.908858+0000","last_fullsized":"2024-09-11T14:45:12.908858+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"63'741","reported_seq":778,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:45:13.442322+0000","last_change":"2024-09-11T14:42:38.204931+0000","last_active":"2024-09-11T14:45:13.442322+0000","last_peered":"2024-09-11T14:45:13.442322+0000","last_clean":"2024-09-11T14:45:13.442322+0000","last_became_active":"2024-09-11T14:42:38.189110+0000","last_became_peered":"2024-09-11T14:42:38.189110+0000","last_unstale":"2024-09-11T14:45:13.442322+0000","last_undegraded":"2024-09-11T14:45:13.442322+0000","last_fullsized":"2024-09-11T14:45:13.442322+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422552,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":741,"num_write_kb":26817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"63'739","reported_seq":775,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:45:14.138627+0000","last_change":"2024-09-11T14:42:38.097894+0000","last_active":"2024-09-11T14:45:14.138627+0000","last_peered":"2024-09-11T14:45:14.138627+0000","last_clean":"2024-09-11T14:45:14.138627+0000","last_became_active":"2024-09-11T14:42:38.068084+0000","last_became_peered":"2024-09-11T14:42:38.068084+0000","last_unstale":"2024-09-11T14:45:14.138627+0000","last_undegraded":"2024-09-11T14:45:14.138627+0000","last_fullsized":"2024-09-11T14:45:14.138627+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":739,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"63'675","reported_seq":711,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:45:13.226497+0000","last_change":"2024-09-11T14:42:38.084302+0000","last_active":"2024-09-11T14:45:13.226497+0000","last_peered":"2024-09-11T14:45:13.226497+0000","last_clean":"2024-09-11T14:45:13.226497+0000","last_became_active":"2024-09-11T14:42:38.060054+0000","last_became_peered":"2024-09-11T14:42:38.060054+0000","last_unstale":"2024-09-11T14:45:13.226497+0000","last_undegraded":"2024-09-11T14:45:13.226497+0000","last_fullsized":"2024-09-11T14:45:13.226497+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":675,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"63'684","reported_seq":720,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:45:12.729113+0000","last_change":"2024-09-11T14:42:38.114647+0000","last_active":"2024-09-11T14:45:12.729113+0000","last_peered":"2024-09-11T14:45:12.729113+0000","last_clean":"2024-09-11T14:45:12.729113+0000","last_became_active":"2024-09-11T14:42:38.075902+0000","last_became_peered":"2024-09-11T14:42:38.075902+0000","last_unstale":"2024-09-11T14:45:12.729113+0000","last_undegraded":"2024-09-11T14:45:12.729113+0000","last_fullsized":"2024-09-11T14:45:12.729113+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":684,"num_write_kb":24704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"63'662","reported_seq":698,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:45:13.273489+0000","last_change":"2024-09-11T14:42:38.105488+0000","last_active":"2024-09-11T14:45:13.273489+0000","last_peered":"2024-09-11T14:45:13.273489+0000","last_clean":"2024-09-11T14:45:13.273489+0000","last_became_active":"2024-09-11T14:42:38.071282+0000","last_became_peered":"2024-09-11T14:42:38.071282+0000","last_unstale":"2024-09-11T14:45:13.273489+0000","last_undegraded":"2024-09-11T14:45:13.273489+0000","last_fullsized":"2024-09-11T14:45:13.273489+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":662,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"63'664","reported_seq":700,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:45:13.097467+0000","last_change":"2024-09-11T14:42:38.122969+0000","last_active":"2024-09-11T14:45:13.097467+0000","last_peered":"2024-09-11T14:45:13.097467+0000","last_clean":"2024-09-11T14:45:13.097467+0000","last_became_active":"2024-09-11T14:42:38.109230+0000","last_became_peered":"2024-09-11T14:42:38.109230+0000","last_unstale":"2024-09-11T14:45:13.097467+0000","last_undegraded":"2024-09-11T14:45:13.097467+0000","last_fullsized":"2024-09-11T14:45:13.097467+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":23552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"63'711","reported_seq":747,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:45:13.362272+0000","last_change":"2024-09-11T14:42:38.222378+0000","last_active":"2024-09-11T14:45:13.362272+0000","last_peered":"2024-09-11T14:45:13.362272+0000","last_clean":"2024-09-11T14:45:13.362272+0000","last_became_active":"2024-09-11T14:42:38.204348+0000","last_became_peered":"2024-09-11T14:42:38.204348+0000","last_unstale":"2024-09-11T14:45:13.362272+0000","last_undegraded":"2024-09-11T14:45:13.362272+0000","last_fullsized":"2024-09-11T14:45:13.362272+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":711,"num_write_kb":25408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":229,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.952940+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:44:25.952940+0000","last_peered":"2024-09-11T14:44:25.952940+0000","last_clean":"2024-09-11T14:44:25.952940+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:44:25.952940+0000","last_undegraded":"2024-09-11T14:44:25.952940+0000","last_fullsized":"2024-09-11T14:44:25.952940+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":158,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.961289+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:44:25.961289+0000","last_peered":"2024-09-11T14:44:25.961289+0000","last_clean":"2024-09-11T14:44:25.961289+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:44:25.961289+0000","last_undegraded":"2024-09-11T14:44:25.961289+0000","last_fullsized":"2024-09-11T14:44:25.961289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"63'660","reported_seq":696,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:45:12.974461+0000","last_change":"2024-09-11T14:42:38.156444+0000","last_active":"2024-09-11T14:45:12.974461+0000","last_peered":"2024-09-11T14:45:12.974461+0000","last_clean":"2024-09-11T14:45:12.974461+0000","last_became_active":"2024-09-11T14:42:38.142793+0000","last_became_peered":"2024-09-11T14:42:38.142793+0000","last_unstale":"2024-09-11T14:45:12.974461+0000","last_undegraded":"2024-09-11T14:45:12.974461+0000","last_fullsized":"2024-09-11T14:45:12.974461+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":660,"num_write_kb":23744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:26.015117+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:44:26.015117+0000","last_peered":"2024-09-11T14:44:26.015117+0000","last_clean":"2024-09-11T14:44:26.015117+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:44:26.015117+0000","last_undegraded":"2024-09-11T14:44:26.015117+0000","last_fullsized":"2024-09-11T14:44:26.015117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"63'711","reported_seq":747,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:45:13.214864+0000","last_change":"2024-09-11T14:42:38.179244+0000","last_active":"2024-09-11T14:45:13.214864+0000","last_peered":"2024-09-11T14:45:13.214864+0000","last_clean":"2024-09-11T14:45:13.214864+0000","last_became_active":"2024-09-11T14:42:38.159043+0000","last_became_peered":"2024-09-11T14:42:38.159043+0000","last_unstale":"2024-09-11T14:45:13.214864+0000","last_undegraded":"2024-09-11T14:45:13.214864+0000","last_fullsized":"2024-09-11T14:45:13.214864+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6356992,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":711,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.956440+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:44:25.956440+0000","last_peered":"2024-09-11T14:44:25.956440+0000","last_clean":"2024-09-11T14:44:25.956440+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:44:25.956440+0000","last_undegraded":"2024-09-11T14:44:25.956440+0000","last_fullsized":"2024-09-11T14:44:25.956440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"63'687","reported_seq":723,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:45:12.937314+0000","last_change":"2024-09-11T14:42:38.098677+0000","last_active":"2024-09-11T14:45:12.937314+0000","last_peered":"2024-09-11T14:45:12.937314+0000","last_clean":"2024-09-11T14:45:12.937314+0000","last_became_active":"2024-09-11T14:42:38.060593+0000","last_became_peered":"2024-09-11T14:42:38.060593+0000","last_unstale":"2024-09-11T14:45:12.937314+0000","last_undegraded":"2024-09-11T14:45:12.937314+0000","last_fullsized":"2024-09-11T14:45:12.937314+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":687,"num_write_kb":25024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":159,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:26.007609+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:44:26.007609+0000","last_peered":"2024-09-11T14:44:26.007609+0000","last_clean":"2024-09-11T14:44:26.007609+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:44:26.007609+0000","last_undegraded":"2024-09-11T14:44:26.007609+0000","last_fullsized":"2024-09-11T14:44:26.007609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"63'695","reported_seq":731,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:45:13.129873+0000","last_change":"2024-09-11T14:42:38.108084+0000","last_active":"2024-09-11T14:45:13.129873+0000","last_peered":"2024-09-11T14:45:13.129873+0000","last_clean":"2024-09-11T14:45:13.129873+0000","last_became_active":"2024-09-11T14:42:38.044460+0000","last_became_peered":"2024-09-11T14:42:38.044460+0000","last_unstale":"2024-09-11T14:45:13.129873+0000","last_undegraded":"2024-09-11T14:45:13.129873+0000","last_fullsized":"2024-09-11T14:45:13.129873+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":695,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:26.008718+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:44:26.008718+0000","last_peered":"2024-09-11T14:44:26.008718+0000","last_clean":"2024-09-11T14:44:26.008718+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:44:26.008718+0000","last_undegraded":"2024-09-11T14:44:26.008718+0000","last_fullsized":"2024-09-11T14:44:26.008718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"63'732","reported_seq":768,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:45:12.952048+0000","last_change":"2024-09-11T14:42:38.096488+0000","last_active":"2024-09-11T14:45:12.952048+0000","last_peered":"2024-09-11T14:45:12.952048+0000","last_clean":"2024-09-11T14:45:12.952048+0000","last_became_active":"2024-09-11T14:42:38.071104+0000","last_became_peered":"2024-09-11T14:42:38.071104+0000","last_unstale":"2024-09-11T14:45:12.952048+0000","last_undegraded":"2024-09-11T14:45:12.952048+0000","last_fullsized":"2024-09-11T14:45:12.952048+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":27008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.958911+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:44:25.958911+0000","last_peered":"2024-09-11T14:44:25.958911+0000","last_clean":"2024-09-11T14:44:25.958911+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:44:25.958911+0000","last_undegraded":"2024-09-11T14:44:25.958911+0000","last_fullsized":"2024-09-11T14:44:25.958911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"63'708","reported_seq":744,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:45:14.061357+0000","last_change":"2024-09-11T14:42:38.132564+0000","last_active":"2024-09-11T14:45:14.061357+0000","last_peered":"2024-09-11T14:45:14.061357+0000","last_clean":"2024-09-11T14:45:14.061357+0000","last_became_active":"2024-09-11T14:42:38.112585+0000","last_became_peered":"2024-09-11T14:42:38.112585+0000","last_unstale":"2024-09-11T14:45:14.061357+0000","last_undegraded":"2024-09-11T14:45:14.061357+0000","last_fullsized":"2024-09-11T14:45:14.061357+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":24960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.998918+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:44:25.998918+0000","last_peered":"2024-09-11T14:44:25.998918+0000","last_clean":"2024-09-11T14:44:25.998918+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:44:25.998918+0000","last_undegraded":"2024-09-11T14:44:25.998918+0000","last_fullsized":"2024-09-11T14:44:25.998918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"63'705","reported_seq":741,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:45:13.327382+0000","last_change":"2024-09-11T14:42:38.233207+0000","last_active":"2024-09-11T14:45:13.327382+0000","last_peered":"2024-09-11T14:45:13.327382+0000","last_clean":"2024-09-11T14:45:13.327382+0000","last_became_active":"2024-09-11T14:42:38.225462+0000","last_became_peered":"2024-09-11T14:42:38.225462+0000","last_unstale":"2024-09-11T14:45:13.327382+0000","last_undegraded":"2024-09-11T14:45:13.327382+0000","last_fullsized":"2024-09-11T14:45:13.327382+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:42:36.863637+0000","last_clean_scrub_stamp":"2024-09-11T14:42:36.863637+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":705,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":157,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T14:44:25.961911+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:44:25.961911+0000","last_peered":"2024-09-11T14:44:25.961911+0000","last_clean":"2024-09-11T14:44:25.961911+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:44:25.961911+0000","last_undegraded":"2024-09-11T14:44:25.961911+0000","last_fullsized":"2024-09-11T14:44:25.961911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":95223832,"num_objects":1454,"num_object_clones":0,"num_object_copies":4362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11198,"num_write_kb":404801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213609492480,"internally_reserved":0,"allocated":602001408,"data_stored":602001408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11198,"ondisk_log_size":11198,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213609230336,"internally_reserved":0,"allocated":602263552,"data_stored":602263552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53415800832,"internally_reserved":0,"allocated":137072640,"data_stored":137072640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":137864,"kb_used_data":137864,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52159864,"statfs":{"total":53552873472,"available":53411700736,"internally_reserved":0,"allocated":141172736,"data_stored":141172736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706213,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":173976,"kb_used_data":173976,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52123752,"statfs":{"total":53552873472,"available":53374722048,"internally_reserved":0,"allocated":178151424,"data_stored":178151424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706213,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":161732,"kb_used_data":161732,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52135996,"statfs":{"total":53552873472,"available":53387259904,"internally_reserved":0,"allocated":165613568,"data_stored":165613568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706213,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":124784,"kb_used_data":124784,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52172944,"statfs":{"total":53552873472,"available":53425094656,"internally_reserved":0,"allocated":127778816,"data_stored":127778816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53415800832,"internally_reserved":0,"allocated":137072640,"data_stored":137072640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53388984320,"internally_reserved":0,"allocated":163889152,"data_stored":163889152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53427458048,"internally_reserved":0,"allocated":125415424,"data_stored":125415424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53376987136,"internally_reserved":0,"allocated":175886336,"data_stored":175886336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53415800832,"internally_reserved":0,"allocated":137072640,"data_stored":137072640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53388984320,"internally_reserved":0,"allocated":163889152,"data_stored":163889152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53427458048,"internally_reserved":0,"allocated":125415424,"data_stored":125415424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53377249280,"internally_reserved":0,"allocated":175624192,"data_stored":175624192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53415800832,"internally_reserved":0,"allocated":137072640,"data_stored":137072640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:45:19.381 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:45:19.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:19.520+0000 7f2685151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:19.527+0000 7f2685151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:21.913 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:45:22.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:22.062+0000 7fcfb7711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:22.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:22.070+0000 7fcfb7711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:24.345 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:45:24.346 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:45:24.346 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:45:24.346 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:45:24.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:24.478+0000 7f17332ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:24.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:24.489+0000 7f17332ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:24.513 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:45:24.614 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:24.614 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:24.614 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:24.614 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:24.614 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:24.614 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:24.615 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:24.615 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:24.615 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:24.615 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:24.615 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:24.615 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:24.619 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:24.619 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:24.620 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:45:24.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:24.663+0000 7fce458bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:24.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:24.672+0000 7fce458bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:24.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:24.774+0000 7f853d657640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:24.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:24.788+0000 7f853d657640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:24.819 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:24.821 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:24.821 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:24.822 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:45:24.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:24.974+0000 7fcf1af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:24.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:24.986+0000 7fcf1af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:25.073 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:25.073 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:25.073 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:25.073 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:25.073 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:25.073 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:25.073 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:25.073 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:25.073 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:25.073 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:25.073 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:25.074 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:25.076 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:25.077 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:25.077 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:45:25.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:25.241+0000 7fc24d097640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:25.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:25.252+0000 7fc24d097640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:25.350 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:25.351 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:25.351 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:25.351 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:25.351 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:25.351 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:25.351 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:25.351 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:25.351 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:25.351 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:25.351 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:25.351 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:25.354 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:25.354 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:27.051 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:45:27.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:27.189+0000 7f7b2ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:27.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:27.195+0000 7f7b2ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:29.469 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:45:29.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:29.605+0000 7f8b23b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:29.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:29.611+0000 7f8b23b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:30.356 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:45:30.356 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:45:30.356 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:45:30.356 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:45:30.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:30.495+0000 7f5a7f093640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:30.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:30.510+0000 7f5a7f093640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:30.584 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:30.584 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:30.584 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:30.584 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:30.584 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:30.584 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:30.584 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:30.585 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:30.585 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:30.585 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:30.585 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:30.585 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:30.588 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:30.588 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:30.588 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:45:30.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:30.723+0000 7faa03d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:30.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:30.736+0000 7faa03d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:30.767 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:30.767 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:30.767 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:30.767 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:30.767 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:30.767 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:30.767 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:30.767 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:30.767 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:30.767 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:30.767 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:30.768 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:30.771 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:30.772 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:30.772 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:45:30.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:30.894+0000 7fe015b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:30.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:30.905+0000 7fe015b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:31.007 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:31.008 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:31.008 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:31.008 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:31.008 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:31.008 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:31.008 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:31.008 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:31.008 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:31.008 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:31.008 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:31.008 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:31.011 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:31.011 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:31.011 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:45:31.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:31.124+0000 7f9a0dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:31.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:31.135+0000 7f9a0dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:31.158 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:31.159 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:31.906 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:45:32.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:32.040+0000 7f57abf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:32.046+0000 7f57abf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:34.327 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:45:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:34.454+0000 7f1101f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:34.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:34.460+0000 7f1101f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:35.912 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Removed 6325 objects 2024-09-11T14:45:35.912 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Clean up completed and total clean up time :85.8577 2024-09-11T14:45:35.949 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_2 2024-09-11T14:45:35.949 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2024-09-11T14:45:36.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:36.052+0000 7f5b76911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:36.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:36.065+0000 7f5b76911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:36.160 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:45:36.160 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:45:36.160 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:45:36.160 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:45:36.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:36.265+0000 7fa786646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:36.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:36.274+0000 7fa786646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:36.292 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:36.292 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:36.292 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:36.292 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:36.292 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:36.292 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:36.293 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:36.293 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:36.293 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:36.293 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:36.293 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:36.293 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:36.295 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:36.296 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:36.296 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:45:36.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:36.399+0000 7f8051f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:36.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:36.407+0000 7f8051f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:36.425 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:36.425 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:36.425 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:36.425 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:36.425 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:36.425 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:36.426 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:36.426 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:36.426 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:36.426 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:36.426 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:36.426 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:36.428 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:36.429 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:36.429 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:45:36.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:36.538+0000 7f88fa311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:36.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:36.547+0000 7f88fa311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:36.565 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:36.565 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:36.565 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:36.566 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:36.566 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:36.566 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:36.566 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:36.566 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:36.566 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:36.566 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:36.566 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:36.566 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:36.568 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:36.569 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:36.569 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:45:36.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:36.679+0000 7fbac3ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:36.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:36.688+0000 7fbac3ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:36.705 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:36.705 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:36.707 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:36.709 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:36.709 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:36.751 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:45:36.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:36.852+0000 7f218e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:36.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:36.858+0000 7f218e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:36.881 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_2' removed 2024-09-11T14:45:36.903 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-11T14:45:36.904 INFO:tasks.radosbench:Beginning radosbench... 2024-09-11T14:45:36.904 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_3 2024-09-11T14:45:36.905 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_3 16 2024-09-11T14:45:37.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:37.070+0000 7fadf50d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:37.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:37.087+0000 7fadf50d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:37.890 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_3' created 2024-09-11T14:45:37.909 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2024-09-11T14:45:38.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:38.043+0000 7ffa7d351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:38.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:38.059+0000 7ffa7d351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:38.892 INFO:teuthology.orchestra.run.smithi103.stderr:enabled application 'rados' on pool 'unique_pool_3' 2024-09-11T14:45:39.256 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:45:39.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:39.359+0000 7f827c511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:39.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:39.364+0000 7f827c511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:39.917 DEBUG:teuthology.orchestra.run.smithi103:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_3 bench 90 write' 2024-09-11T14:45:39.919 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-11T14:45:39.919 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-11T14:45:39.987 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:hints = 1 2024-09-11T14:45:39.987 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-11T14:45:39.987 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object prefix: benchmark_data_smithi103_52308 2024-09-11T14:45:39.987 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:45:39.987 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 0 0 0 0 0 0 - 0 2024-09-11T14:45:40.987 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 1 16 77 61 3.81217 3.8125 0.747205 0.211159 2024-09-11T14:45:41.465 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:45:41.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:41.618+0000 7f654d511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:41.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:41.630+0000 7f654d511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:41.710 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:45:41.711 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:45:41.711 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:45:41.711 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:45:41.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:41.842+0000 7fefeeebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:41.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:41.857+0000 7fefeeebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:41.982 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:41.982 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:41.983 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:45:41.987 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 2 16 147 131 4.09339 4.375 0.0891962 0.219999 2024-09-11T14:45:42.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:42.163+0000 7ff84f0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:42.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:42.181+0000 7ff84f0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:42.300 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:42.300 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:42.300 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:42.301 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:42.301 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:42.301 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:42.301 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:42.301 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:42.301 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:42.301 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:42.301 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:42.301 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:42.305 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:42.305 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:42.305 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:45:42.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:42.483+0000 7ff0b7ef4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:42.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:42.501+0000 7ff0b7ef4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:42.552 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:42.552 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:42.552 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:42.552 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:42.552 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:42.553 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:42.553 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:42.553 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:42.553 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:42.553 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:42.553 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:42.553 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:42.557 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:42.557 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:42.558 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:45:42.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:42.741+0000 7fb20f87d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:42.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:42.756+0000 7fb20f87d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:42.797 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:45:42.797 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:45:42.797 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:45:42.797 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:45:42.797 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:45:42.797 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:45:42.798 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:45:42.798 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:45:42.798 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:45:42.798 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:45:42.798 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:45:42.798 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:45:42.801 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:45:42.802 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:45:42.987 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 3 16 213 197 4.1038 4.125 1.04157 0.226831 2024-09-11T14:45:43.987 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 4 16 294 278 4.34335 5.0625 0.110757 0.223586 2024-09-11T14:45:44.006 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:45:44.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:44.132+0000 7f13b1d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:44.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:44.140+0000 7f13b1d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:44.987 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 5 16 369 353 4.41209 4.6875 0.0787948 0.215258 2024-09-11T14:45:45.988 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 6 16 439 423 4.40584 4.375 0.135302 0.213809 2024-09-11T14:45:46.709 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:45:46.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:46.862+0000 7f4733e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:46.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:46.870+0000 7f4733e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:46.988 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 7 16 504 488 4.35673 4.0625 0.192704 0.221373 2024-09-11T14:45:47.802 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:45:47.803 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:45:47.803 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:45:47.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:47.927+0000 7fd1eb111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:47.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:47.938+0000 7fd1eb111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:47.988 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 8 16 568 552 4.31209 4 0.0631499 0.221859 2024-09-11T14:45:48.218 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:45:48.219 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:45:48.237 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2024-09-11T14:45:47.344846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18022963,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":347,"num_write_kb":18132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":321,"ondisk_log_size":321,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":100160,"kb_used_data":100160,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209090752,"statfs":{"total":214211493888,"available":214108930048,"internally_reserved":0,"allocated":102563840,"data_stored":102563840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17432576,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.443512"},"pg_stats":[{"pgid":"6.f","version":"68'13","reported_seq":28,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:42.801691+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:45:42.801691+0000","last_peered":"2024-09-11T14:45:42.801691+0000","last_clean":"2024-09-11T14:45:42.801691+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:45:42.801691+0000","last_undegraded":"2024-09-11T14:45:42.801691+0000","last_fullsized":"2024-09-11T14:45:42.801691+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"68'18","reported_seq":33,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:43.303426+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:45:43.303426+0000","last_peered":"2024-09-11T14:45:43.303426+0000","last_clean":"2024-09-11T14:45:43.303426+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:45:43.303426+0000","last_undegraded":"2024-09-11T14:45:43.303426+0000","last_fullsized":"2024-09-11T14:45:43.303426+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"68'14","reported_seq":29,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:42.683224+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:45:42.683224+0000","last_peered":"2024-09-11T14:45:42.683224+0000","last_clean":"2024-09-11T14:45:42.683224+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:45:42.683224+0000","last_undegraded":"2024-09-11T14:45:42.683224+0000","last_fullsized":"2024-09-11T14:45:42.683224+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"68'20","reported_seq":35,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:44.114512+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:45:44.114512+0000","last_peered":"2024-09-11T14:45:44.114512+0000","last_clean":"2024-09-11T14:45:44.114512+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:45:44.114512+0000","last_undegraded":"2024-09-11T14:45:44.114512+0000","last_fullsized":"2024-09-11T14:45:44.114512+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"68'18","reported_seq":33,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:42.593228+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:45:42.593228+0000","last_peered":"2024-09-11T14:45:42.593228+0000","last_clean":"2024-09-11T14:45:42.593228+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:45:42.593228+0000","last_undegraded":"2024-09-11T14:45:42.593228+0000","last_fullsized":"2024-09-11T14:45:42.593228+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"68'18","reported_seq":33,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:43.325136+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:45:43.325136+0000","last_peered":"2024-09-11T14:45:43.325136+0000","last_clean":"2024-09-11T14:45:43.325136+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:45:43.325136+0000","last_undegraded":"2024-09-11T14:45:43.325136+0000","last_fullsized":"2024-09-11T14:45:43.325136+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"68'22","reported_seq":37,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:43.849587+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:45:43.849587+0000","last_peered":"2024-09-11T14:45:43.849587+0000","last_clean":"2024-09-11T14:45:43.849587+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:45:43.849587+0000","last_undegraded":"2024-09-11T14:45:43.849587+0000","last_fullsized":"2024-09-11T14:45:43.849587+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"68'15","reported_seq":30,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:42.713597+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:45:42.713597+0000","last_peered":"2024-09-11T14:45:42.713597+0000","last_clean":"2024-09-11T14:45:42.713597+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:45:42.713597+0000","last_undegraded":"2024-09-11T14:45:42.713597+0000","last_fullsized":"2024-09-11T14:45:42.713597+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"68'17","reported_seq":32,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:43.390814+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:45:43.390814+0000","last_peered":"2024-09-11T14:45:43.390814+0000","last_clean":"2024-09-11T14:45:43.390814+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:45:43.390814+0000","last_undegraded":"2024-09-11T14:45:43.390814+0000","last_fullsized":"2024-09-11T14:45:43.390814+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":244,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:41.909203+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:45:41.909203+0000","last_peered":"2024-09-11T14:45:41.909203+0000","last_clean":"2024-09-11T14:45:41.909203+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:45:41.909203+0000","last_undegraded":"2024-09-11T14:45:41.909203+0000","last_fullsized":"2024-09-11T14:45:41.909203+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":173,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:41.953384+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:45:41.953384+0000","last_peered":"2024-09-11T14:45:41.953384+0000","last_clean":"2024-09-11T14:45:41.953384+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:45:41.953384+0000","last_undegraded":"2024-09-11T14:45:41.953384+0000","last_fullsized":"2024-09-11T14:45:41.953384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"68'15","reported_seq":30,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:43.353631+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:45:43.353631+0000","last_peered":"2024-09-11T14:45:43.353631+0000","last_clean":"2024-09-11T14:45:43.353631+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:45:43.353631+0000","last_undegraded":"2024-09-11T14:45:43.353631+0000","last_fullsized":"2024-09-11T14:45:43.353631+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":172,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:42.277011+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:45:42.277011+0000","last_peered":"2024-09-11T14:45:42.277011+0000","last_clean":"2024-09-11T14:45:42.277011+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:45:42.277011+0000","last_undegraded":"2024-09-11T14:45:42.277011+0000","last_fullsized":"2024-09-11T14:45:42.277011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"68'18","reported_seq":33,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:42.652063+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:45:42.652063+0000","last_peered":"2024-09-11T14:45:42.652063+0000","last_clean":"2024-09-11T14:45:42.652063+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:45:42.652063+0000","last_undegraded":"2024-09-11T14:45:42.652063+0000","last_fullsized":"2024-09-11T14:45:42.652063+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":172,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:41.948533+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:45:41.948533+0000","last_peered":"2024-09-11T14:45:41.948533+0000","last_clean":"2024-09-11T14:45:41.948533+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:45:41.948533+0000","last_undegraded":"2024-09-11T14:45:41.948533+0000","last_fullsized":"2024-09-11T14:45:41.948533+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"68'22","reported_seq":37,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:44.338439+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:45:44.338439+0000","last_peered":"2024-09-11T14:45:44.338439+0000","last_clean":"2024-09-11T14:45:44.338439+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:45:44.338439+0000","last_undegraded":"2024-09-11T14:45:44.338439+0000","last_fullsized":"2024-09-11T14:45:44.338439+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":174,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:42.272324+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:45:42.272324+0000","last_peered":"2024-09-11T14:45:42.272324+0000","last_clean":"2024-09-11T14:45:42.272324+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:45:42.272324+0000","last_undegraded":"2024-09-11T14:45:42.272324+0000","last_fullsized":"2024-09-11T14:45:42.272324+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"68'16","reported_seq":31,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:43.072376+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:45:43.072376+0000","last_peered":"2024-09-11T14:45:43.072376+0000","last_clean":"2024-09-11T14:45:43.072376+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:45:43.072376+0000","last_undegraded":"2024-09-11T14:45:43.072376+0000","last_fullsized":"2024-09-11T14:45:43.072376+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:41.956968+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:45:41.956968+0000","last_peered":"2024-09-11T14:45:41.956968+0000","last_clean":"2024-09-11T14:45:41.956968+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:45:41.956968+0000","last_undegraded":"2024-09-11T14:45:41.956968+0000","last_fullsized":"2024-09-11T14:45:41.956968+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"68'18","reported_seq":33,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:42.624095+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:45:42.624095+0000","last_peered":"2024-09-11T14:45:42.624095+0000","last_clean":"2024-09-11T14:45:42.624095+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:45:42.624095+0000","last_undegraded":"2024-09-11T14:45:42.624095+0000","last_fullsized":"2024-09-11T14:45:42.624095+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":172,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:41.914095+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:45:41.914095+0000","last_peered":"2024-09-11T14:45:41.914095+0000","last_clean":"2024-09-11T14:45:41.914095+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:45:41.914095+0000","last_undegraded":"2024-09-11T14:45:41.914095+0000","last_fullsized":"2024-09-11T14:45:41.914095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"68'11","reported_seq":26,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:43.117153+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:45:43.117153+0000","last_peered":"2024-09-11T14:45:43.117153+0000","last_clean":"2024-09-11T14:45:43.117153+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:45:43.117153+0000","last_undegraded":"2024-09-11T14:45:43.117153+0000","last_fullsized":"2024-09-11T14:45:43.117153+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:41.948182+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:45:41.948182+0000","last_peered":"2024-09-11T14:45:41.948182+0000","last_clean":"2024-09-11T14:45:41.948182+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:45:41.948182+0000","last_undegraded":"2024-09-11T14:45:41.948182+0000","last_fullsized":"2024-09-11T14:45:41.948182+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"68'11","reported_seq":26,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:43.185425+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:45:43.185425+0000","last_peered":"2024-09-11T14:45:43.185425+0000","last_clean":"2024-09-11T14:45:43.185425+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:45:43.185425+0000","last_undegraded":"2024-09-11T14:45:43.185425+0000","last_fullsized":"2024-09-11T14:45:43.185425+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":172,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-11T14:45:41.959886+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:45:41.959886+0000","last_peered":"2024-09-11T14:45:41.959886+0000","last_clean":"2024-09-11T14:45:41.959886+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:45:41.959886+0000","last_undegraded":"2024-09-11T14:45:41.959886+0000","last_fullsized":"2024-09-11T14:45:41.959886+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":17432576,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214097219584,"internally_reserved":0,"allocated":114274304,"data_stored":114274304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":266,"ondisk_log_size":266,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214097350656,"internally_reserved":0,"allocated":114143232,"data_stored":114143232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53520011264,"internally_reserved":0,"allocated":32862208,"data_stored":32862208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":27452,"kb_used_data":27452,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52270276,"statfs":{"total":53552873472,"available":53524762624,"internally_reserved":0,"allocated":28110848,"data_stored":28110848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706243,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24188,"kb_used_data":24188,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52273540,"statfs":{"total":53552873472,"available":53528104960,"internally_reserved":0,"allocated":24768512,"data_stored":24768512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706243,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":26128,"kb_used_data":26128,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52271600,"statfs":{"total":53552873472,"available":53526118400,"internally_reserved":0,"allocated":26755072,"data_stored":26755072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706243,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":22392,"kb_used_data":22392,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52275336,"statfs":{"total":53552873472,"available":53529944064,"internally_reserved":0,"allocated":22929408,"data_stored":22929408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53520011264,"internally_reserved":0,"allocated":32862208,"data_stored":32862208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53524283392,"internally_reserved":0,"allocated":28590080,"data_stored":28590080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53526265856,"internally_reserved":0,"allocated":26607616,"data_stored":26607616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53526790144,"internally_reserved":0,"allocated":26083328,"data_stored":26083328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53520011264,"internally_reserved":0,"allocated":32862208,"data_stored":32862208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53524152320,"internally_reserved":0,"allocated":28721152,"data_stored":28721152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53526265856,"internally_reserved":0,"allocated":26607616,"data_stored":26607616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53526790144,"internally_reserved":0,"allocated":26083328,"data_stored":26083328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53520011264,"internally_reserved":0,"allocated":32862208,"data_stored":32862208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:45:48.988 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 9 16 641 625 4.33987 4.5625 0.0616093 0.223052 2024-09-11T14:45:49.362 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:45:49.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:49.511+0000 7fcead0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:49.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:49.518+0000 7fcead0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:49.988 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 10 16 717 701 4.38084 4.75 0.0353301 0.222104 2024-09-11T14:45:50.988 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 11 16 788 772 4.38595 4.4375 0.118504 0.223494 2024-09-11T14:45:51.988 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 12 16 877 861 4.48395 5.5625 0.292443 0.220931 2024-09-11T14:45:52.014 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:45:52.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:52.138+0000 7f5e63b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:52.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:52.147+0000 7f5e63b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:52.988 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 13 16 958 942 4.52842 5.0625 0.119832 0.218455 2024-09-11T14:45:53.239 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:45:53.239 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:45:53.239 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:45:53.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:53.375+0000 7f40f7b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:53.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:53.385+0000 7f40f7b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:53.677 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:45:53.678 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:45:53.702 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":358,"stamp":"2024-09-11T14:45:53.346122+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":40567347,"num_objects":614,"num_object_clones":0,"num_object_copies":1842,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":691,"num_write_kb":40148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":665,"ondisk_log_size":665,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":236012,"kb_used_data":236012,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208954900,"statfs":{"total":214211493888,"available":213969817600,"internally_reserved":0,"allocated":241676288,"data_stored":241676288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22544384,"num_objects":344,"num_object_clones":0,"num_object_copies":1032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":22016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001801"},"pg_stats":[{"pgid":"6.f","version":"69'38","reported_seq":56,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:47.943515+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:45:47.943515+0000","last_peered":"2024-09-11T14:45:47.943515+0000","last_clean":"2024-09-11T14:45:47.943515+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:45:47.943515+0000","last_undegraded":"2024-09-11T14:45:47.943515+0000","last_fullsized":"2024-09-11T14:45:47.943515+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"69'42","reported_seq":60,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:48.127749+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:45:48.127749+0000","last_peered":"2024-09-11T14:45:48.127749+0000","last_clean":"2024-09-11T14:45:48.127749+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:45:48.127749+0000","last_undegraded":"2024-09-11T14:45:48.127749+0000","last_fullsized":"2024-09-11T14:45:48.127749+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"69'37","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:48.343289+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:45:48.343289+0000","last_peered":"2024-09-11T14:45:48.343289+0000","last_clean":"2024-09-11T14:45:48.343289+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:45:48.343289+0000","last_undegraded":"2024-09-11T14:45:48.343289+0000","last_fullsized":"2024-09-11T14:45:48.343289+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"69'40","reported_seq":58,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:49.049575+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:45:49.049575+0000","last_peered":"2024-09-11T14:45:49.049575+0000","last_clean":"2024-09-11T14:45:49.049575+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:45:49.049575+0000","last_undegraded":"2024-09-11T14:45:49.049575+0000","last_fullsized":"2024-09-11T14:45:49.049575+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"69'30","reported_seq":48,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:48.028347+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:45:48.028347+0000","last_peered":"2024-09-11T14:45:48.028347+0000","last_clean":"2024-09-11T14:45:48.028347+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:45:48.028347+0000","last_undegraded":"2024-09-11T14:45:48.028347+0000","last_fullsized":"2024-09-11T14:45:48.028347+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"69'44","reported_seq":62,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:48.281904+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:45:48.281904+0000","last_peered":"2024-09-11T14:45:48.281904+0000","last_clean":"2024-09-11T14:45:48.281904+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:45:48.281904+0000","last_undegraded":"2024-09-11T14:45:48.281904+0000","last_fullsized":"2024-09-11T14:45:48.281904+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"69'40","reported_seq":58,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:49.348607+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:45:49.348607+0000","last_peered":"2024-09-11T14:45:49.348607+0000","last_clean":"2024-09-11T14:45:49.348607+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:45:49.348607+0000","last_undegraded":"2024-09-11T14:45:49.348607+0000","last_fullsized":"2024-09-11T14:45:49.348607+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"69'40","reported_seq":58,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:47.991586+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:45:47.991586+0000","last_peered":"2024-09-11T14:45:47.991586+0000","last_clean":"2024-09-11T14:45:47.991586+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:45:47.991586+0000","last_undegraded":"2024-09-11T14:45:47.991586+0000","last_fullsized":"2024-09-11T14:45:47.991586+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"69'32","reported_seq":50,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:47.620781+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:45:47.620781+0000","last_peered":"2024-09-11T14:45:47.620781+0000","last_clean":"2024-09-11T14:45:47.620781+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:45:47.620781+0000","last_undegraded":"2024-09-11T14:45:47.620781+0000","last_fullsized":"2024-09-11T14:45:47.620781+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":247,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:46.930749+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:45:46.930749+0000","last_peered":"2024-09-11T14:45:46.930749+0000","last_clean":"2024-09-11T14:45:46.930749+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:45:46.930749+0000","last_undegraded":"2024-09-11T14:45:46.930749+0000","last_fullsized":"2024-09-11T14:45:46.930749+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":176,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:46.923175+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:45:46.923175+0000","last_peered":"2024-09-11T14:45:46.923175+0000","last_clean":"2024-09-11T14:45:46.923175+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:45:46.923175+0000","last_undegraded":"2024-09-11T14:45:46.923175+0000","last_fullsized":"2024-09-11T14:45:46.923175+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"69'35","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:48.848994+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:45:48.848994+0000","last_peered":"2024-09-11T14:45:48.848994+0000","last_clean":"2024-09-11T14:45:48.848994+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:45:48.848994+0000","last_undegraded":"2024-09-11T14:45:48.848994+0000","last_fullsized":"2024-09-11T14:45:48.848994+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":175,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:46.981437+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:45:46.981437+0000","last_peered":"2024-09-11T14:45:46.981437+0000","last_clean":"2024-09-11T14:45:46.981437+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:45:46.981437+0000","last_undegraded":"2024-09-11T14:45:46.981437+0000","last_fullsized":"2024-09-11T14:45:46.981437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"69'44","reported_seq":62,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:48.185542+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:45:48.185542+0000","last_peered":"2024-09-11T14:45:48.185542+0000","last_clean":"2024-09-11T14:45:48.185542+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:45:48.185542+0000","last_undegraded":"2024-09-11T14:45:48.185542+0000","last_fullsized":"2024-09-11T14:45:48.185542+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":175,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:46.916473+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:45:46.916473+0000","last_peered":"2024-09-11T14:45:46.916473+0000","last_clean":"2024-09-11T14:45:46.916473+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:45:46.916473+0000","last_undegraded":"2024-09-11T14:45:46.916473+0000","last_fullsized":"2024-09-11T14:45:46.916473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"69'42","reported_seq":60,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:49.278684+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:45:49.278684+0000","last_peered":"2024-09-11T14:45:49.278684+0000","last_clean":"2024-09-11T14:45:49.278684+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:45:49.278684+0000","last_undegraded":"2024-09-11T14:45:49.278684+0000","last_fullsized":"2024-09-11T14:45:49.278684+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":177,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:46.973986+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:45:46.973986+0000","last_peered":"2024-09-11T14:45:46.973986+0000","last_clean":"2024-09-11T14:45:46.973986+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:45:46.973986+0000","last_undegraded":"2024-09-11T14:45:46.973986+0000","last_fullsized":"2024-09-11T14:45:46.973986+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"69'40","reported_seq":58,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:47.705524+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:45:47.705524+0000","last_peered":"2024-09-11T14:45:47.705524+0000","last_clean":"2024-09-11T14:45:47.705524+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:45:47.705524+0000","last_undegraded":"2024-09-11T14:45:47.705524+0000","last_fullsized":"2024-09-11T14:45:47.705524+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":175,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:47.032046+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:45:47.032046+0000","last_peered":"2024-09-11T14:45:47.032046+0000","last_clean":"2024-09-11T14:45:47.032046+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:45:47.032046+0000","last_undegraded":"2024-09-11T14:45:47.032046+0000","last_fullsized":"2024-09-11T14:45:47.032046+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"69'37","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:47.765021+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:45:47.765021+0000","last_peered":"2024-09-11T14:45:47.765021+0000","last_clean":"2024-09-11T14:45:47.765021+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:45:47.765021+0000","last_undegraded":"2024-09-11T14:45:47.765021+0000","last_fullsized":"2024-09-11T14:45:47.765021+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":175,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:46.936350+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:45:46.936350+0000","last_peered":"2024-09-11T14:45:46.936350+0000","last_clean":"2024-09-11T14:45:46.936350+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:45:46.936350+0000","last_undegraded":"2024-09-11T14:45:46.936350+0000","last_fullsized":"2024-09-11T14:45:46.936350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"69'37","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:48.234214+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:45:48.234214+0000","last_peered":"2024-09-11T14:45:48.234214+0000","last_clean":"2024-09-11T14:45:48.234214+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:45:48.234214+0000","last_undegraded":"2024-09-11T14:45:48.234214+0000","last_fullsized":"2024-09-11T14:45:48.234214+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":175,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:47.029120+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:45:47.029120+0000","last_peered":"2024-09-11T14:45:47.029120+0000","last_clean":"2024-09-11T14:45:47.029120+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:45:47.029120+0000","last_undegraded":"2024-09-11T14:45:47.029120+0000","last_fullsized":"2024-09-11T14:45:47.029120+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"69'32","reported_seq":50,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:47.321690+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:45:47.321690+0000","last_peered":"2024-09-11T14:45:47.321690+0000","last_clean":"2024-09-11T14:45:47.321690+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:45:47.321690+0000","last_undegraded":"2024-09-11T14:45:47.321690+0000","last_fullsized":"2024-09-11T14:45:47.321690+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":175,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T14:45:46.925468+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:45:46.925468+0000","last_peered":"2024-09-11T14:45:46.925468+0000","last_clean":"2024-09-11T14:45:46.925468+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:45:46.925468+0000","last_undegraded":"2024-09-11T14:45:46.925468+0000","last_fullsized":"2024-09-11T14:45:46.925468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":39976960,"num_objects":610,"num_object_clones":0,"num_object_copies":1830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":610,"num_write_kb":39040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213960638464,"internally_reserved":0,"allocated":250855424,"data_stored":250855424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":610,"ondisk_log_size":610,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213960769536,"internally_reserved":0,"allocated":250724352,"data_stored":250724352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53492015104,"internally_reserved":0,"allocated":60858368,"data_stored":60858368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":56488,"kb_used_data":56488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52241240,"statfs":{"total":53552873472,"available":53495029760,"internally_reserved":0,"allocated":57843712,"data_stored":57843712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706248,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":56660,"kb_used_data":56660,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52241068,"statfs":{"total":53552873472,"available":53494853632,"internally_reserved":0,"allocated":58019840,"data_stored":58019840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706248,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":65048,"kb_used_data":65048,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52232680,"statfs":{"total":53552873472,"available":53486264320,"internally_reserved":0,"allocated":66609152,"data_stored":66609152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706248,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":57816,"kb_used_data":57816,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52239912,"statfs":{"total":53552873472,"available":53493669888,"internally_reserved":0,"allocated":59203584,"data_stored":59203584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53492015104,"internally_reserved":0,"allocated":60858368,"data_stored":60858368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53484429312,"internally_reserved":0,"allocated":68444160,"data_stored":68444160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53490388992,"internally_reserved":0,"allocated":62484480,"data_stored":62484480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53493936128,"internally_reserved":0,"allocated":58937344,"data_stored":58937344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53492015104,"internally_reserved":0,"allocated":60858368,"data_stored":60858368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53484429312,"internally_reserved":0,"allocated":68444160,"data_stored":68444160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53490257920,"internally_reserved":0,"allocated":62615552,"data_stored":62615552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53493936128,"internally_reserved":0,"allocated":58937344,"data_stored":58937344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53492015104,"internally_reserved":0,"allocated":60858368,"data_stored":60858368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:45:53.988 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 14 16 1040 1024 4.57099 5.125 0.420254 0.21685 2024-09-11T14:45:54.639 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:45:54.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:54.811+0000 7fdd51f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:54.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:54.823+0000 7fdd51f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:54.988 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 15 16 1129 1113 4.63706 5.5625 0.19447 0.214295 2024-09-11T14:45:55.989 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 16 16 1213 1197 4.67534 5.25 0.149914 0.212796 2024-09-11T14:45:56.989 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 17 16 1292 1276 4.69074 4.9375 0.204456 0.211661 2024-09-11T14:45:57.602 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:45:57.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:57.775+0000 7f47db6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:57.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:57.785+0000 7f47db6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:57.989 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 18 16 1377 1361 4.72525 5.3125 0.199757 0.210675 2024-09-11T14:45:58.705 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:45:58.705 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:45:58.705 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:45:58.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:58.837+0000 7f4e04751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:58.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:45:58.849+0000 7f4e04751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:58.989 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 19 16 1449 1433 4.71338 4.5 0.411634 0.210434 2024-09-11T14:45:59.161 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:45:59.162 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:45:59.178 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":361,"stamp":"2024-09-11T14:45:57.347020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":66781747,"num_objects":1014,"num_object_clones":0,"num_object_copies":3042,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1091,"num_write_kb":65748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1065,"ondisk_log_size":1065,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":386420,"kb_used_data":386420,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208804492,"statfs":{"total":214211493888,"available":213815799808,"internally_reserved":0,"allocated":395694080,"data_stored":395694080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":31326208,"num_objects":478,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":478,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001831"},"pg_stats":[{"pgid":"6.f","version":"70'65","reported_seq":86,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:53.271418+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:45:53.271418+0000","last_peered":"2024-09-11T14:45:53.271418+0000","last_clean":"2024-09-11T14:45:53.271418+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:45:53.271418+0000","last_undegraded":"2024-09-11T14:45:53.271418+0000","last_fullsized":"2024-09-11T14:45:53.271418+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"70'63","reported_seq":84,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:52.697183+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:45:52.697183+0000","last_peered":"2024-09-11T14:45:52.697183+0000","last_clean":"2024-09-11T14:45:52.697183+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:45:52.697183+0000","last_undegraded":"2024-09-11T14:45:52.697183+0000","last_fullsized":"2024-09-11T14:45:52.697183+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"70'66","reported_seq":87,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:52.802696+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:45:52.802696+0000","last_peered":"2024-09-11T14:45:52.802696+0000","last_clean":"2024-09-11T14:45:52.802696+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:45:52.802696+0000","last_undegraded":"2024-09-11T14:45:52.802696+0000","last_fullsized":"2024-09-11T14:45:52.802696+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"70'64","reported_seq":85,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:53.969790+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:45:53.969790+0000","last_peered":"2024-09-11T14:45:53.969790+0000","last_clean":"2024-09-11T14:45:53.969790+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:45:53.969790+0000","last_undegraded":"2024-09-11T14:45:53.969790+0000","last_fullsized":"2024-09-11T14:45:53.969790+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"70'55","reported_seq":76,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:52.909560+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:45:52.909560+0000","last_peered":"2024-09-11T14:45:52.909560+0000","last_clean":"2024-09-11T14:45:52.909560+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:45:52.909560+0000","last_undegraded":"2024-09-11T14:45:52.909560+0000","last_fullsized":"2024-09-11T14:45:52.909560+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"70'68","reported_seq":89,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:53.329871+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:45:53.329871+0000","last_peered":"2024-09-11T14:45:53.329871+0000","last_clean":"2024-09-11T14:45:53.329871+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:45:53.329871+0000","last_undegraded":"2024-09-11T14:45:53.329871+0000","last_fullsized":"2024-09-11T14:45:53.329871+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"70'61","reported_seq":82,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:54.378191+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:45:54.378191+0000","last_peered":"2024-09-11T14:45:54.378191+0000","last_clean":"2024-09-11T14:45:54.378191+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:45:54.378191+0000","last_undegraded":"2024-09-11T14:45:54.378191+0000","last_fullsized":"2024-09-11T14:45:54.378191+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"70'74","reported_seq":95,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:52.990101+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:45:52.990101+0000","last_peered":"2024-09-11T14:45:52.990101+0000","last_clean":"2024-09-11T14:45:52.990101+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:45:52.990101+0000","last_undegraded":"2024-09-11T14:45:52.990101+0000","last_fullsized":"2024-09-11T14:45:52.990101+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"70'61","reported_seq":82,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:52.978984+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:45:52.978984+0000","last_peered":"2024-09-11T14:45:52.978984+0000","last_clean":"2024-09-11T14:45:52.978984+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:45:52.978984+0000","last_undegraded":"2024-09-11T14:45:52.978984+0000","last_fullsized":"2024-09-11T14:45:52.978984+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":250,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:52.006681+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:45:52.006681+0000","last_peered":"2024-09-11T14:45:52.006681+0000","last_clean":"2024-09-11T14:45:52.006681+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:45:52.006681+0000","last_undegraded":"2024-09-11T14:45:52.006681+0000","last_fullsized":"2024-09-11T14:45:52.006681+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":179,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:51.924055+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:45:51.924055+0000","last_peered":"2024-09-11T14:45:51.924055+0000","last_clean":"2024-09-11T14:45:51.924055+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:45:51.924055+0000","last_undegraded":"2024-09-11T14:45:51.924055+0000","last_fullsized":"2024-09-11T14:45:51.924055+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"70'56","reported_seq":77,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:54.358421+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:45:54.358421+0000","last_peered":"2024-09-11T14:45:54.358421+0000","last_clean":"2024-09-11T14:45:54.358421+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:45:54.358421+0000","last_undegraded":"2024-09-11T14:45:54.358421+0000","last_fullsized":"2024-09-11T14:45:54.358421+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":178,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:51.939734+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:45:51.939734+0000","last_peered":"2024-09-11T14:45:51.939734+0000","last_clean":"2024-09-11T14:45:51.939734+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:45:51.939734+0000","last_undegraded":"2024-09-11T14:45:51.939734+0000","last_fullsized":"2024-09-11T14:45:51.939734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"70'68","reported_seq":89,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:53.236175+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:45:53.236175+0000","last_peered":"2024-09-11T14:45:53.236175+0000","last_clean":"2024-09-11T14:45:53.236175+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:45:53.236175+0000","last_undegraded":"2024-09-11T14:45:53.236175+0000","last_fullsized":"2024-09-11T14:45:53.236175+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":178,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:51.919519+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:45:51.919519+0000","last_peered":"2024-09-11T14:45:51.919519+0000","last_clean":"2024-09-11T14:45:51.919519+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:45:51.919519+0000","last_undegraded":"2024-09-11T14:45:51.919519+0000","last_fullsized":"2024-09-11T14:45:51.919519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"70'66","reported_seq":87,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:53.922035+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:45:53.922035+0000","last_peered":"2024-09-11T14:45:53.922035+0000","last_clean":"2024-09-11T14:45:53.922035+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:45:53.922035+0000","last_undegraded":"2024-09-11T14:45:53.922035+0000","last_fullsized":"2024-09-11T14:45:53.922035+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":180,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:51.934596+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:45:51.934596+0000","last_peered":"2024-09-11T14:45:51.934596+0000","last_clean":"2024-09-11T14:45:51.934596+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:45:51.934596+0000","last_undegraded":"2024-09-11T14:45:51.934596+0000","last_fullsized":"2024-09-11T14:45:51.934596+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"70'62","reported_seq":83,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:53.368626+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:45:53.368626+0000","last_peered":"2024-09-11T14:45:53.368626+0000","last_clean":"2024-09-11T14:45:53.368626+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:45:53.368626+0000","last_undegraded":"2024-09-11T14:45:53.368626+0000","last_fullsized":"2024-09-11T14:45:53.368626+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":178,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:51.944718+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:45:51.944718+0000","last_peered":"2024-09-11T14:45:51.944718+0000","last_clean":"2024-09-11T14:45:51.944718+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:45:51.944718+0000","last_undegraded":"2024-09-11T14:45:51.944718+0000","last_fullsized":"2024-09-11T14:45:51.944718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"70'70","reported_seq":91,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:53.308133+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:45:53.308133+0000","last_peered":"2024-09-11T14:45:53.308133+0000","last_clean":"2024-09-11T14:45:53.308133+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:45:53.308133+0000","last_undegraded":"2024-09-11T14:45:53.308133+0000","last_fullsized":"2024-09-11T14:45:53.308133+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":178,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:52.010013+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:45:52.010013+0000","last_peered":"2024-09-11T14:45:52.010013+0000","last_clean":"2024-09-11T14:45:52.010013+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:45:52.010013+0000","last_undegraded":"2024-09-11T14:45:52.010013+0000","last_fullsized":"2024-09-11T14:45:52.010013+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"70'64","reported_seq":85,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:53.049613+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:45:53.049613+0000","last_peered":"2024-09-11T14:45:53.049613+0000","last_clean":"2024-09-11T14:45:53.049613+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:45:53.049613+0000","last_undegraded":"2024-09-11T14:45:53.049613+0000","last_fullsized":"2024-09-11T14:45:53.049613+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":178,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:51.939115+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:45:51.939115+0000","last_peered":"2024-09-11T14:45:51.939115+0000","last_clean":"2024-09-11T14:45:51.939115+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:45:51.939115+0000","last_undegraded":"2024-09-11T14:45:51.939115+0000","last_fullsized":"2024-09-11T14:45:51.939115+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"70'47","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:52.642985+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:45:52.642985+0000","last_peered":"2024-09-11T14:45:52.642985+0000","last_clean":"2024-09-11T14:45:52.642985+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:45:52.642985+0000","last_undegraded":"2024-09-11T14:45:52.642985+0000","last_fullsized":"2024-09-11T14:45:52.642985+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":178,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T14:45:51.935361+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:45:51.935361+0000","last_peered":"2024-09-11T14:45:51.935361+0000","last_clean":"2024-09-11T14:45:51.935361+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:45:51.935361+0000","last_undegraded":"2024-09-11T14:45:51.935361+0000","last_fullsized":"2024-09-11T14:45:51.935361+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":66191360,"num_objects":1010,"num_object_clones":0,"num_object_copies":3030,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":64640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213802422272,"internally_reserved":0,"allocated":409071616,"data_stored":409071616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1010,"ondisk_log_size":1010,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213802946560,"internally_reserved":0,"allocated":408547328,"data_stored":408547328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53455880192,"internally_reserved":0,"allocated":96993280,"data_stored":96993280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673549,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":90356,"kb_used_data":90356,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52207372,"statfs":{"total":53552873472,"available":53460348928,"internally_reserved":0,"allocated":92524544,"data_stored":92524544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706253,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":91416,"kb_used_data":91416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52206312,"statfs":{"total":53552873472,"available":53459263488,"internally_reserved":0,"allocated":93609984,"data_stored":93609984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706253,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":106768,"kb_used_data":106768,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52190960,"statfs":{"total":53552873472,"available":53443543040,"internally_reserved":0,"allocated":109330432,"data_stored":109330432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706253,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":97880,"kb_used_data":97880,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52199848,"statfs":{"total":53552873472,"available":53452644352,"internally_reserved":0,"allocated":100229120,"data_stored":100229120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53455880192,"internally_reserved":0,"allocated":96993280,"data_stored":96993280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53442097152,"internally_reserved":0,"allocated":110776320,"data_stored":110776320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53447151616,"internally_reserved":0,"allocated":105721856,"data_stored":105721856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53457817600,"internally_reserved":0,"allocated":95055872,"data_stored":95055872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53455880192,"internally_reserved":0,"allocated":96993280,"data_stored":96993280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53441835008,"internally_reserved":0,"allocated":111038464,"data_stored":111038464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53447151616,"internally_reserved":0,"allocated":105721856,"data_stored":105721856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53457686528,"internally_reserved":0,"allocated":95186944,"data_stored":95186944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53455749120,"internally_reserved":0,"allocated":97124352,"data_stored":97124352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:45:59.989 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:45:59.988873+0000 min lat: 0.0255907 max lat: 1.45742 avg lat: 0.210958 2024-09-11T14:45:59.989 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:45:59.989 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 20 16 1520 1504 4.69956 4.4375 0.180207 0.210958 2024-09-11T14:46:00.446 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:46:00.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:00.613+0000 7f2bf5aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:00.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:00.620+0000 7f2bf5aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:00.989 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 21 16 1598 1582 4.70789 4.875 0.0550676 0.211037 2024-09-11T14:46:01.989 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 22 16 1672 1656 4.7041 4.625 0.11677 0.210905 2024-09-11T14:46:02.989 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 23 16 1738 1722 4.67891 4.125 0.157031 0.211885 2024-09-11T14:46:03.295 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:46:03.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:03.450+0000 7f0a934d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:03.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:03.458+0000 7f0a934d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:03.989 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 24 16 1802 1786 4.65061 4 0.088821 0.213419 2024-09-11T14:46:04.180 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:46:04.180 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:46:04.180 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:46:04.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:04.320+0000 7f434787d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:04.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:04.336+0000 7f434787d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:04.670 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:46:04.671 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:46:04.689 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":365,"stamp":"2024-09-11T14:46:03.348287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":94306867,"num_objects":1434,"num_object_clones":0,"num_object_copies":4302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1511,"num_write_kb":92628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1485,"ondisk_log_size":1485,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":548712,"kb_used_data":548712,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208642200,"statfs":{"total":214211493888,"available":213649612800,"internally_reserved":0,"allocated":561881088,"data_stored":561881088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27525120,"num_objects":420,"num_object_clones":0,"num_object_copies":1260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":420,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001726"},"pg_stats":[{"pgid":"6.f","version":"71'88","reported_seq":112,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:58.013231+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:45:58.013231+0000","last_peered":"2024-09-11T14:45:58.013231+0000","last_clean":"2024-09-11T14:45:58.013231+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:45:58.013231+0000","last_undegraded":"2024-09-11T14:45:58.013231+0000","last_fullsized":"2024-09-11T14:45:58.013231+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"71'90","reported_seq":114,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:57.418468+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:45:57.418468+0000","last_peered":"2024-09-11T14:45:57.418468+0000","last_clean":"2024-09-11T14:45:57.418468+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:45:57.418468+0000","last_undegraded":"2024-09-11T14:45:57.418468+0000","last_fullsized":"2024-09-11T14:45:57.418468+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"71'90","reported_seq":114,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:58.170092+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:45:58.170092+0000","last_peered":"2024-09-11T14:45:58.170092+0000","last_clean":"2024-09-11T14:45:58.170092+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:45:58.170092+0000","last_undegraded":"2024-09-11T14:45:58.170092+0000","last_fullsized":"2024-09-11T14:45:58.170092+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"71'93","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:59.361035+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:45:59.361035+0000","last_peered":"2024-09-11T14:45:59.361035+0000","last_clean":"2024-09-11T14:45:59.361035+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:45:59.361035+0000","last_undegraded":"2024-09-11T14:45:59.361035+0000","last_fullsized":"2024-09-11T14:45:59.361035+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"71'79","reported_seq":103,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:57.577201+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:45:57.577201+0000","last_peered":"2024-09-11T14:45:57.577201+0000","last_clean":"2024-09-11T14:45:57.577201+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:45:57.577201+0000","last_undegraded":"2024-09-11T14:45:57.577201+0000","last_fullsized":"2024-09-11T14:45:57.577201+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"71'92","reported_seq":116,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:58.031393+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:45:58.031393+0000","last_peered":"2024-09-11T14:45:58.031393+0000","last_clean":"2024-09-11T14:45:58.031393+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:45:58.031393+0000","last_undegraded":"2024-09-11T14:45:58.031393+0000","last_fullsized":"2024-09-11T14:45:58.031393+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"71'88","reported_seq":112,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:59.067276+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:45:59.067276+0000","last_peered":"2024-09-11T14:45:59.067276+0000","last_clean":"2024-09-11T14:45:59.067276+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:45:59.067276+0000","last_undegraded":"2024-09-11T14:45:59.067276+0000","last_fullsized":"2024-09-11T14:45:59.067276+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"71'99","reported_seq":123,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:58.295467+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:45:58.295467+0000","last_peered":"2024-09-11T14:45:58.295467+0000","last_clean":"2024-09-11T14:45:58.295467+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:45:58.295467+0000","last_undegraded":"2024-09-11T14:45:58.295467+0000","last_fullsized":"2024-09-11T14:45:58.295467+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"71'89","reported_seq":113,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:57.945515+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:45:57.945515+0000","last_peered":"2024-09-11T14:45:57.945515+0000","last_clean":"2024-09-11T14:45:57.945515+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:45:57.945515+0000","last_undegraded":"2024-09-11T14:45:57.945515+0000","last_fullsized":"2024-09-11T14:45:57.945515+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":253,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:56.951446+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:45:56.951446+0000","last_peered":"2024-09-11T14:45:56.951446+0000","last_clean":"2024-09-11T14:45:56.951446+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:45:56.951446+0000","last_undegraded":"2024-09-11T14:45:56.951446+0000","last_fullsized":"2024-09-11T14:45:56.951446+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":182,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:56.926903+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:45:56.926903+0000","last_peered":"2024-09-11T14:45:56.926903+0000","last_clean":"2024-09-11T14:45:56.926903+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:45:56.926903+0000","last_undegraded":"2024-09-11T14:45:56.926903+0000","last_fullsized":"2024-09-11T14:45:56.926903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"71'90","reported_seq":114,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:59.158507+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:45:59.158507+0000","last_peered":"2024-09-11T14:45:59.158507+0000","last_clean":"2024-09-11T14:45:59.158507+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:45:59.158507+0000","last_undegraded":"2024-09-11T14:45:59.158507+0000","last_fullsized":"2024-09-11T14:45:59.158507+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:57.322118+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:45:57.322118+0000","last_peered":"2024-09-11T14:45:57.322118+0000","last_clean":"2024-09-11T14:45:57.322118+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:45:57.322118+0000","last_undegraded":"2024-09-11T14:45:57.322118+0000","last_fullsized":"2024-09-11T14:45:57.322118+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"71'87","reported_seq":111,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:58.291893+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:45:58.291893+0000","last_peered":"2024-09-11T14:45:58.291893+0000","last_clean":"2024-09-11T14:45:58.291893+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:45:58.291893+0000","last_undegraded":"2024-09-11T14:45:58.291893+0000","last_fullsized":"2024-09-11T14:45:58.291893+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:56.921530+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:45:56.921530+0000","last_peered":"2024-09-11T14:45:56.921530+0000","last_clean":"2024-09-11T14:45:56.921530+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:45:56.921530+0000","last_undegraded":"2024-09-11T14:45:56.921530+0000","last_fullsized":"2024-09-11T14:45:56.921530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"71'89","reported_seq":113,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:59.198420+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:45:59.198420+0000","last_peered":"2024-09-11T14:45:59.198420+0000","last_clean":"2024-09-11T14:45:59.198420+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:45:59.198420+0000","last_undegraded":"2024-09-11T14:45:59.198420+0000","last_fullsized":"2024-09-11T14:45:59.198420+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":183,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:57.318088+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:45:57.318088+0000","last_peered":"2024-09-11T14:45:57.318088+0000","last_clean":"2024-09-11T14:45:57.318088+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:45:57.318088+0000","last_undegraded":"2024-09-11T14:45:57.318088+0000","last_fullsized":"2024-09-11T14:45:57.318088+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"71'93","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:58.267734+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:45:58.267734+0000","last_peered":"2024-09-11T14:45:58.267734+0000","last_clean":"2024-09-11T14:45:58.267734+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:45:58.267734+0000","last_undegraded":"2024-09-11T14:45:58.267734+0000","last_fullsized":"2024-09-11T14:45:58.267734+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:57.162009+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:45:57.162009+0000","last_peered":"2024-09-11T14:45:57.162009+0000","last_clean":"2024-09-11T14:45:57.162009+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:45:57.162009+0000","last_undegraded":"2024-09-11T14:45:57.162009+0000","last_fullsized":"2024-09-11T14:45:57.162009+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"71'100","reported_seq":124,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:58.069212+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:45:58.069212+0000","last_peered":"2024-09-11T14:45:58.069212+0000","last_clean":"2024-09-11T14:45:58.069212+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:45:58.069212+0000","last_undegraded":"2024-09-11T14:45:58.069212+0000","last_fullsized":"2024-09-11T14:45:58.069212+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:56.958259+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:45:56.958259+0000","last_peered":"2024-09-11T14:45:56.958259+0000","last_clean":"2024-09-11T14:45:56.958259+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:45:56.958259+0000","last_undegraded":"2024-09-11T14:45:56.958259+0000","last_fullsized":"2024-09-11T14:45:56.958259+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"71'89","reported_seq":113,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:58.227423+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:45:58.227423+0000","last_peered":"2024-09-11T14:45:58.227423+0000","last_clean":"2024-09-11T14:45:58.227423+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:45:58.227423+0000","last_undegraded":"2024-09-11T14:45:58.227423+0000","last_fullsized":"2024-09-11T14:45:58.227423+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:57.156519+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:45:57.156519+0000","last_peered":"2024-09-11T14:45:57.156519+0000","last_clean":"2024-09-11T14:45:57.156519+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:45:57.156519+0000","last_undegraded":"2024-09-11T14:45:57.156519+0000","last_fullsized":"2024-09-11T14:45:57.156519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"71'74","reported_seq":98,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:57.848144+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:45:57.848144+0000","last_peered":"2024-09-11T14:45:57.848144+0000","last_clean":"2024-09-11T14:45:57.848144+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:45:57.848144+0000","last_undegraded":"2024-09-11T14:45:57.848144+0000","last_fullsized":"2024-09-11T14:45:57.848144+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T14:45:56.929902+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:45:56.929902+0000","last_peered":"2024-09-11T14:45:56.929902+0000","last_clean":"2024-09-11T14:45:56.929902+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:45:56.929902+0000","last_undegraded":"2024-09-11T14:45:56.929902+0000","last_fullsized":"2024-09-11T14:45:56.929902+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":93716480,"num_objects":1430,"num_object_clones":0,"num_object_copies":4290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1430,"num_write_kb":91520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213638819840,"internally_reserved":0,"allocated":572674048,"data_stored":572674048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1430,"ondisk_log_size":1430,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213638819840,"internally_reserved":0,"allocated":572674048,"data_stored":572674048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53418340352,"internally_reserved":0,"allocated":134533120,"data_stored":134533120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673554,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":127524,"kb_used_data":127524,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52170204,"statfs":{"total":53552873472,"available":53422288896,"internally_reserved":0,"allocated":130584576,"data_stored":130584576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":128296,"kb_used_data":128296,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52169432,"statfs":{"total":53552873472,"available":53421498368,"internally_reserved":0,"allocated":131375104,"data_stored":131375104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":149820,"kb_used_data":149820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52147908,"statfs":{"total":53552873472,"available":53399457792,"internally_reserved":0,"allocated":153415680,"data_stored":153415680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":143072,"kb_used_data":143072,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52154656,"statfs":{"total":53552873472,"available":53406367744,"internally_reserved":0,"allocated":146505728,"data_stored":146505728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53418340352,"internally_reserved":0,"allocated":134533120,"data_stored":134533120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53397471232,"internally_reserved":0,"allocated":155402240,"data_stored":155402240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53402443776,"internally_reserved":0,"allocated":150429696,"data_stored":150429696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53420564480,"internally_reserved":0,"allocated":132308992,"data_stored":132308992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53418340352,"internally_reserved":0,"allocated":134533120,"data_stored":134533120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53397471232,"internally_reserved":0,"allocated":155402240,"data_stored":155402240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53402443776,"internally_reserved":0,"allocated":150429696,"data_stored":150429696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53420564480,"internally_reserved":0,"allocated":132308992,"data_stored":132308992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53418340352,"internally_reserved":0,"allocated":134533120,"data_stored":134533120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:46:04.989 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 25 16 1877 1861 4.65207 4.6875 0.0728191 0.213619 2024-09-11T14:46:05.989 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 26 16 1953 1937 4.65582 4.75 0.1752 0.213738 2024-09-11T14:46:06.093 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:46:06.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:06.230+0000 7f9fd66fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:06.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:06.240+0000 7f9fd66fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:06.989 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 27 16 2016 2000 4.6292 3.9375 0.2251 0.214644 2024-09-11T14:46:07.990 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 28 16 2095 2079 4.64019 4.9375 0.189431 0.214451 2024-09-11T14:46:08.925 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:46:08.990 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 29 16 2170 2154 4.64181 4.6875 0.130821 0.214556 2024-09-11T14:46:09.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:09.085+0000 7f7d75391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:09.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:09.093+0000 7f7d75391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:09.691 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:46:09.691 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:46:09.691 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:46:09.691 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:46:09.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:09.838+0000 7f34a6aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:09.855+0000 7f34a6aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:09.990 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 30 16 2252 2236 4.6579 5.125 0.269868 0.213417 2024-09-11T14:46:10.002 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:46:10.002 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:46:10.002 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:46:10.002 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:46:10.003 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:46:10.003 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:46:10.003 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:46:10.003 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:46:10.003 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:46:10.003 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:46:10.003 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:46:10.003 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:46:10.005 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:46:10.006 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:46:10.006 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:46:10.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:10.163+0000 7f293eb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:10.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:10.174+0000 7f293eb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:10.328 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:46:10.329 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:46:10.329 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:46:10.329 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:46:10.329 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:46:10.329 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:46:10.329 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:46:10.329 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:46:10.329 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:46:10.329 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:46:10.329 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:46:10.329 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:46:10.333 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:46:10.333 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:46:10.333 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:46:10.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:10.505+0000 7fb49f288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:10.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:10.524+0000 7fb49f288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:10.708 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:46:10.708 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:46:10.709 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:46:10.709 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:46:10.709 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:46:10.709 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:46:10.709 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:46:10.709 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:46:10.710 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:46:10.710 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:46:10.710 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:46:10.710 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:46:10.712 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:46:10.713 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:46:10.713 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:46:10.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:10.883+0000 7fdb28351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:10.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:10.897+0000 7fdb28351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:10.990 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 31 16 2333 2317 4.67094 5.0625 0.0738474 0.213182 2024-09-11T14:46:11.124 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:46:11.125 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:46:11.125 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:46:11.125 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:46:11.125 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:46:11.125 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:46:11.125 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:46:11.125 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:46:11.125 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:46:11.128 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:46:11.129 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:46:11.129 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:46:11.130 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:46:11.130 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:46:11.930 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:46:11.990 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 32 16 2425 2409 4.70464 5.75 0.13608 0.211508 2024-09-11T14:46:12.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:12.070+0000 7f2fca791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:12.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:12.079+0000 7f2fca791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:12.990 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 33 16 2501 2485 4.706 4.75 0.154952 0.211181 2024-09-11T14:46:13.990 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 34 16 2582 2566 4.71647 5.0625 0.0896273 0.211017 2024-09-11T14:46:14.719 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:46:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:14.870+0000 7f3789f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:14.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:14.877+0000 7f3789f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:14.990 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 35 16 2661 2645 4.72278 4.9375 0.112398 0.210601 2024-09-11T14:46:15.990 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 36 16 2727 2711 4.70616 4.125 0.241798 0.210233 2024-09-11T14:46:16.132 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:46:16.132 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:46:16.132 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:46:16.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:16.296+0000 7f15bd911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:16.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:16.310+0000 7f15bd911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:16.640 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:46:16.640 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:46:16.658 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":371,"stamp":"2024-09-11T14:46:15.350894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":168231475,"num_objects":2562,"num_object_clones":0,"num_object_copies":7686,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2639,"num_write_kb":164820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2613,"ondisk_log_size":2613,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":984520,"kb_used_data":984520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208206392,"statfs":{"total":214211493888,"available":213203345408,"internally_reserved":0,"allocated":1008148480,"data_stored":1008148480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":73924608,"num_objects":1128,"num_object_clones":0,"num_object_copies":3384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":72192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002606"},"pg_stats":[{"pgid":"6.f","version":"72'143","reported_seq":170,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:12.999317+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:46:12.999317+0000","last_peered":"2024-09-11T14:46:12.999317+0000","last_clean":"2024-09-11T14:46:12.999317+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:46:12.999317+0000","last_undegraded":"2024-09-11T14:46:12.999317+0000","last_fullsized":"2024-09-11T14:46:12.999317+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9371648,"num_objects":143,"num_object_clones":0,"num_object_copies":429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":9152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"72'161","reported_seq":188,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:13.164753+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:46:13.164753+0000","last_peered":"2024-09-11T14:46:13.164753+0000","last_clean":"2024-09-11T14:46:13.164753+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:46:13.164753+0000","last_undegraded":"2024-09-11T14:46:13.164753+0000","last_fullsized":"2024-09-11T14:46:13.164753+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"72'150","reported_seq":177,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:12.695150+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:46:12.695150+0000","last_peered":"2024-09-11T14:46:12.695150+0000","last_clean":"2024-09-11T14:46:12.695150+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:46:12.695150+0000","last_undegraded":"2024-09-11T14:46:12.695150+0000","last_fullsized":"2024-09-11T14:46:12.695150+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":9600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"72'168","reported_seq":195,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:14.168122+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:46:14.168122+0000","last_peered":"2024-09-11T14:46:14.168122+0000","last_clean":"2024-09-11T14:46:14.168122+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:46:14.168122+0000","last_undegraded":"2024-09-11T14:46:14.168122+0000","last_fullsized":"2024-09-11T14:46:14.168122+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11010048,"num_objects":168,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":10752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"72'156","reported_seq":183,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:13.242366+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:46:13.242366+0000","last_peered":"2024-09-11T14:46:13.242366+0000","last_clean":"2024-09-11T14:46:13.242366+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:46:13.242366+0000","last_undegraded":"2024-09-11T14:46:13.242366+0000","last_fullsized":"2024-09-11T14:46:13.242366+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":9984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"72'184","reported_seq":211,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:13.419502+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:46:13.419502+0000","last_peered":"2024-09-11T14:46:13.419502+0000","last_clean":"2024-09-11T14:46:13.419502+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:46:13.419502+0000","last_undegraded":"2024-09-11T14:46:13.419502+0000","last_fullsized":"2024-09-11T14:46:13.419502+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12058624,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":11776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"72'154","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:14.287295+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:46:14.287295+0000","last_peered":"2024-09-11T14:46:14.287295+0000","last_clean":"2024-09-11T14:46:14.287295+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:46:14.287295+0000","last_undegraded":"2024-09-11T14:46:14.287295+0000","last_fullsized":"2024-09-11T14:46:14.287295+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":9856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"72'160","reported_seq":187,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:12.887359+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:46:12.887359+0000","last_peered":"2024-09-11T14:46:12.887359+0000","last_clean":"2024-09-11T14:46:12.887359+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:46:12.887359+0000","last_undegraded":"2024-09-11T14:46:12.887359+0000","last_fullsized":"2024-09-11T14:46:12.887359+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":160,"num_object_clones":0,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"72'166","reported_seq":193,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:13.293827+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:46:13.293827+0000","last_peered":"2024-09-11T14:46:13.293827+0000","last_clean":"2024-09-11T14:46:13.293827+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:46:13.293827+0000","last_undegraded":"2024-09-11T14:46:13.293827+0000","last_fullsized":"2024-09-11T14:46:13.293827+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":10624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":256,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.971313+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:46:01.971313+0000","last_peered":"2024-09-11T14:46:01.971313+0000","last_clean":"2024-09-11T14:46:01.971313+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:46:01.971313+0000","last_undegraded":"2024-09-11T14:46:01.971313+0000","last_fullsized":"2024-09-11T14:46:01.971313+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":185,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.922981+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:46:01.922981+0000","last_peered":"2024-09-11T14:46:01.922981+0000","last_clean":"2024-09-11T14:46:01.922981+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:46:01.922981+0000","last_undegraded":"2024-09-11T14:46:01.922981+0000","last_fullsized":"2024-09-11T14:46:01.922981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"72'153","reported_seq":180,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:14.145496+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:46:14.145496+0000","last_peered":"2024-09-11T14:46:14.145496+0000","last_clean":"2024-09-11T14:46:14.145496+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:46:14.145496+0000","last_undegraded":"2024-09-11T14:46:14.145496+0000","last_fullsized":"2024-09-11T14:46:14.145496+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.046064+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:46:02.046064+0000","last_peered":"2024-09-11T14:46:02.046064+0000","last_clean":"2024-09-11T14:46:02.046064+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:46:02.046064+0000","last_undegraded":"2024-09-11T14:46:02.046064+0000","last_fullsized":"2024-09-11T14:46:02.046064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"72'162","reported_seq":189,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:13.422879+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:46:13.422879+0000","last_peered":"2024-09-11T14:46:13.422879+0000","last_clean":"2024-09-11T14:46:13.422879+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:46:13.422879+0000","last_undegraded":"2024-09-11T14:46:13.422879+0000","last_fullsized":"2024-09-11T14:46:13.422879+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10616832,"num_objects":162,"num_object_clones":0,"num_object_copies":486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":10368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.918227+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:46:01.918227+0000","last_peered":"2024-09-11T14:46:01.918227+0000","last_clean":"2024-09-11T14:46:01.918227+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:46:01.918227+0000","last_undegraded":"2024-09-11T14:46:01.918227+0000","last_fullsized":"2024-09-11T14:46:01.918227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"72'166","reported_seq":193,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:13.652626+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:46:13.652626+0000","last_peered":"2024-09-11T14:46:13.652626+0000","last_clean":"2024-09-11T14:46:13.652626+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:46:13.652626+0000","last_undegraded":"2024-09-11T14:46:13.652626+0000","last_fullsized":"2024-09-11T14:46:13.652626+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":10624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":186,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.036830+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:46:02.036830+0000","last_peered":"2024-09-11T14:46:02.036830+0000","last_clean":"2024-09-11T14:46:02.036830+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:46:02.036830+0000","last_undegraded":"2024-09-11T14:46:02.036830+0000","last_fullsized":"2024-09-11T14:46:02.036830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"72'158","reported_seq":185,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:13.014881+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:46:13.014881+0000","last_peered":"2024-09-11T14:46:13.014881+0000","last_clean":"2024-09-11T14:46:13.014881+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:46:13.014881+0000","last_undegraded":"2024-09-11T14:46:13.014881+0000","last_fullsized":"2024-09-11T14:46:13.014881+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10354688,"num_objects":158,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":10112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.018704+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:46:02.018704+0000","last_peered":"2024-09-11T14:46:02.018704+0000","last_clean":"2024-09-11T14:46:02.018704+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:46:02.018704+0000","last_undegraded":"2024-09-11T14:46:02.018704+0000","last_fullsized":"2024-09-11T14:46:02.018704+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"72'178","reported_seq":205,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:13.394865+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:46:13.394865+0000","last_peered":"2024-09-11T14:46:13.394865+0000","last_clean":"2024-09-11T14:46:13.394865+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:46:13.394865+0000","last_undegraded":"2024-09-11T14:46:13.394865+0000","last_fullsized":"2024-09-11T14:46:13.394865+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11665408,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":11392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.978106+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:01.978106+0000","last_peered":"2024-09-11T14:46:01.978106+0000","last_clean":"2024-09-11T14:46:01.978106+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:46:01.978106+0000","last_undegraded":"2024-09-11T14:46:01.978106+0000","last_fullsized":"2024-09-11T14:46:01.978106+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"72'161","reported_seq":188,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:13.106697+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:46:13.106697+0000","last_peered":"2024-09-11T14:46:13.106697+0000","last_clean":"2024-09-11T14:46:13.106697+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:46:13.106697+0000","last_undegraded":"2024-09-11T14:46:13.106697+0000","last_fullsized":"2024-09-11T14:46:13.106697+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.013318+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:02.013318+0000","last_peered":"2024-09-11T14:46:02.013318+0000","last_clean":"2024-09-11T14:46:02.013318+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:46:02.013318+0000","last_undegraded":"2024-09-11T14:46:02.013318+0000","last_fullsized":"2024-09-11T14:46:02.013318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"72'138","reported_seq":165,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:13.071276+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:46:13.071276+0000","last_peered":"2024-09-11T14:46:13.071276+0000","last_clean":"2024-09-11T14:46:13.071276+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:46:13.071276+0000","last_undegraded":"2024-09-11T14:46:13.071276+0000","last_fullsized":"2024-09-11T14:46:13.071276+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.923625+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:46:01.923625+0000","last_peered":"2024-09-11T14:46:01.923625+0000","last_clean":"2024-09-11T14:46:01.923625+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:46:01.923625+0000","last_undegraded":"2024-09-11T14:46:01.923625+0000","last_fullsized":"2024-09-11T14:46:01.923625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":167641088,"num_objects":2558,"num_object_clones":0,"num_object_copies":7674,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2558,"num_write_kb":163712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213193412608,"internally_reserved":0,"allocated":1018081280,"data_stored":1018081280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2558,"ondisk_log_size":2558,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213193674752,"internally_reserved":0,"allocated":1017819136,"data_stored":1017819136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53318365184,"internally_reserved":0,"allocated":234508288,"data_stored":234508288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673569,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":225020,"kb_used_data":225020,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52072708,"statfs":{"total":53552873472,"available":53322452992,"internally_reserved":0,"allocated":230420480,"data_stored":230420480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706273,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":229140,"kb_used_data":229140,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52068588,"statfs":{"total":53552873472,"available":53318234112,"internally_reserved":0,"allocated":234639360,"data_stored":234639360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706273,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":268128,"kb_used_data":268128,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52029600,"statfs":{"total":53552873472,"available":53278310400,"internally_reserved":0,"allocated":274563072,"data_stored":274563072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706273,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":262232,"kb_used_data":262232,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52035496,"statfs":{"total":53552873472,"available":53284347904,"internally_reserved":0,"allocated":268525568,"data_stored":268525568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53318365184,"internally_reserved":0,"allocated":234508288,"data_stored":234508288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53276995584,"internally_reserved":0,"allocated":275877888,"data_stored":275877888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53280751616,"internally_reserved":0,"allocated":272121856,"data_stored":272121856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53317562368,"internally_reserved":0,"allocated":235311104,"data_stored":235311104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53318365184,"internally_reserved":0,"allocated":234508288,"data_stored":234508288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53276733440,"internally_reserved":0,"allocated":276140032,"data_stored":276140032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53280751616,"internally_reserved":0,"allocated":272121856,"data_stored":272121856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53317562368,"internally_reserved":0,"allocated":235311104,"data_stored":235311104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53318365184,"internally_reserved":0,"allocated":234508288,"data_stored":234508288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:46:16.990 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 37 16 2797 2781 4.6972 4.375 0.0725152 0.211432 2024-09-11T14:46:17.578 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:46:17.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:17.699+0000 7f7fc8488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:17.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:17.706+0000 7f7fc8488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:17.991 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 38 16 2862 2846 4.68048 4.0625 0.0757776 0.212409 2024-09-11T14:46:18.991 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 39 16 2930 2914 4.66943 4.25 0.0412354 0.212789 2024-09-11T14:46:19.991 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:46:19.990794+0000 min lat: 0.0255907 max lat: 1.45742 avg lat: 0.213333 2024-09-11T14:46:19.991 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:46:19.991 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 40 16 3002 2986 4.66518 4.5 0.0826987 0.213333 2024-09-11T14:46:20.479 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:46:20.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:20.601+0000 7f6b70111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:20.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:20.608+0000 7f6b70111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:20.991 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 41 16 3059 3043 4.63828 3.5625 0.0787248 0.21414 2024-09-11T14:46:21.660 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:46:21.660 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:46:21.661 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:46:21.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:21.816+0000 7fb372591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:21.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:21.832+0000 7fb372591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:21.991 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 42 16 3127 3111 4.62902 4.25 0.216409 0.215236 2024-09-11T14:46:22.159 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:46:22.160 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:46:22.184 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":374,"stamp":"2024-09-11T14:46:21.352372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":191758899,"num_objects":2921,"num_object_clones":0,"num_object_copies":8763,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2998,"num_write_kb":187796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2972,"ondisk_log_size":2972,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1123400,"kb_used_data":1123400,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208067512,"statfs":{"total":214211493888,"available":213061132288,"internally_reserved":0,"allocated":1150361600,"data_stored":1150361600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":56754176,"num_objects":866,"num_object_clones":0,"num_object_copies":2598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":866,"num_write_kb":55424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002861"},"pg_stats":[{"pgid":"6.f","version":"72'161","reported_seq":188,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:17.765211+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:46:17.765211+0000","last_peered":"2024-09-11T14:46:17.765211+0000","last_clean":"2024-09-11T14:46:17.765211+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:46:17.765211+0000","last_undegraded":"2024-09-11T14:46:17.765211+0000","last_fullsized":"2024-09-11T14:46:17.765211+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"72'179","reported_seq":206,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:18.132762+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:46:18.132762+0000","last_peered":"2024-09-11T14:46:18.132762+0000","last_clean":"2024-09-11T14:46:18.132762+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:46:18.132762+0000","last_undegraded":"2024-09-11T14:46:18.132762+0000","last_fullsized":"2024-09-11T14:46:18.132762+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11730944,"num_objects":179,"num_object_clones":0,"num_object_copies":537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":11456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"72'167","reported_seq":194,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:18.179032+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:46:18.179032+0000","last_peered":"2024-09-11T14:46:18.179032+0000","last_clean":"2024-09-11T14:46:18.179032+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:46:18.179032+0000","last_undegraded":"2024-09-11T14:46:18.179032+0000","last_fullsized":"2024-09-11T14:46:18.179032+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10944512,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":10688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"72'192","reported_seq":219,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:19.349398+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:46:19.349398+0000","last_peered":"2024-09-11T14:46:19.349398+0000","last_clean":"2024-09-11T14:46:19.349398+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:46:19.349398+0000","last_undegraded":"2024-09-11T14:46:19.349398+0000","last_fullsized":"2024-09-11T14:46:19.349398+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"72'173","reported_seq":200,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:17.592171+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:46:17.592171+0000","last_peered":"2024-09-11T14:46:17.592171+0000","last_clean":"2024-09-11T14:46:17.592171+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:46:17.592171+0000","last_undegraded":"2024-09-11T14:46:17.592171+0000","last_fullsized":"2024-09-11T14:46:17.592171+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11337728,"num_objects":173,"num_object_clones":0,"num_object_copies":519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":11072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"72'217","reported_seq":244,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:18.135285+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:46:18.135285+0000","last_peered":"2024-09-11T14:46:18.135285+0000","last_clean":"2024-09-11T14:46:18.135285+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:46:18.135285+0000","last_undegraded":"2024-09-11T14:46:18.135285+0000","last_fullsized":"2024-09-11T14:46:18.135285+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14221312,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":13888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"72'176","reported_seq":203,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:19.148002+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:46:19.148002+0000","last_peered":"2024-09-11T14:46:19.148002+0000","last_clean":"2024-09-11T14:46:19.148002+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:46:19.148002+0000","last_undegraded":"2024-09-11T14:46:19.148002+0000","last_fullsized":"2024-09-11T14:46:19.148002+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":176,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"72'186","reported_seq":213,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:17.357026+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:46:17.357026+0000","last_peered":"2024-09-11T14:46:17.357026+0000","last_clean":"2024-09-11T14:46:17.357026+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:46:17.357026+0000","last_undegraded":"2024-09-11T14:46:17.357026+0000","last_fullsized":"2024-09-11T14:46:17.357026+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":11904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"72'186","reported_seq":213,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:18.019668+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:46:18.019668+0000","last_peered":"2024-09-11T14:46:18.019668+0000","last_clean":"2024-09-11T14:46:18.019668+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:46:18.019668+0000","last_undegraded":"2024-09-11T14:46:18.019668+0000","last_fullsized":"2024-09-11T14:46:18.019668+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":11904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":256,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.971313+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:46:01.971313+0000","last_peered":"2024-09-11T14:46:01.971313+0000","last_clean":"2024-09-11T14:46:01.971313+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:46:01.971313+0000","last_undegraded":"2024-09-11T14:46:01.971313+0000","last_fullsized":"2024-09-11T14:46:01.971313+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":185,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.922981+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:46:01.922981+0000","last_peered":"2024-09-11T14:46:01.922981+0000","last_clean":"2024-09-11T14:46:01.922981+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:46:01.922981+0000","last_undegraded":"2024-09-11T14:46:01.922981+0000","last_fullsized":"2024-09-11T14:46:01.922981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"72'177","reported_seq":204,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:19.373061+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:46:19.373061+0000","last_peered":"2024-09-11T14:46:19.373061+0000","last_clean":"2024-09-11T14:46:19.373061+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:46:19.373061+0000","last_undegraded":"2024-09-11T14:46:19.373061+0000","last_fullsized":"2024-09-11T14:46:19.373061+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11599872,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":11328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.046064+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:46:02.046064+0000","last_peered":"2024-09-11T14:46:02.046064+0000","last_clean":"2024-09-11T14:46:02.046064+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:46:02.046064+0000","last_undegraded":"2024-09-11T14:46:02.046064+0000","last_fullsized":"2024-09-11T14:46:02.046064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"72'184","reported_seq":211,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:17.965508+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:46:17.965508+0000","last_peered":"2024-09-11T14:46:17.965508+0000","last_clean":"2024-09-11T14:46:17.965508+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:46:17.965508+0000","last_undegraded":"2024-09-11T14:46:17.965508+0000","last_fullsized":"2024-09-11T14:46:17.965508+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12058624,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":11776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.918227+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:46:01.918227+0000","last_peered":"2024-09-11T14:46:01.918227+0000","last_clean":"2024-09-11T14:46:01.918227+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:46:01.918227+0000","last_undegraded":"2024-09-11T14:46:01.918227+0000","last_fullsized":"2024-09-11T14:46:01.918227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"72'190","reported_seq":217,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:19.045705+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:46:19.045705+0000","last_peered":"2024-09-11T14:46:19.045705+0000","last_clean":"2024-09-11T14:46:19.045705+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:46:19.045705+0000","last_undegraded":"2024-09-11T14:46:19.045705+0000","last_fullsized":"2024-09-11T14:46:19.045705+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12451840,"num_objects":190,"num_object_clones":0,"num_object_copies":570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":12160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":186,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.036830+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:46:02.036830+0000","last_peered":"2024-09-11T14:46:02.036830+0000","last_clean":"2024-09-11T14:46:02.036830+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:46:02.036830+0000","last_undegraded":"2024-09-11T14:46:02.036830+0000","last_fullsized":"2024-09-11T14:46:02.036830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"72'181","reported_seq":208,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:18.298792+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:46:18.298792+0000","last_peered":"2024-09-11T14:46:18.298792+0000","last_clean":"2024-09-11T14:46:18.298792+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:46:18.298792+0000","last_undegraded":"2024-09-11T14:46:18.298792+0000","last_fullsized":"2024-09-11T14:46:18.298792+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11862016,"num_objects":181,"num_object_clones":0,"num_object_copies":543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":11584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.018704+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:46:02.018704+0000","last_peered":"2024-09-11T14:46:02.018704+0000","last_clean":"2024-09-11T14:46:02.018704+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:46:02.018704+0000","last_undegraded":"2024-09-11T14:46:02.018704+0000","last_fullsized":"2024-09-11T14:46:02.018704+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"72'206","reported_seq":233,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:18.085027+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:46:18.085027+0000","last_peered":"2024-09-11T14:46:18.085027+0000","last_clean":"2024-09-11T14:46:18.085027+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:46:18.085027+0000","last_undegraded":"2024-09-11T14:46:18.085027+0000","last_fullsized":"2024-09-11T14:46:18.085027+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13500416,"num_objects":206,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":13184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.978106+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:01.978106+0000","last_peered":"2024-09-11T14:46:01.978106+0000","last_clean":"2024-09-11T14:46:01.978106+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:46:01.978106+0000","last_undegraded":"2024-09-11T14:46:01.978106+0000","last_fullsized":"2024-09-11T14:46:01.978106+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"72'182","reported_seq":209,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:18.019697+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:46:18.019697+0000","last_peered":"2024-09-11T14:46:18.019697+0000","last_clean":"2024-09-11T14:46:18.019697+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:46:18.019697+0000","last_undegraded":"2024-09-11T14:46:18.019697+0000","last_fullsized":"2024-09-11T14:46:18.019697+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927552,"num_objects":182,"num_object_clones":0,"num_object_copies":546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":11648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.013318+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:02.013318+0000","last_peered":"2024-09-11T14:46:02.013318+0000","last_clean":"2024-09-11T14:46:02.013318+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:46:02.013318+0000","last_undegraded":"2024-09-11T14:46:02.013318+0000","last_fullsized":"2024-09-11T14:46:02.013318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"72'160","reported_seq":187,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:18.230692+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:46:18.230692+0000","last_peered":"2024-09-11T14:46:18.230692+0000","last_clean":"2024-09-11T14:46:18.230692+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:46:18.230692+0000","last_undegraded":"2024-09-11T14:46:18.230692+0000","last_fullsized":"2024-09-11T14:46:18.230692+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":160,"num_object_clones":0,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.923625+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:46:01.923625+0000","last_peered":"2024-09-11T14:46:01.923625+0000","last_clean":"2024-09-11T14:46:01.923625+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:46:01.923625+0000","last_undegraded":"2024-09-11T14:46:01.923625+0000","last_fullsized":"2024-09-11T14:46:01.923625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":191168512,"num_objects":2917,"num_object_clones":0,"num_object_copies":8751,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2917,"num_write_kb":186688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213051645952,"internally_reserved":0,"allocated":1159847936,"data_stored":1159847936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2917,"ondisk_log_size":2917,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213051645952,"internally_reserved":0,"allocated":1159847936,"data_stored":1159847936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53287596032,"internally_reserved":0,"allocated":265277440,"data_stored":265277440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673574,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":255452,"kb_used_data":255452,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52042276,"statfs":{"total":53552873472,"available":53291290624,"internally_reserved":0,"allocated":261582848,"data_stored":261582848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706278,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":262624,"kb_used_data":262624,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52035104,"statfs":{"total":53552873472,"available":53283946496,"internally_reserved":0,"allocated":268926976,"data_stored":268926976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706278,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":306068,"kb_used_data":306068,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51991660,"statfs":{"total":53552873472,"available":53239459840,"internally_reserved":0,"allocated":313413632,"data_stored":313413632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706278,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":299256,"kb_used_data":299256,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51998472,"statfs":{"total":53552873472,"available":53246435328,"internally_reserved":0,"allocated":306438144,"data_stored":306438144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53287596032,"internally_reserved":0,"allocated":265277440,"data_stored":265277440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53238525952,"internally_reserved":0,"allocated":314347520,"data_stored":314347520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53242494976,"internally_reserved":0,"allocated":310378496,"data_stored":310378496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53283028992,"internally_reserved":0,"allocated":269844480,"data_stored":269844480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53287596032,"internally_reserved":0,"allocated":265277440,"data_stored":265277440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53238525952,"internally_reserved":0,"allocated":314347520,"data_stored":314347520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53242494976,"internally_reserved":0,"allocated":310378496,"data_stored":310378496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53283028992,"internally_reserved":0,"allocated":269844480,"data_stored":269844480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53287596032,"internally_reserved":0,"allocated":265277440,"data_stored":265277440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:46:22.991 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 43 16 3195 3179 4.62019 4.25 0.063615 0.215492 2024-09-11T14:46:23.307 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:46:23.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:23.452+0000 7f52d5a7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:23.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:23.461+0000 7f52d5a7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:23.991 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 44 16 3262 3246 4.61035 4.1875 0.440285 0.215998 2024-09-11T14:46:24.991 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 45 16 3334 3318 4.60789 4.5 0.171362 0.216388 2024-09-11T14:46:25.991 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 46 16 3407 3391 4.6069 4.5625 0.0642422 0.216403 2024-09-11T14:46:26.202 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:46:26.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:26.329+0000 7f09aeb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:26.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:26.338+0000 7f09aeb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:26.992 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 47 16 3485 3469 4.61259 4.875 0.347007 0.216167 2024-09-11T14:46:27.189 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:46:27.189 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:46:27.189 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:46:27.189 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:46:27.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:27.340+0000 7f4ce46d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:27.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:27.358+0000 7f4ce46d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:27.386 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:46:27.386 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:46:27.386 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:46:27.386 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:46:27.387 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:46:27.387 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:46:27.387 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:46:27.387 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:46:27.387 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:46:27.387 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:46:27.387 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:46:27.387 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:46:27.391 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:46:27.391 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:46:27.391 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:46:27.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:27.555+0000 7f196a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:27.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:27.567+0000 7f196a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:27.734 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:46:27.734 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:46:27.735 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:46:27.735 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:46:27.735 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:46:27.735 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:46:27.735 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:46:27.735 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:46:27.735 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:46:27.735 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:46:27.735 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:46:27.735 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:46:27.738 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:46:27.738 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:46:27.738 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:46:27.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:27.876+0000 7fcdefa7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:27.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:27.894+0000 7fcdefa7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:27.992 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 48 16 3541 3525 4.58941 3.5 0.076695 0.217071 2024-09-11T14:46:28.130 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:46:28.130 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:46:28.130 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:46:28.130 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:46:28.130 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:46:28.130 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:46:28.130 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:46:28.131 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:46:28.131 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:46:28.131 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:46:28.131 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:46:28.131 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:46:28.134 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:46:28.135 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:46:28.135 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:46:28.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:28.263+0000 7f1528791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:28.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:28.274+0000 7f1528791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:28.509 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:46:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:46:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:46:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:46:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:46:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:46:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:46:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:46:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:46:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:46:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:46:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:46:28.514 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:46:28.514 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:46:28.992 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 49 16 3607 3591 4.57992 4.125 0.15861 0.217345 2024-09-11T14:46:29.106 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:46:29.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:29.242+0000 7faed2ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:29.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:29.248+0000 7faed2ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:29.992 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 50 16 3673 3657 4.57081 4.125 0.258969 0.218034 2024-09-11T14:46:30.992 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 51 16 3737 3721 4.55961 4 0.729585 0.218568 2024-09-11T14:46:31.884 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:46:31.992 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 52 16 3797 3781 4.54404 3.75 0.102519 0.219601 2024-09-11T14:46:32.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:32.033+0000 7f1e46311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:32.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:32.040+0000 7f1e46311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:32.992 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 53 16 3853 3837 4.52433 3.5 0.0919306 0.219599 2024-09-11T14:46:33.515 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:46:33.516 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:46:33.516 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:46:33.516 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:46:33.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:33.630+0000 7efd04c63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:33.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:33.641+0000 7efd04c63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:33.661 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:46:33.661 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:46:33.661 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:46:33.661 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:46:33.661 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:46:33.661 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:46:33.661 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:46:33.661 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:46:33.662 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:46:33.662 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:46:33.662 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:46:33.662 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:46:33.664 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:46:33.664 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:46:33.665 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:46:33.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:33.780+0000 7f04b8b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:33.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:33.791+0000 7f04b8b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:33.966 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:46:33.966 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:46:33.966 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:46:33.966 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:46:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:46:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:46:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:46:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:46:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:46:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:46:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:46:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:46:33.969 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:46:33.969 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:46:33.970 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:46:33.992 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 54 16 3907 3891 4.50304 3.375 0.520378 0.221377 2024-09-11T14:46:34.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:34.085+0000 7f9c65f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:34.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:34.095+0000 7f9c65f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:34.115 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:46:34.115 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:46:34.115 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:46:34.115 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:46:34.115 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:46:34.115 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:46:34.115 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:46:34.116 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:46:34.116 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:46:34.116 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:46:34.116 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:46:34.116 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:46:34.118 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:46:34.118 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:46:34.118 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:46:34.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:34.321+0000 7f8324ca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:34.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:34.336+0000 7f8324ca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:34.462 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:46:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:46:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:46:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:46:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:46:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:46:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:46:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:46:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:46:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:46:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:46:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:46:34.466 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:46:34.466 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:46:34.550 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:46:34.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:34.710+0000 7f790dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:34.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:34.719+0000 7f790dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:34.992 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 55 16 3973 3957 4.49616 4.125 0.236227 0.222001 2024-09-11T14:46:35.993 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 56 16 4042 4026 4.49287 4.3125 0.0586267 0.221752 2024-09-11T14:46:36.993 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 57 16 4095 4079 4.47216 3.3125 0.747252 0.222663 2024-09-11T14:46:37.292 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:46:37.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:37.411+0000 7f1e41911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:37.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:37.417+0000 7f1e41911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:37.993 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 58 16 4134 4118 4.43707 2.4375 1.39843 0.223678 2024-09-11T14:46:38.993 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 59 16 4204 4188 4.43601 4.375 0.0860488 0.224312 2024-09-11T14:46:39.467 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:46:39.467 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T14:46:39.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:39.588+0000 7f680a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:39.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:39.602+0000 7f680a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:39.739 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:46:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:39.872+0000 7f4df1f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:39.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:39.880+0000 7f4df1f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:39.933 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T14:46:39.957 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T14:46:39.993 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:46:39.992804+0000 min lat: 0.0255907 max lat: 1.45742 avg lat: 0.225097 2024-09-11T14:46:39.993 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:46:39.993 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 60 16 4264 4248 4.42457 3.75 0.365668 0.225097 2024-09-11T14:46:40.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:40.128+0000 7f35f0b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:40.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:40.146+0000 7f35f0b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:40.934 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T14:46:40.955 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T14:46:40.993 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 61 16 4312 4296 4.40121 3 0.63218 0.226157 2024-09-11T14:46:41.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:41.106+0000 7f1a9e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:41.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:41.123+0000 7f1a9e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:41.946 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T14:46:41.967 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T14:46:41.993 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 62 16 4381 4365 4.39978 4.3125 0.174898 0.226552 2024-09-11T14:46:42.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:42.158+0000 7f2363cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:42.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:42.169+0000 7f2363cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:42.265 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:46:42.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:42.406+0000 7f89c7f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:42.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:42.413+0000 7f89c7f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:42.947 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T14:46:42.966 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T14:46:42.966 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:46:42.993 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 63 16 4440 4424 4.38846 3.6875 0.57569 0.227136 2024-09-11T14:46:43.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:43.123+0000 7f56dad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:43.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:43.136+0000 7f56dad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:43.476 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:46:43.477 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:46:43.493 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":389,"stamp":"2024-09-11T14:46:43.357361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":275382835,"num_objects":4197,"num_object_clones":0,"num_object_copies":12591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4274,"num_write_kb":269460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4248,"ondisk_log_size":4248,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1619304,"kb_used_data":1619304,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207571608,"statfs":{"total":214211493888,"available":212553326592,"internally_reserved":0,"allocated":1658167296,"data_stored":1658167296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000789"},"pg_stats":[{"pgid":"6.f","version":"72'222","reported_seq":249,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:36.721613+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:46:36.721613+0000","last_peered":"2024-09-11T14:46:36.721613+0000","last_clean":"2024-09-11T14:46:36.721613+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:46:36.721613+0000","last_undegraded":"2024-09-11T14:46:36.721613+0000","last_fullsized":"2024-09-11T14:46:36.721613+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14548992,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":14208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"72'258","reported_seq":285,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:37.127994+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:46:37.127994+0000","last_peered":"2024-09-11T14:46:37.127994+0000","last_clean":"2024-09-11T14:46:37.127994+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:46:37.127994+0000","last_undegraded":"2024-09-11T14:46:37.127994+0000","last_fullsized":"2024-09-11T14:46:37.127994+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"72'240","reported_seq":267,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.099752+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:46:38.099752+0000","last_peered":"2024-09-11T14:46:38.099752+0000","last_clean":"2024-09-11T14:46:38.099752+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:46:38.099752+0000","last_undegraded":"2024-09-11T14:46:38.099752+0000","last_fullsized":"2024-09-11T14:46:38.099752+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"72'277","reported_seq":304,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:39.073050+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:46:39.073050+0000","last_peered":"2024-09-11T14:46:39.073050+0000","last_clean":"2024-09-11T14:46:39.073050+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:46:39.073050+0000","last_undegraded":"2024-09-11T14:46:39.073050+0000","last_fullsized":"2024-09-11T14:46:39.073050+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18153472,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":17728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"72'258","reported_seq":285,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.222099+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:46:38.222099+0000","last_peered":"2024-09-11T14:46:38.222099+0000","last_clean":"2024-09-11T14:46:38.222099+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:46:38.222099+0000","last_undegraded":"2024-09-11T14:46:38.222099+0000","last_fullsized":"2024-09-11T14:46:38.222099+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"72'291","reported_seq":318,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.100876+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:46:38.100876+0000","last_peered":"2024-09-11T14:46:38.100876+0000","last_clean":"2024-09-11T14:46:38.100876+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:46:38.100876+0000","last_undegraded":"2024-09-11T14:46:38.100876+0000","last_fullsized":"2024-09-11T14:46:38.100876+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19070976,"num_objects":291,"num_object_clones":0,"num_object_copies":873,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":18624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"72'258","reported_seq":285,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:39.028199+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:46:39.028199+0000","last_peered":"2024-09-11T14:46:39.028199+0000","last_clean":"2024-09-11T14:46:39.028199+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:46:39.028199+0000","last_undegraded":"2024-09-11T14:46:39.028199+0000","last_fullsized":"2024-09-11T14:46:39.028199+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"72'281","reported_seq":308,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.199722+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:46:38.199722+0000","last_peered":"2024-09-11T14:46:38.199722+0000","last_clean":"2024-09-11T14:46:38.199722+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:46:38.199722+0000","last_undegraded":"2024-09-11T14:46:38.199722+0000","last_fullsized":"2024-09-11T14:46:38.199722+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18415616,"num_objects":281,"num_object_clones":0,"num_object_copies":843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":17984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"72'264","reported_seq":291,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.332194+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:46:38.332194+0000","last_peered":"2024-09-11T14:46:38.332194+0000","last_clean":"2024-09-11T14:46:38.332194+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:46:38.332194+0000","last_undegraded":"2024-09-11T14:46:38.332194+0000","last_fullsized":"2024-09-11T14:46:38.332194+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17301504,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":16896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":256,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.971313+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:46:01.971313+0000","last_peered":"2024-09-11T14:46:01.971313+0000","last_clean":"2024-09-11T14:46:01.971313+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:46:01.971313+0000","last_undegraded":"2024-09-11T14:46:01.971313+0000","last_fullsized":"2024-09-11T14:46:01.971313+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":185,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.922981+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:46:01.922981+0000","last_peered":"2024-09-11T14:46:01.922981+0000","last_clean":"2024-09-11T14:46:01.922981+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:46:01.922981+0000","last_undegraded":"2024-09-11T14:46:01.922981+0000","last_fullsized":"2024-09-11T14:46:01.922981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"72'264","reported_seq":291,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:39.330310+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:46:39.330310+0000","last_peered":"2024-09-11T14:46:39.330310+0000","last_clean":"2024-09-11T14:46:39.330310+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:46:39.330310+0000","last_undegraded":"2024-09-11T14:46:39.330310+0000","last_fullsized":"2024-09-11T14:46:39.330310+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17301504,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":16896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.046064+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:46:02.046064+0000","last_peered":"2024-09-11T14:46:02.046064+0000","last_clean":"2024-09-11T14:46:02.046064+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:46:02.046064+0000","last_undegraded":"2024-09-11T14:46:02.046064+0000","last_fullsized":"2024-09-11T14:46:02.046064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"72'266","reported_seq":293,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:37.944557+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:46:37.944557+0000","last_peered":"2024-09-11T14:46:37.944557+0000","last_clean":"2024-09-11T14:46:37.944557+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:46:37.944557+0000","last_undegraded":"2024-09-11T14:46:37.944557+0000","last_fullsized":"2024-09-11T14:46:37.944557+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17432576,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.918227+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:46:01.918227+0000","last_peered":"2024-09-11T14:46:01.918227+0000","last_clean":"2024-09-11T14:46:01.918227+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:46:01.918227+0000","last_undegraded":"2024-09-11T14:46:01.918227+0000","last_fullsized":"2024-09-11T14:46:01.918227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"72'261","reported_seq":288,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:39.329608+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:46:39.329608+0000","last_peered":"2024-09-11T14:46:39.329608+0000","last_clean":"2024-09-11T14:46:39.329608+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:46:39.329608+0000","last_undegraded":"2024-09-11T14:46:39.329608+0000","last_fullsized":"2024-09-11T14:46:39.329608+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104896,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":16704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":186,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.036830+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:46:02.036830+0000","last_peered":"2024-09-11T14:46:02.036830+0000","last_clean":"2024-09-11T14:46:02.036830+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:46:02.036830+0000","last_undegraded":"2024-09-11T14:46:02.036830+0000","last_fullsized":"2024-09-11T14:46:02.036830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"72'263","reported_seq":290,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:37.863703+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:46:37.863703+0000","last_peered":"2024-09-11T14:46:37.863703+0000","last_clean":"2024-09-11T14:46:37.863703+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:46:37.863703+0000","last_undegraded":"2024-09-11T14:46:37.863703+0000","last_fullsized":"2024-09-11T14:46:37.863703+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17235968,"num_objects":263,"num_object_clones":0,"num_object_copies":789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.018704+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:46:02.018704+0000","last_peered":"2024-09-11T14:46:02.018704+0000","last_clean":"2024-09-11T14:46:02.018704+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:46:02.018704+0000","last_undegraded":"2024-09-11T14:46:02.018704+0000","last_fullsized":"2024-09-11T14:46:02.018704+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"72'283","reported_seq":310,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.349301+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:46:38.349301+0000","last_peered":"2024-09-11T14:46:38.349301+0000","last_clean":"2024-09-11T14:46:38.349301+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:46:38.349301+0000","last_undegraded":"2024-09-11T14:46:38.349301+0000","last_fullsized":"2024-09-11T14:46:38.349301+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.978106+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:01.978106+0000","last_peered":"2024-09-11T14:46:01.978106+0000","last_clean":"2024-09-11T14:46:01.978106+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:46:01.978106+0000","last_undegraded":"2024-09-11T14:46:01.978106+0000","last_fullsized":"2024-09-11T14:46:01.978106+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"72'265","reported_seq":292,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.105418+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:46:38.105418+0000","last_peered":"2024-09-11T14:46:38.105418+0000","last_clean":"2024-09-11T14:46:38.105418+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:46:38.105418+0000","last_undegraded":"2024-09-11T14:46:38.105418+0000","last_fullsized":"2024-09-11T14:46:38.105418+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17367040,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":265,"num_write_kb":16960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.013318+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:02.013318+0000","last_peered":"2024-09-11T14:46:02.013318+0000","last_clean":"2024-09-11T14:46:02.013318+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:46:02.013318+0000","last_undegraded":"2024-09-11T14:46:02.013318+0000","last_fullsized":"2024-09-11T14:46:02.013318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"72'242","reported_seq":269,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:37.113646+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:46:37.113646+0000","last_peered":"2024-09-11T14:46:37.113646+0000","last_clean":"2024-09-11T14:46:37.113646+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:46:37.113646+0000","last_undegraded":"2024-09-11T14:46:37.113646+0000","last_fullsized":"2024-09-11T14:46:37.113646+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859712,"num_objects":242,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":15488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.923625+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:46:01.923625+0000","last_peered":"2024-09-11T14:46:01.923625+0000","last_clean":"2024-09-11T14:46:01.923625+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:46:01.923625+0000","last_undegraded":"2024-09-11T14:46:01.923625+0000","last_fullsized":"2024-09-11T14:46:01.923625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":274792448,"num_objects":4193,"num_object_clones":0,"num_object_copies":12579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4193,"num_write_kb":268352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212544294912,"internally_reserved":0,"allocated":1667198976,"data_stored":1667198976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4193,"ondisk_log_size":4193,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212544950272,"internally_reserved":0,"allocated":1666543616,"data_stored":1666543616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53166604288,"internally_reserved":0,"allocated":386269184,"data_stored":386269184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":373392,"kb_used_data":373392,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51924336,"statfs":{"total":53552873472,"available":53170520064,"internally_reserved":0,"allocated":382353408,"data_stored":382353408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706298,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":377868,"kb_used_data":377868,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51919860,"statfs":{"total":53552873472,"available":53165936640,"internally_reserved":0,"allocated":386936832,"data_stored":386936832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706298,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":438036,"kb_used_data":438036,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51859692,"statfs":{"total":53552873472,"available":53104324608,"internally_reserved":0,"allocated":448548864,"data_stored":448548864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706298,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":430008,"kb_used_data":430008,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51867720,"statfs":{"total":53552873472,"available":53112545280,"internally_reserved":0,"allocated":440328192,"data_stored":440328192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53166604288,"internally_reserved":0,"allocated":386269184,"data_stored":386269184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53103669248,"internally_reserved":0,"allocated":449204224,"data_stored":449204224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53109297152,"internally_reserved":0,"allocated":443576320,"data_stored":443576320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53165379584,"internally_reserved":0,"allocated":387493888,"data_stored":387493888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53166604288,"internally_reserved":0,"allocated":386269184,"data_stored":386269184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53103669248,"internally_reserved":0,"allocated":449204224,"data_stored":449204224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53108903936,"internally_reserved":0,"allocated":443969536,"data_stored":443969536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53165117440,"internally_reserved":0,"allocated":387756032,"data_stored":387756032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53166604288,"internally_reserved":0,"allocated":386269184,"data_stored":386269184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:46:43.495 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:46:43.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:43.691+0000 7f0b33311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:43.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:43.702+0000 7f0b33311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:43.991 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:46:43.992 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:46:43.993 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 64 16 4502 4486 4.38044 3.875 0.533754 0.227535 2024-09-11T14:46:44.014 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":389,"stamp":"2024-09-11T14:46:43.357361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":275382835,"num_objects":4197,"num_object_clones":0,"num_object_copies":12591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4274,"num_write_kb":269460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4248,"ondisk_log_size":4248,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1619304,"kb_used_data":1619304,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207571608,"statfs":{"total":214211493888,"available":212553326592,"internally_reserved":0,"allocated":1658167296,"data_stored":1658167296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000789"},"pg_stats":[{"pgid":"6.f","version":"72'222","reported_seq":249,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:36.721613+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:46:36.721613+0000","last_peered":"2024-09-11T14:46:36.721613+0000","last_clean":"2024-09-11T14:46:36.721613+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:46:36.721613+0000","last_undegraded":"2024-09-11T14:46:36.721613+0000","last_fullsized":"2024-09-11T14:46:36.721613+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14548992,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":14208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"72'258","reported_seq":285,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:37.127994+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:46:37.127994+0000","last_peered":"2024-09-11T14:46:37.127994+0000","last_clean":"2024-09-11T14:46:37.127994+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:46:37.127994+0000","last_undegraded":"2024-09-11T14:46:37.127994+0000","last_fullsized":"2024-09-11T14:46:37.127994+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"72'240","reported_seq":267,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.099752+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:46:38.099752+0000","last_peered":"2024-09-11T14:46:38.099752+0000","last_clean":"2024-09-11T14:46:38.099752+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:46:38.099752+0000","last_undegraded":"2024-09-11T14:46:38.099752+0000","last_fullsized":"2024-09-11T14:46:38.099752+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"72'277","reported_seq":304,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:39.073050+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:46:39.073050+0000","last_peered":"2024-09-11T14:46:39.073050+0000","last_clean":"2024-09-11T14:46:39.073050+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:46:39.073050+0000","last_undegraded":"2024-09-11T14:46:39.073050+0000","last_fullsized":"2024-09-11T14:46:39.073050+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18153472,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":17728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"72'258","reported_seq":285,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.222099+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:46:38.222099+0000","last_peered":"2024-09-11T14:46:38.222099+0000","last_clean":"2024-09-11T14:46:38.222099+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:46:38.222099+0000","last_undegraded":"2024-09-11T14:46:38.222099+0000","last_fullsized":"2024-09-11T14:46:38.222099+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"72'291","reported_seq":318,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.100876+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:46:38.100876+0000","last_peered":"2024-09-11T14:46:38.100876+0000","last_clean":"2024-09-11T14:46:38.100876+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:46:38.100876+0000","last_undegraded":"2024-09-11T14:46:38.100876+0000","last_fullsized":"2024-09-11T14:46:38.100876+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19070976,"num_objects":291,"num_object_clones":0,"num_object_copies":873,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":18624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"72'258","reported_seq":285,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:39.028199+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:46:39.028199+0000","last_peered":"2024-09-11T14:46:39.028199+0000","last_clean":"2024-09-11T14:46:39.028199+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:46:39.028199+0000","last_undegraded":"2024-09-11T14:46:39.028199+0000","last_fullsized":"2024-09-11T14:46:39.028199+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"72'281","reported_seq":308,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.199722+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:46:38.199722+0000","last_peered":"2024-09-11T14:46:38.199722+0000","last_clean":"2024-09-11T14:46:38.199722+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:46:38.199722+0000","last_undegraded":"2024-09-11T14:46:38.199722+0000","last_fullsized":"2024-09-11T14:46:38.199722+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18415616,"num_objects":281,"num_object_clones":0,"num_object_copies":843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":17984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"72'264","reported_seq":291,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.332194+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:46:38.332194+0000","last_peered":"2024-09-11T14:46:38.332194+0000","last_clean":"2024-09-11T14:46:38.332194+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:46:38.332194+0000","last_undegraded":"2024-09-11T14:46:38.332194+0000","last_fullsized":"2024-09-11T14:46:38.332194+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17301504,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":16896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":256,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.971313+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:46:01.971313+0000","last_peered":"2024-09-11T14:46:01.971313+0000","last_clean":"2024-09-11T14:46:01.971313+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:46:01.971313+0000","last_undegraded":"2024-09-11T14:46:01.971313+0000","last_fullsized":"2024-09-11T14:46:01.971313+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":185,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.922981+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:46:01.922981+0000","last_peered":"2024-09-11T14:46:01.922981+0000","last_clean":"2024-09-11T14:46:01.922981+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:46:01.922981+0000","last_undegraded":"2024-09-11T14:46:01.922981+0000","last_fullsized":"2024-09-11T14:46:01.922981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"72'264","reported_seq":291,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:39.330310+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:46:39.330310+0000","last_peered":"2024-09-11T14:46:39.330310+0000","last_clean":"2024-09-11T14:46:39.330310+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:46:39.330310+0000","last_undegraded":"2024-09-11T14:46:39.330310+0000","last_fullsized":"2024-09-11T14:46:39.330310+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17301504,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":16896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.046064+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:46:02.046064+0000","last_peered":"2024-09-11T14:46:02.046064+0000","last_clean":"2024-09-11T14:46:02.046064+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:46:02.046064+0000","last_undegraded":"2024-09-11T14:46:02.046064+0000","last_fullsized":"2024-09-11T14:46:02.046064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"72'266","reported_seq":293,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:37.944557+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:46:37.944557+0000","last_peered":"2024-09-11T14:46:37.944557+0000","last_clean":"2024-09-11T14:46:37.944557+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:46:37.944557+0000","last_undegraded":"2024-09-11T14:46:37.944557+0000","last_fullsized":"2024-09-11T14:46:37.944557+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17432576,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.918227+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:46:01.918227+0000","last_peered":"2024-09-11T14:46:01.918227+0000","last_clean":"2024-09-11T14:46:01.918227+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:46:01.918227+0000","last_undegraded":"2024-09-11T14:46:01.918227+0000","last_fullsized":"2024-09-11T14:46:01.918227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"72'261","reported_seq":288,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:39.329608+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:46:39.329608+0000","last_peered":"2024-09-11T14:46:39.329608+0000","last_clean":"2024-09-11T14:46:39.329608+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:46:39.329608+0000","last_undegraded":"2024-09-11T14:46:39.329608+0000","last_fullsized":"2024-09-11T14:46:39.329608+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104896,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":16704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":186,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.036830+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:46:02.036830+0000","last_peered":"2024-09-11T14:46:02.036830+0000","last_clean":"2024-09-11T14:46:02.036830+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:46:02.036830+0000","last_undegraded":"2024-09-11T14:46:02.036830+0000","last_fullsized":"2024-09-11T14:46:02.036830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"72'263","reported_seq":290,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:37.863703+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:46:37.863703+0000","last_peered":"2024-09-11T14:46:37.863703+0000","last_clean":"2024-09-11T14:46:37.863703+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:46:37.863703+0000","last_undegraded":"2024-09-11T14:46:37.863703+0000","last_fullsized":"2024-09-11T14:46:37.863703+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17235968,"num_objects":263,"num_object_clones":0,"num_object_copies":789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.018704+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:46:02.018704+0000","last_peered":"2024-09-11T14:46:02.018704+0000","last_clean":"2024-09-11T14:46:02.018704+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:46:02.018704+0000","last_undegraded":"2024-09-11T14:46:02.018704+0000","last_fullsized":"2024-09-11T14:46:02.018704+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"72'283","reported_seq":310,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.349301+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:46:38.349301+0000","last_peered":"2024-09-11T14:46:38.349301+0000","last_clean":"2024-09-11T14:46:38.349301+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:46:38.349301+0000","last_undegraded":"2024-09-11T14:46:38.349301+0000","last_fullsized":"2024-09-11T14:46:38.349301+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.978106+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:01.978106+0000","last_peered":"2024-09-11T14:46:01.978106+0000","last_clean":"2024-09-11T14:46:01.978106+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:46:01.978106+0000","last_undegraded":"2024-09-11T14:46:01.978106+0000","last_fullsized":"2024-09-11T14:46:01.978106+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"72'265","reported_seq":292,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.105418+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:46:38.105418+0000","last_peered":"2024-09-11T14:46:38.105418+0000","last_clean":"2024-09-11T14:46:38.105418+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:46:38.105418+0000","last_undegraded":"2024-09-11T14:46:38.105418+0000","last_fullsized":"2024-09-11T14:46:38.105418+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17367040,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":265,"num_write_kb":16960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.013318+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:02.013318+0000","last_peered":"2024-09-11T14:46:02.013318+0000","last_clean":"2024-09-11T14:46:02.013318+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:46:02.013318+0000","last_undegraded":"2024-09-11T14:46:02.013318+0000","last_fullsized":"2024-09-11T14:46:02.013318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"72'242","reported_seq":269,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:37.113646+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:46:37.113646+0000","last_peered":"2024-09-11T14:46:37.113646+0000","last_clean":"2024-09-11T14:46:37.113646+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:46:37.113646+0000","last_undegraded":"2024-09-11T14:46:37.113646+0000","last_fullsized":"2024-09-11T14:46:37.113646+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859712,"num_objects":242,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":15488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.923625+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:46:01.923625+0000","last_peered":"2024-09-11T14:46:01.923625+0000","last_clean":"2024-09-11T14:46:01.923625+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:46:01.923625+0000","last_undegraded":"2024-09-11T14:46:01.923625+0000","last_fullsized":"2024-09-11T14:46:01.923625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":274792448,"num_objects":4193,"num_object_clones":0,"num_object_copies":12579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4193,"num_write_kb":268352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212544294912,"internally_reserved":0,"allocated":1667198976,"data_stored":1667198976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4193,"ondisk_log_size":4193,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212544950272,"internally_reserved":0,"allocated":1666543616,"data_stored":1666543616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53166604288,"internally_reserved":0,"allocated":386269184,"data_stored":386269184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":373392,"kb_used_data":373392,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51924336,"statfs":{"total":53552873472,"available":53170520064,"internally_reserved":0,"allocated":382353408,"data_stored":382353408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706298,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":377868,"kb_used_data":377868,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51919860,"statfs":{"total":53552873472,"available":53165936640,"internally_reserved":0,"allocated":386936832,"data_stored":386936832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706298,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":438036,"kb_used_data":438036,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51859692,"statfs":{"total":53552873472,"available":53104324608,"internally_reserved":0,"allocated":448548864,"data_stored":448548864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706298,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":430008,"kb_used_data":430008,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51867720,"statfs":{"total":53552873472,"available":53112545280,"internally_reserved":0,"allocated":440328192,"data_stored":440328192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53166604288,"internally_reserved":0,"allocated":386269184,"data_stored":386269184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53103669248,"internally_reserved":0,"allocated":449204224,"data_stored":449204224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53109297152,"internally_reserved":0,"allocated":443576320,"data_stored":443576320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53165379584,"internally_reserved":0,"allocated":387493888,"data_stored":387493888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53166604288,"internally_reserved":0,"allocated":386269184,"data_stored":386269184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53103669248,"internally_reserved":0,"allocated":449204224,"data_stored":449204224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53108903936,"internally_reserved":0,"allocated":443969536,"data_stored":443969536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53165117440,"internally_reserved":0,"allocated":387756032,"data_stored":387756032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53166604288,"internally_reserved":0,"allocated":386269184,"data_stored":386269184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:46:44.015 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T14:46:44.015 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:46:44.016 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:46:44.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:44.171+0000 7f64800fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:44.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:44.182+0000 7f64800fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:44.485 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:46:44.485 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:46:44.506 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":389,"stamp":"2024-09-11T14:46:43.357361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":275382835,"num_objects":4197,"num_object_clones":0,"num_object_copies":12591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4274,"num_write_kb":269460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4248,"ondisk_log_size":4248,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1619304,"kb_used_data":1619304,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207571608,"statfs":{"total":214211493888,"available":212553326592,"internally_reserved":0,"allocated":1658167296,"data_stored":1658167296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000789"},"pg_stats":[{"pgid":"6.f","version":"72'222","reported_seq":249,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:36.721613+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:46:36.721613+0000","last_peered":"2024-09-11T14:46:36.721613+0000","last_clean":"2024-09-11T14:46:36.721613+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:46:36.721613+0000","last_undegraded":"2024-09-11T14:46:36.721613+0000","last_fullsized":"2024-09-11T14:46:36.721613+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14548992,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":14208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"72'258","reported_seq":285,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:37.127994+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:46:37.127994+0000","last_peered":"2024-09-11T14:46:37.127994+0000","last_clean":"2024-09-11T14:46:37.127994+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:46:37.127994+0000","last_undegraded":"2024-09-11T14:46:37.127994+0000","last_fullsized":"2024-09-11T14:46:37.127994+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"72'240","reported_seq":267,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.099752+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:46:38.099752+0000","last_peered":"2024-09-11T14:46:38.099752+0000","last_clean":"2024-09-11T14:46:38.099752+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:46:38.099752+0000","last_undegraded":"2024-09-11T14:46:38.099752+0000","last_fullsized":"2024-09-11T14:46:38.099752+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"72'277","reported_seq":304,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:39.073050+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:46:39.073050+0000","last_peered":"2024-09-11T14:46:39.073050+0000","last_clean":"2024-09-11T14:46:39.073050+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:46:39.073050+0000","last_undegraded":"2024-09-11T14:46:39.073050+0000","last_fullsized":"2024-09-11T14:46:39.073050+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18153472,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":17728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"72'258","reported_seq":285,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.222099+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:46:38.222099+0000","last_peered":"2024-09-11T14:46:38.222099+0000","last_clean":"2024-09-11T14:46:38.222099+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:46:38.222099+0000","last_undegraded":"2024-09-11T14:46:38.222099+0000","last_fullsized":"2024-09-11T14:46:38.222099+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"72'291","reported_seq":318,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.100876+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:46:38.100876+0000","last_peered":"2024-09-11T14:46:38.100876+0000","last_clean":"2024-09-11T14:46:38.100876+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:46:38.100876+0000","last_undegraded":"2024-09-11T14:46:38.100876+0000","last_fullsized":"2024-09-11T14:46:38.100876+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19070976,"num_objects":291,"num_object_clones":0,"num_object_copies":873,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":18624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"72'258","reported_seq":285,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:39.028199+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:46:39.028199+0000","last_peered":"2024-09-11T14:46:39.028199+0000","last_clean":"2024-09-11T14:46:39.028199+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:46:39.028199+0000","last_undegraded":"2024-09-11T14:46:39.028199+0000","last_fullsized":"2024-09-11T14:46:39.028199+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"72'281","reported_seq":308,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.199722+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:46:38.199722+0000","last_peered":"2024-09-11T14:46:38.199722+0000","last_clean":"2024-09-11T14:46:38.199722+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:46:38.199722+0000","last_undegraded":"2024-09-11T14:46:38.199722+0000","last_fullsized":"2024-09-11T14:46:38.199722+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18415616,"num_objects":281,"num_object_clones":0,"num_object_copies":843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":17984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"72'264","reported_seq":291,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.332194+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:46:38.332194+0000","last_peered":"2024-09-11T14:46:38.332194+0000","last_clean":"2024-09-11T14:46:38.332194+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:46:38.332194+0000","last_undegraded":"2024-09-11T14:46:38.332194+0000","last_fullsized":"2024-09-11T14:46:38.332194+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17301504,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":16896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":256,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.971313+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:46:01.971313+0000","last_peered":"2024-09-11T14:46:01.971313+0000","last_clean":"2024-09-11T14:46:01.971313+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:46:01.971313+0000","last_undegraded":"2024-09-11T14:46:01.971313+0000","last_fullsized":"2024-09-11T14:46:01.971313+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":185,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.922981+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:46:01.922981+0000","last_peered":"2024-09-11T14:46:01.922981+0000","last_clean":"2024-09-11T14:46:01.922981+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:46:01.922981+0000","last_undegraded":"2024-09-11T14:46:01.922981+0000","last_fullsized":"2024-09-11T14:46:01.922981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"72'264","reported_seq":291,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:39.330310+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:46:39.330310+0000","last_peered":"2024-09-11T14:46:39.330310+0000","last_clean":"2024-09-11T14:46:39.330310+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:46:39.330310+0000","last_undegraded":"2024-09-11T14:46:39.330310+0000","last_fullsized":"2024-09-11T14:46:39.330310+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17301504,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":16896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.046064+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:46:02.046064+0000","last_peered":"2024-09-11T14:46:02.046064+0000","last_clean":"2024-09-11T14:46:02.046064+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:46:02.046064+0000","last_undegraded":"2024-09-11T14:46:02.046064+0000","last_fullsized":"2024-09-11T14:46:02.046064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"72'266","reported_seq":293,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:37.944557+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:46:37.944557+0000","last_peered":"2024-09-11T14:46:37.944557+0000","last_clean":"2024-09-11T14:46:37.944557+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:46:37.944557+0000","last_undegraded":"2024-09-11T14:46:37.944557+0000","last_fullsized":"2024-09-11T14:46:37.944557+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17432576,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.918227+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:46:01.918227+0000","last_peered":"2024-09-11T14:46:01.918227+0000","last_clean":"2024-09-11T14:46:01.918227+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:46:01.918227+0000","last_undegraded":"2024-09-11T14:46:01.918227+0000","last_fullsized":"2024-09-11T14:46:01.918227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"72'261","reported_seq":288,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:39.329608+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:46:39.329608+0000","last_peered":"2024-09-11T14:46:39.329608+0000","last_clean":"2024-09-11T14:46:39.329608+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:46:39.329608+0000","last_undegraded":"2024-09-11T14:46:39.329608+0000","last_fullsized":"2024-09-11T14:46:39.329608+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104896,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":16704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":186,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.036830+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:46:02.036830+0000","last_peered":"2024-09-11T14:46:02.036830+0000","last_clean":"2024-09-11T14:46:02.036830+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:46:02.036830+0000","last_undegraded":"2024-09-11T14:46:02.036830+0000","last_fullsized":"2024-09-11T14:46:02.036830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"72'263","reported_seq":290,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:37.863703+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:46:37.863703+0000","last_peered":"2024-09-11T14:46:37.863703+0000","last_clean":"2024-09-11T14:46:37.863703+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:46:37.863703+0000","last_undegraded":"2024-09-11T14:46:37.863703+0000","last_fullsized":"2024-09-11T14:46:37.863703+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17235968,"num_objects":263,"num_object_clones":0,"num_object_copies":789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.018704+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:46:02.018704+0000","last_peered":"2024-09-11T14:46:02.018704+0000","last_clean":"2024-09-11T14:46:02.018704+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:46:02.018704+0000","last_undegraded":"2024-09-11T14:46:02.018704+0000","last_fullsized":"2024-09-11T14:46:02.018704+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"72'283","reported_seq":310,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.349301+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:46:38.349301+0000","last_peered":"2024-09-11T14:46:38.349301+0000","last_clean":"2024-09-11T14:46:38.349301+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:46:38.349301+0000","last_undegraded":"2024-09-11T14:46:38.349301+0000","last_fullsized":"2024-09-11T14:46:38.349301+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.978106+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:01.978106+0000","last_peered":"2024-09-11T14:46:01.978106+0000","last_clean":"2024-09-11T14:46:01.978106+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:46:01.978106+0000","last_undegraded":"2024-09-11T14:46:01.978106+0000","last_fullsized":"2024-09-11T14:46:01.978106+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"72'265","reported_seq":292,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:38.105418+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:46:38.105418+0000","last_peered":"2024-09-11T14:46:38.105418+0000","last_clean":"2024-09-11T14:46:38.105418+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:46:38.105418+0000","last_undegraded":"2024-09-11T14:46:38.105418+0000","last_fullsized":"2024-09-11T14:46:38.105418+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17367040,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":265,"num_write_kb":16960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:02.013318+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:02.013318+0000","last_peered":"2024-09-11T14:46:02.013318+0000","last_clean":"2024-09-11T14:46:02.013318+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:46:02.013318+0000","last_undegraded":"2024-09-11T14:46:02.013318+0000","last_fullsized":"2024-09-11T14:46:02.013318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"72'242","reported_seq":269,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:37.113646+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:46:37.113646+0000","last_peered":"2024-09-11T14:46:37.113646+0000","last_clean":"2024-09-11T14:46:37.113646+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:46:37.113646+0000","last_undegraded":"2024-09-11T14:46:37.113646+0000","last_fullsized":"2024-09-11T14:46:37.113646+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859712,"num_objects":242,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":15488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T14:46:01.923625+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:46:01.923625+0000","last_peered":"2024-09-11T14:46:01.923625+0000","last_clean":"2024-09-11T14:46:01.923625+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:46:01.923625+0000","last_undegraded":"2024-09-11T14:46:01.923625+0000","last_fullsized":"2024-09-11T14:46:01.923625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":274792448,"num_objects":4193,"num_object_clones":0,"num_object_copies":12579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4193,"num_write_kb":268352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212544294912,"internally_reserved":0,"allocated":1667198976,"data_stored":1667198976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4193,"ondisk_log_size":4193,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212544950272,"internally_reserved":0,"allocated":1666543616,"data_stored":1666543616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53166604288,"internally_reserved":0,"allocated":386269184,"data_stored":386269184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":373392,"kb_used_data":373392,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51924336,"statfs":{"total":53552873472,"available":53170520064,"internally_reserved":0,"allocated":382353408,"data_stored":382353408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706298,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":377868,"kb_used_data":377868,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51919860,"statfs":{"total":53552873472,"available":53165936640,"internally_reserved":0,"allocated":386936832,"data_stored":386936832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706298,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":438036,"kb_used_data":438036,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51859692,"statfs":{"total":53552873472,"available":53104324608,"internally_reserved":0,"allocated":448548864,"data_stored":448548864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706298,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":430008,"kb_used_data":430008,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51867720,"statfs":{"total":53552873472,"available":53112545280,"internally_reserved":0,"allocated":440328192,"data_stored":440328192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53166604288,"internally_reserved":0,"allocated":386269184,"data_stored":386269184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53103669248,"internally_reserved":0,"allocated":449204224,"data_stored":449204224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53109297152,"internally_reserved":0,"allocated":443576320,"data_stored":443576320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53165379584,"internally_reserved":0,"allocated":387493888,"data_stored":387493888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53166604288,"internally_reserved":0,"allocated":386269184,"data_stored":386269184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53103669248,"internally_reserved":0,"allocated":449204224,"data_stored":449204224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53108903936,"internally_reserved":0,"allocated":443969536,"data_stored":443969536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53165117440,"internally_reserved":0,"allocated":387756032,"data_stored":387756032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53166604288,"internally_reserved":0,"allocated":386269184,"data_stored":386269184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:46:44.863 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:46:44.993 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 65 16 4575 4559 4.38323 4.5625 0.104033 0.227637 2024-09-11T14:46:45.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:45.002+0000 7f7f99191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:45.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:45.010+0000 7f7f99191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:45.993 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 66 16 4645 4629 4.3831 4.375 1.04744 0.227502 2024-09-11T14:46:46.994 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 67 16 4707 4691 4.37551 3.875 0.148753 0.227763 2024-09-11T14:46:47.415 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:46:47.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:47.565+0000 7f5dca6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:47.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:47.573+0000 7f5dca6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:47.994 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 68 16 4766 4750 4.36539 3.6875 0.662683 0.228233 2024-09-11T14:46:48.994 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 69 16 4833 4817 4.3628 4.1875 0.349298 0.228486 2024-09-11T14:46:49.508 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:46:49.508 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:46:49.509 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:46:49.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:49.675+0000 7f9e2d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:49.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:49.688+0000 7f9e2d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:49.883 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:46:49.994 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 70 16 4910 4894 4.36922 4.8125 0.229468 0.228321 2024-09-11T14:46:50.064 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:46:50.065 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:46:50.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:50.061+0000 7fe941b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:50.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:50.069+0000 7fe941b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:50.088 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":392,"stamp":"2024-09-11T14:46:49.358529+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":310641203,"num_objects":4735,"num_object_clones":0,"num_object_copies":14205,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4812,"num_write_kb":303892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4786,"ondisk_log_size":4786,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1834648,"kb_used_data":1834648,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207356264,"statfs":{"total":214211493888,"available":212332814336,"internally_reserved":0,"allocated":1878679552,"data_stored":1878679552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":35258368,"num_objects":538,"num_object_clones":0,"num_object_copies":1614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001530"},"pg_stats":[{"pgid":"6.f","version":"76'262","reported_seq":301,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:48.300805+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:46:48.300805+0000","last_peered":"2024-09-11T14:46:48.300805+0000","last_clean":"2024-09-11T14:46:48.300805+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:46:48.300805+0000","last_undegraded":"2024-09-11T14:46:48.300805+0000","last_fullsized":"2024-09-11T14:46:48.300805+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17170432,"num_objects":262,"num_object_clones":0,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":262,"num_write_kb":16768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'289","reported_seq":328,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:48.138870+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:46:48.138870+0000","last_peered":"2024-09-11T14:46:48.138870+0000","last_clean":"2024-09-11T14:46:48.138870+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:46:48.138870+0000","last_undegraded":"2024-09-11T14:46:48.138870+0000","last_fullsized":"2024-09-11T14:46:48.138870+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18939904,"num_objects":289,"num_object_clones":0,"num_object_copies":867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":18496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"76'279","reported_seq":318,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:48.187226+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:46:48.187226+0000","last_peered":"2024-09-11T14:46:48.187226+0000","last_clean":"2024-09-11T14:46:48.187226+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:46:48.187226+0000","last_undegraded":"2024-09-11T14:46:48.187226+0000","last_fullsized":"2024-09-11T14:46:48.187226+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":17856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"76'293","reported_seq":332,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.632601+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:46:43.632601+0000","last_peered":"2024-09-11T14:46:43.632601+0000","last_clean":"2024-09-11T14:46:43.632601+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:46:43.632601+0000","last_undegraded":"2024-09-11T14:46:43.632601+0000","last_fullsized":"2024-09-11T14:46:43.632601+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":18752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"76'303","reported_seq":342,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:48.166586+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:46:48.166586+0000","last_peered":"2024-09-11T14:46:48.166586+0000","last_clean":"2024-09-11T14:46:48.166586+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:46:48.166586+0000","last_undegraded":"2024-09-11T14:46:48.166586+0000","last_fullsized":"2024-09-11T14:46:48.166586+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":19392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'336","reported_seq":375,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:48.065514+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:46:48.065514+0000","last_peered":"2024-09-11T14:46:48.065514+0000","last_clean":"2024-09-11T14:46:48.065514+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:46:48.065514+0000","last_undegraded":"2024-09-11T14:46:48.065514+0000","last_fullsized":"2024-09-11T14:46:48.065514+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":21504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'281","reported_seq":320,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.825511+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:46:43.825511+0000","last_peered":"2024-09-11T14:46:43.825511+0000","last_clean":"2024-09-11T14:46:43.825511+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:46:43.825511+0000","last_undegraded":"2024-09-11T14:46:43.825511+0000","last_fullsized":"2024-09-11T14:46:43.825511+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18415616,"num_objects":281,"num_object_clones":0,"num_object_copies":843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":17984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"76'320","reported_seq":359,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:47.852537+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:46:47.852537+0000","last_peered":"2024-09-11T14:46:47.852537+0000","last_clean":"2024-09-11T14:46:47.852537+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:46:47.852537+0000","last_undegraded":"2024-09-11T14:46:47.852537+0000","last_fullsized":"2024-09-11T14:46:47.852537+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":320,"num_object_clones":0,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'296","reported_seq":335,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:48.339049+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:46:48.339049+0000","last_peered":"2024-09-11T14:46:48.339049+0000","last_clean":"2024-09-11T14:46:48.339049+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:46:48.339049+0000","last_undegraded":"2024-09-11T14:46:48.339049+0000","last_fullsized":"2024-09-11T14:46:48.339049+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19398656,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":18944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":268,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.014461+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:46:43.014461+0000","last_peered":"2024-09-11T14:46:43.014461+0000","last_clean":"2024-09-11T14:46:43.014461+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:46:43.014461+0000","last_undegraded":"2024-09-11T14:46:43.014461+0000","last_fullsized":"2024-09-11T14:46:43.014461+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.021089+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:46:43.021089+0000","last_peered":"2024-09-11T14:46:43.021089+0000","last_clean":"2024-09-11T14:46:43.021089+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:46:43.021089+0000","last_undegraded":"2024-09-11T14:46:43.021089+0000","last_fullsized":"2024-09-11T14:46:43.021089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"76'276","reported_seq":315,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:44.362320+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:46:44.362320+0000","last_peered":"2024-09-11T14:46:44.362320+0000","last_clean":"2024-09-11T14:46:44.362320+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:46:44.362320+0000","last_undegraded":"2024-09-11T14:46:44.362320+0000","last_fullsized":"2024-09-11T14:46:44.362320+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18087936,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":17664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.040945+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:46:43.040945+0000","last_peered":"2024-09-11T14:46:43.040945+0000","last_clean":"2024-09-11T14:46:43.040945+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:46:43.040945+0000","last_undegraded":"2024-09-11T14:46:43.040945+0000","last_fullsized":"2024-09-11T14:46:43.040945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"76'298","reported_seq":337,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:48.235736+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:46:48.235736+0000","last_peered":"2024-09-11T14:46:48.235736+0000","last_clean":"2024-09-11T14:46:48.235736+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:46:48.235736+0000","last_undegraded":"2024-09-11T14:46:48.235736+0000","last_fullsized":"2024-09-11T14:46:48.235736+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19529728,"num_objects":298,"num_object_clones":0,"num_object_copies":894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":19072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.012354+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:46:43.012354+0000","last_peered":"2024-09-11T14:46:43.012354+0000","last_clean":"2024-09-11T14:46:43.012354+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:46:43.012354+0000","last_undegraded":"2024-09-11T14:46:43.012354+0000","last_fullsized":"2024-09-11T14:46:43.012354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"76'279","reported_seq":318,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:44.429573+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:46:44.429573+0000","last_peered":"2024-09-11T14:46:44.429573+0000","last_clean":"2024-09-11T14:46:44.429573+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:46:44.429573+0000","last_undegraded":"2024-09-11T14:46:44.429573+0000","last_fullsized":"2024-09-11T14:46:44.429573+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":17856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.036415+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:46:43.036415+0000","last_peered":"2024-09-11T14:46:43.036415+0000","last_clean":"2024-09-11T14:46:43.036415+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:46:43.036415+0000","last_undegraded":"2024-09-11T14:46:43.036415+0000","last_fullsized":"2024-09-11T14:46:43.036415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'303","reported_seq":342,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:47.557073+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:46:47.557073+0000","last_peered":"2024-09-11T14:46:47.557073+0000","last_clean":"2024-09-11T14:46:47.557073+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:46:47.557073+0000","last_undegraded":"2024-09-11T14:46:47.557073+0000","last_fullsized":"2024-09-11T14:46:47.557073+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":19392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.038790+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:46:43.038790+0000","last_peered":"2024-09-11T14:46:43.038790+0000","last_clean":"2024-09-11T14:46:43.038790+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:46:43.038790+0000","last_undegraded":"2024-09-11T14:46:43.038790+0000","last_fullsized":"2024-09-11T14:46:43.038790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"76'325","reported_seq":364,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:47.517684+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:46:47.517684+0000","last_peered":"2024-09-11T14:46:47.517684+0000","last_clean":"2024-09-11T14:46:47.517684+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:46:47.517684+0000","last_undegraded":"2024-09-11T14:46:47.517684+0000","last_fullsized":"2024-09-11T14:46:47.517684+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21299200,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":325,"num_write_kb":20800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.019157+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.019157+0000","last_peered":"2024-09-11T14:46:43.019157+0000","last_clean":"2024-09-11T14:46:43.019157+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:46:43.019157+0000","last_undegraded":"2024-09-11T14:46:43.019157+0000","last_fullsized":"2024-09-11T14:46:43.019157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"76'303","reported_seq":342,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:48.294409+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:46:48.294409+0000","last_peered":"2024-09-11T14:46:48.294409+0000","last_clean":"2024-09-11T14:46:48.294409+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:46:48.294409+0000","last_undegraded":"2024-09-11T14:46:48.294409+0000","last_fullsized":"2024-09-11T14:46:48.294409+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":19392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.039999+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.039999+0000","last_peered":"2024-09-11T14:46:43.039999+0000","last_clean":"2024-09-11T14:46:43.039999+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:46:43.039999+0000","last_undegraded":"2024-09-11T14:46:43.039999+0000","last_fullsized":"2024-09-11T14:46:43.039999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"76'288","reported_seq":327,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:47.751412+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:46:47.751412+0000","last_peered":"2024-09-11T14:46:47.751412+0000","last_clean":"2024-09-11T14:46:47.751412+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:46:47.751412+0000","last_undegraded":"2024-09-11T14:46:47.751412+0000","last_fullsized":"2024-09-11T14:46:47.751412+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.023012+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:46:43.023012+0000","last_peered":"2024-09-11T14:46:43.023012+0000","last_clean":"2024-09-11T14:46:43.023012+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:46:43.023012+0000","last_undegraded":"2024-09-11T14:46:43.023012+0000","last_fullsized":"2024-09-11T14:46:43.023012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":310050816,"num_objects":4731,"num_object_clones":0,"num_object_copies":14193,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4731,"num_write_kb":302784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212325036032,"internally_reserved":0,"allocated":1886457856,"data_stored":1886457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4731,"ondisk_log_size":4731,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212325433344,"internally_reserved":0,"allocated":1886060544,"data_stored":1886060544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53140365312,"internally_reserved":0,"allocated":412508160,"data_stored":412508160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":399752,"kb_used_data":399752,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51897976,"statfs":{"total":53552873472,"available":53143527424,"internally_reserved":0,"allocated":409346048,"data_stored":409346048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706308,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":433500,"kb_used_data":433500,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51864228,"statfs":{"total":53552873472,"available":53108969472,"internally_reserved":0,"allocated":443904000,"data_stored":443904000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706308,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":503688,"kb_used_data":503688,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51794040,"statfs":{"total":53552873472,"available":53037096960,"internally_reserved":0,"allocated":515776512,"data_stored":515776512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706308,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":497708,"kb_used_data":497708,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51800020,"statfs":{"total":53552873472,"available":53043220480,"internally_reserved":0,"allocated":509652992,"data_stored":509652992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53140365312,"internally_reserved":0,"allocated":412508160,"data_stored":412508160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53035782144,"internally_reserved":0,"allocated":517091328,"data_stored":517091328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53040971776,"internally_reserved":0,"allocated":511901696,"data_stored":511901696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53108445184,"internally_reserved":0,"allocated":444428288,"data_stored":444428288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53140234240,"internally_reserved":0,"allocated":412639232,"data_stored":412639232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53035782144,"internally_reserved":0,"allocated":517091328,"data_stored":517091328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53040709632,"internally_reserved":0,"allocated":512163840,"data_stored":512163840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53108310016,"internally_reserved":0,"allocated":444563456,"data_stored":444563456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53140234240,"internally_reserved":0,"allocated":412639232,"data_stored":412639232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:46:50.994 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 71 16 4971 4955 4.36138 3.8125 0.274379 0.228777 2024-09-11T14:46:51.994 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 72 16 5053 5037 4.37197 5.125 0.280197 0.228397 2024-09-11T14:46:52.508 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:46:52.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:52.659+0000 7fe354791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:52.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:52.667+0000 7fe354791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:52.994 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 73 16 5133 5117 4.38057 5 0.1829 0.228007 2024-09-11T14:46:53.994 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 74 16 5208 5192 4.38471 4.6875 0.377319 0.227434 2024-09-11T14:46:54.994 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 75 16 5291 5275 4.3954 5.1875 0.233735 0.227006 2024-09-11T14:46:55.090 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:46:55.091 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:46:55.091 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:46:55.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:55.218+0000 7f9d0c991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:55.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:55.228+0000 7f9d0c991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:55.284 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:46:55.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:55.469+0000 7f1f71f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:55.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:55.480+0000 7f1f71f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:55.548 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:46:55.549 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:46:55.571 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":395,"stamp":"2024-09-11T14:46:55.359913+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":341049907,"num_objects":5199,"num_object_clones":0,"num_object_copies":15597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5276,"num_write_kb":333588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5250,"ondisk_log_size":5250,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2005984,"kb_used_data":2005984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207184928,"statfs":{"total":214211493888,"available":212157366272,"internally_reserved":0,"allocated":2054127616,"data_stored":2054127616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":65667072,"num_objects":1002,"num_object_clones":0,"num_object_copies":3006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1002,"num_write_kb":64128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002552"},"pg_stats":[{"pgid":"6.f","version":"76'279","reported_seq":318,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:52.452190+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:46:52.452190+0000","last_peered":"2024-09-11T14:46:52.452190+0000","last_clean":"2024-09-11T14:46:52.452190+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:46:52.452190+0000","last_undegraded":"2024-09-11T14:46:52.452190+0000","last_fullsized":"2024-09-11T14:46:52.452190+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":17856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'310","reported_seq":349,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:53.239519+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:46:53.239519+0000","last_peered":"2024-09-11T14:46:53.239519+0000","last_clean":"2024-09-11T14:46:53.239519+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:46:53.239519+0000","last_undegraded":"2024-09-11T14:46:53.239519+0000","last_fullsized":"2024-09-11T14:46:53.239519+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20316160,"num_objects":310,"num_object_clones":0,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":19840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"76'308","reported_seq":347,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:53.158837+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:46:53.158837+0000","last_peered":"2024-09-11T14:46:53.158837+0000","last_clean":"2024-09-11T14:46:53.158837+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:46:53.158837+0000","last_undegraded":"2024-09-11T14:46:53.158837+0000","last_fullsized":"2024-09-11T14:46:53.158837+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20185088,"num_objects":308,"num_object_clones":0,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":308,"num_write_kb":19712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"76'343","reported_seq":382,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:54.020662+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:46:54.020662+0000","last_peered":"2024-09-11T14:46:54.020662+0000","last_clean":"2024-09-11T14:46:54.020662+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:46:54.020662+0000","last_undegraded":"2024-09-11T14:46:54.020662+0000","last_fullsized":"2024-09-11T14:46:54.020662+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22478848,"num_objects":343,"num_object_clones":0,"num_object_copies":1029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":343,"num_write_kb":21952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"76'320","reported_seq":359,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:51.985292+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:46:51.985292+0000","last_peered":"2024-09-11T14:46:51.985292+0000","last_clean":"2024-09-11T14:46:51.985292+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:46:51.985292+0000","last_undegraded":"2024-09-11T14:46:51.985292+0000","last_fullsized":"2024-09-11T14:46:51.985292+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":320,"num_object_clones":0,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'356","reported_seq":395,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:52.644077+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:46:52.644077+0000","last_peered":"2024-09-11T14:46:52.644077+0000","last_clean":"2024-09-11T14:46:52.644077+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:46:52.644077+0000","last_undegraded":"2024-09-11T14:46:52.644077+0000","last_fullsized":"2024-09-11T14:46:52.644077+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23330816,"num_objects":356,"num_object_clones":0,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":22784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'315","reported_seq":354,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:54.212895+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:46:54.212895+0000","last_peered":"2024-09-11T14:46:54.212895+0000","last_clean":"2024-09-11T14:46:54.212895+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:46:54.212895+0000","last_undegraded":"2024-09-11T14:46:54.212895+0000","last_fullsized":"2024-09-11T14:46:54.212895+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20643840,"num_objects":315,"num_object_clones":0,"num_object_copies":945,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":20160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"76'347","reported_seq":386,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:53.450995+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:46:53.450995+0000","last_peered":"2024-09-11T14:46:53.450995+0000","last_clean":"2024-09-11T14:46:53.450995+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:46:53.450995+0000","last_undegraded":"2024-09-11T14:46:53.450995+0000","last_fullsized":"2024-09-11T14:46:53.450995+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22740992,"num_objects":347,"num_object_clones":0,"num_object_copies":1041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":22208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'336","reported_seq":375,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:53.266260+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:46:53.266260+0000","last_peered":"2024-09-11T14:46:53.266260+0000","last_clean":"2024-09-11T14:46:53.266260+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:46:53.266260+0000","last_undegraded":"2024-09-11T14:46:53.266260+0000","last_fullsized":"2024-09-11T14:46:53.266260+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":21504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":268,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.014461+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:46:43.014461+0000","last_peered":"2024-09-11T14:46:43.014461+0000","last_clean":"2024-09-11T14:46:43.014461+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:46:43.014461+0000","last_undegraded":"2024-09-11T14:46:43.014461+0000","last_fullsized":"2024-09-11T14:46:43.014461+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.021089+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:46:43.021089+0000","last_peered":"2024-09-11T14:46:43.021089+0000","last_clean":"2024-09-11T14:46:43.021089+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:46:43.021089+0000","last_undegraded":"2024-09-11T14:46:43.021089+0000","last_fullsized":"2024-09-11T14:46:43.021089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"76'311","reported_seq":350,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:53.865066+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:46:53.865066+0000","last_peered":"2024-09-11T14:46:53.865066+0000","last_clean":"2024-09-11T14:46:53.865066+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:46:53.865066+0000","last_undegraded":"2024-09-11T14:46:53.865066+0000","last_fullsized":"2024-09-11T14:46:53.865066+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20381696,"num_objects":311,"num_object_clones":0,"num_object_copies":933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":19904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.040945+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:46:43.040945+0000","last_peered":"2024-09-11T14:46:43.040945+0000","last_clean":"2024-09-11T14:46:43.040945+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:46:43.040945+0000","last_undegraded":"2024-09-11T14:46:43.040945+0000","last_fullsized":"2024-09-11T14:46:43.040945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"76'325","reported_seq":364,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:53.329960+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:46:53.329960+0000","last_peered":"2024-09-11T14:46:53.329960+0000","last_clean":"2024-09-11T14:46:53.329960+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:46:53.329960+0000","last_undegraded":"2024-09-11T14:46:53.329960+0000","last_fullsized":"2024-09-11T14:46:53.329960+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21299200,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":325,"num_write_kb":20800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.012354+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:46:43.012354+0000","last_peered":"2024-09-11T14:46:43.012354+0000","last_clean":"2024-09-11T14:46:43.012354+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:46:43.012354+0000","last_undegraded":"2024-09-11T14:46:43.012354+0000","last_fullsized":"2024-09-11T14:46:43.012354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"76'335","reported_seq":374,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:54.326902+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:46:54.326902+0000","last_peered":"2024-09-11T14:46:54.326902+0000","last_clean":"2024-09-11T14:46:54.326902+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:46:54.326902+0000","last_undegraded":"2024-09-11T14:46:54.326902+0000","last_fullsized":"2024-09-11T14:46:54.326902+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":21440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.036415+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:46:43.036415+0000","last_peered":"2024-09-11T14:46:43.036415+0000","last_clean":"2024-09-11T14:46:43.036415+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:46:43.036415+0000","last_undegraded":"2024-09-11T14:46:43.036415+0000","last_fullsized":"2024-09-11T14:46:43.036415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'331","reported_seq":370,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:53.030122+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:46:53.030122+0000","last_peered":"2024-09-11T14:46:53.030122+0000","last_clean":"2024-09-11T14:46:53.030122+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:46:53.030122+0000","last_undegraded":"2024-09-11T14:46:53.030122+0000","last_fullsized":"2024-09-11T14:46:53.030122+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21692416,"num_objects":331,"num_object_clones":0,"num_object_copies":993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":21184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.038790+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:46:43.038790+0000","last_peered":"2024-09-11T14:46:43.038790+0000","last_clean":"2024-09-11T14:46:43.038790+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:46:43.038790+0000","last_undegraded":"2024-09-11T14:46:43.038790+0000","last_fullsized":"2024-09-11T14:46:43.038790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"76'352","reported_seq":391,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:53.322289+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:46:53.322289+0000","last_peered":"2024-09-11T14:46:53.322289+0000","last_clean":"2024-09-11T14:46:53.322289+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:46:53.322289+0000","last_undegraded":"2024-09-11T14:46:53.322289+0000","last_fullsized":"2024-09-11T14:46:53.322289+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":352,"num_object_clones":0,"num_object_copies":1056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.019157+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.019157+0000","last_peered":"2024-09-11T14:46:43.019157+0000","last_clean":"2024-09-11T14:46:43.019157+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:46:43.019157+0000","last_undegraded":"2024-09-11T14:46:43.019157+0000","last_fullsized":"2024-09-11T14:46:43.019157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"76'322","reported_seq":361,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:53.249354+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:46:53.249354+0000","last_peered":"2024-09-11T14:46:53.249354+0000","last_clean":"2024-09-11T14:46:53.249354+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:46:53.249354+0000","last_undegraded":"2024-09-11T14:46:53.249354+0000","last_fullsized":"2024-09-11T14:46:53.249354+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21102592,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":20608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.039999+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.039999+0000","last_peered":"2024-09-11T14:46:43.039999+0000","last_clean":"2024-09-11T14:46:43.039999+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:46:43.039999+0000","last_undegraded":"2024-09-11T14:46:43.039999+0000","last_fullsized":"2024-09-11T14:46:43.039999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"76'305","reported_seq":344,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:52.962290+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:46:52.962290+0000","last_peered":"2024-09-11T14:46:52.962290+0000","last_clean":"2024-09-11T14:46:52.962290+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:46:52.962290+0000","last_undegraded":"2024-09-11T14:46:52.962290+0000","last_fullsized":"2024-09-11T14:46:52.962290+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19988480,"num_objects":305,"num_object_clones":0,"num_object_copies":915,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":19520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.023012+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:46:43.023012+0000","last_peered":"2024-09-11T14:46:43.023012+0000","last_clean":"2024-09-11T14:46:43.023012+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:46:43.023012+0000","last_undegraded":"2024-09-11T14:46:43.023012+0000","last_fullsized":"2024-09-11T14:46:43.023012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":340459520,"num_objects":5195,"num_object_clones":0,"num_object_copies":15585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5195,"num_write_kb":332480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212148027392,"internally_reserved":0,"allocated":2063466496,"data_stored":2063466496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5195,"ondisk_log_size":5195,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212148289536,"internally_reserved":0,"allocated":2063204352,"data_stored":2063204352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53073993728,"internally_reserved":0,"allocated":478879744,"data_stored":478879744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673609,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":463660,"kb_used_data":463660,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51834068,"statfs":{"total":53552873472,"available":53078085632,"internally_reserved":0,"allocated":474787840,"data_stored":474787840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706313,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":464940,"kb_used_data":464940,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51832788,"statfs":{"total":53552873472,"available":53076774912,"internally_reserved":0,"allocated":476098560,"data_stored":476098560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706313,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":542932,"kb_used_data":542932,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51754796,"statfs":{"total":53552873472,"available":52996911104,"internally_reserved":0,"allocated":555962368,"data_stored":555962368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706313,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":534452,"kb_used_data":534452,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51763276,"statfs":{"total":53552873472,"available":53005594624,"internally_reserved":0,"allocated":547278848,"data_stored":547278848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53073993728,"internally_reserved":0,"allocated":478879744,"data_stored":478879744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52996259840,"internally_reserved":0,"allocated":556613632,"data_stored":556613632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53001654272,"internally_reserved":0,"allocated":551219200,"data_stored":551219200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53076381696,"internally_reserved":0,"allocated":476491776,"data_stored":476491776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53073993728,"internally_reserved":0,"allocated":478879744,"data_stored":478879744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":52996259840,"internally_reserved":0,"allocated":556613632,"data_stored":556613632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53001654272,"internally_reserved":0,"allocated":551219200,"data_stored":551219200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53076119552,"internally_reserved":0,"allocated":476753920,"data_stored":476753920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53073993728,"internally_reserved":0,"allocated":478879744,"data_stored":478879744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:46:55.994 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 76 16 5360 5344 4.39431 4.3125 0.370039 0.227026 2024-09-11T14:46:56.995 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 77 16 5431 5415 4.39486 4.4375 0.502206 0.226878 2024-09-11T14:46:57.995 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 78 16 5501 5485 4.3946 4.375 0.221438 0.227137 2024-09-11T14:46:57.997 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:46:58.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:58.127+0000 7f12c6f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:58.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:46:58.134+0000 7f12c6f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:46:58.995 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 79 16 5591 5575 4.41017 5.625 0.119316 0.226503 2024-09-11T14:46:59.995 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:46:59.994831+0000 min lat: 0.0255907 max lat: 1.45742 avg lat: 0.226131 2024-09-11T14:46:59.995 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:46:59.995 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 80 16 5667 5651 4.41441 4.75 0.217684 0.226131 2024-09-11T14:47:00.573 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:47:00.573 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:47:00.574 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:47:00.574 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:47:00.654 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:47:00.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:00.694+0000 7f30f5023640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:00.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:00.707+0000 7f30f5023640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:00.728 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:47:00.729 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:47:00.729 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:47:00.729 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:47:00.729 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:47:00.729 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:47:00.729 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:47:00.729 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:47:00.729 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:47:00.729 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:47:00.730 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:47:00.730 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:47:00.732 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:47:00.733 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:47:00.733 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:47:00.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:00.800+0000 7fbea469c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:00.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:00.814+0000 7fbea469c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:00.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:00.871+0000 7f78e1046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:00.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:00.884+0000 7f78e1046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:00.995 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 81 16 5729 5713 4.40775 3.875 0.135341 0.226378 2024-09-11T14:47:01.036 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:47:01.036 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:47:01.036 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:47:01.036 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:47:01.036 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:47:01.036 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:47:01.037 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:47:01.037 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:47:01.037 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:47:01.037 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:47:01.037 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:47:01.037 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:47:01.039 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:47:01.039 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:47:01.040 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:47:01.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:01.159+0000 7f1570d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:01.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:01.171+0000 7f1570d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:01.212 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:47:01.212 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:47:01.213 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:47:01.213 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:47:01.213 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:47:01.213 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:47:01.213 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:47:01.213 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:47:01.213 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:47:01.213 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:47:01.213 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:47:01.213 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:47:01.216 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:47:01.217 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:47:01.217 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:47:01.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:01.382+0000 7f11be191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:01.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:01.393+0000 7f11be191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:01.422 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:47:01.422 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:47:01.423 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:47:01.423 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:47:01.423 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:47:01.423 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:47:01.423 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:47:01.424 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:47:01.424 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:47:01.424 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:47:01.424 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:47:01.424 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:47:01.427 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:47:01.427 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:47:01.995 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 82 16 5792 5776 4.40201 3.9375 0.0969808 0.226567 2024-09-11T14:47:02.995 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 83 16 5851 5835 4.39339 3.6875 0.702655 0.226832 2024-09-11T14:47:03.130 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:47:03.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:03.300+0000 7f608bc57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:03.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:03.311+0000 7f608bc57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:03.995 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 84 16 5927 5911 4.39763 4.75 0.139754 0.226985 2024-09-11T14:47:04.995 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 85 16 6010 5994 4.40692 5.1875 0.183214 0.226513 2024-09-11T14:47:05.653 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:47:05.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:05.825+0000 7fc1044a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:05.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:05.835+0000 7fc1044a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:05.995 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 86 16 6102 6086 4.42253 5.75 0.173761 0.22578 2024-09-11T14:47:06.428 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:47:06.428 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:47:06.428 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:47:06.428 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:47:06.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:06.611+0000 7f4fcd2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:06.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:06.630+0000 7f4fcd2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:06.690 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:47:06.691 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:47:06.691 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:47:06.691 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:47:06.691 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:47:06.691 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:47:06.691 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:47:06.691 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:47:06.691 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:47:06.691 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:47:06.691 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:47:06.691 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:47:06.695 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:47:06.695 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:47:06.695 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:47:06.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:06.872+0000 7fa5a0046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:06.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:06.896+0000 7fa5a0046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:06.996 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 87 16 6188 6172 4.43347 5.375 0.146309 0.225251 2024-09-11T14:47:07.042 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:47:07.043 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:47:07.043 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:47:07.043 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:47:07.043 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:47:07.043 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:47:07.043 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:47:07.043 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:47:07.043 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:47:07.043 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:47:07.043 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:47:07.043 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:47:07.047 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:47:07.048 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:47:07.048 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:47:07.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:07.231+0000 7f7e5d8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:07.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:07.249+0000 7f7e5d8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:07.531 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:47:07.531 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:47:07.531 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:47:07.531 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:47:07.531 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:47:07.531 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:47:07.531 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:47:07.531 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:47:07.531 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:47:07.531 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:47:07.531 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:47:07.532 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:47:07.535 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:47:07.536 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:47:07.536 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:47:07.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:07.672+0000 7fd8282a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:07.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:07.685+0000 7fd8282a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:47:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:47:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:47:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:47:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:47:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:47:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:47:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:47:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:47:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:47:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:47:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:47:07.752 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:47:07.752 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:47:07.996 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 88 16 6272 6256 4.44275 5.25 0.119067 0.224857 2024-09-11T14:47:08.265 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:47:08.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:08.434+0000 7f9b52391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:08.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:08.446+0000 7f9b52391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:08.996 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 89 16 6354 6338 4.45041 5.125 0.090475 0.224329 2024-09-11T14:47:09.996 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 90 13 6429 6416 4.45512 4.875 0.285354 0.224202 2024-09-11T14:47:10.996 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total time run: 90.1673 2024-09-11T14:47:10.996 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total writes made: 6429 2024-09-11T14:47:10.996 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Write size: 65536 2024-09-11T14:47:10.996 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object size: 65536 2024-09-11T14:47:10.996 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Bandwidth (MB/sec): 4.4563 2024-09-11T14:47:10.997 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Bandwidth: 0.628029 2024-09-11T14:47:10.997 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max bandwidth (MB/sec): 5.75 2024-09-11T14:47:10.997 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min bandwidth (MB/sec): 2.4375 2024-09-11T14:47:10.997 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average IOPS: 71 2024-09-11T14:47:10.997 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev IOPS: 10.0485 2024-09-11T14:47:10.997 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max IOPS: 92 2024-09-11T14:47:10.997 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min IOPS: 39 2024-09-11T14:47:10.997 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average Latency(s): 0.224126 2024-09-11T14:47:10.997 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Latency(s): 0.178018 2024-09-11T14:47:10.997 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max latency(s): 1.45742 2024-09-11T14:47:10.997 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min latency(s): 0.0255907 2024-09-11T14:47:11.034 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Cleaning up (deleting benchmark objects) 2024-09-11T14:47:11.053 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:47:11.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:11.228+0000 7ffa9d6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:11.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:11.235+0000 7ffa9d6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:12.753 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:47:12.753 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:47:12.753 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:47:12.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:12.919+0000 7f11c7351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:12.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:12.933+0000 7f11c7351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:13.313 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:47:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:47:13.340 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":403,"stamp":"2024-09-11T14:47:11.363304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":415105587,"num_objects":6329,"num_object_clones":0,"num_object_copies":18987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6406,"num_write_kb":405908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6380,"ondisk_log_size":6380,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2449076,"kb_used_data":2449076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206741836,"statfs":{"total":214211493888,"available":211703640064,"internally_reserved":0,"allocated":2507853824,"data_stored":2507853824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":56098816,"num_objects":856,"num_object_clones":0,"num_object_copies":2568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":54784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002561"},"pg_stats":[{"pgid":"6.f","version":"76'356","reported_seq":395,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:08.100654+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:47:08.100654+0000","last_peered":"2024-09-11T14:47:08.100654+0000","last_clean":"2024-09-11T14:47:08.100654+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:47:08.100654+0000","last_undegraded":"2024-09-11T14:47:08.100654+0000","last_fullsized":"2024-09-11T14:47:08.100654+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23330816,"num_objects":356,"num_object_clones":0,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":22784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'377","reported_seq":416,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:08.056758+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:47:08.056758+0000","last_peered":"2024-09-11T14:47:08.056758+0000","last_clean":"2024-09-11T14:47:08.056758+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:47:08.056758+0000","last_undegraded":"2024-09-11T14:47:08.056758+0000","last_fullsized":"2024-09-11T14:47:08.056758+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24707072,"num_objects":377,"num_object_clones":0,"num_object_copies":1131,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":24128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"76'367","reported_seq":406,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:07.932067+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:47:07.932067+0000","last_peered":"2024-09-11T14:47:07.932067+0000","last_clean":"2024-09-11T14:47:07.932067+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:47:07.932067+0000","last_undegraded":"2024-09-11T14:47:07.932067+0000","last_fullsized":"2024-09-11T14:47:07.932067+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24051712,"num_objects":367,"num_object_clones":0,"num_object_copies":1101,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":23488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"76'417","reported_seq":456,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:09.243421+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:47:09.243421+0000","last_peered":"2024-09-11T14:47:09.243421+0000","last_clean":"2024-09-11T14:47:09.243421+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:47:09.243421+0000","last_undegraded":"2024-09-11T14:47:09.243421+0000","last_fullsized":"2024-09-11T14:47:09.243421+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27328512,"num_objects":417,"num_object_clones":0,"num_object_copies":1251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":26688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"76'391","reported_seq":430,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:08.063074+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:47:08.063074+0000","last_peered":"2024-09-11T14:47:08.063074+0000","last_clean":"2024-09-11T14:47:08.063074+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:47:08.063074+0000","last_undegraded":"2024-09-11T14:47:08.063074+0000","last_fullsized":"2024-09-11T14:47:08.063074+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25624576,"num_objects":391,"num_object_clones":0,"num_object_copies":1173,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":391,"num_write_kb":25024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'431","reported_seq":470,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:08.024407+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:47:08.024407+0000","last_peered":"2024-09-11T14:47:08.024407+0000","last_clean":"2024-09-11T14:47:08.024407+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:47:08.024407+0000","last_undegraded":"2024-09-11T14:47:08.024407+0000","last_fullsized":"2024-09-11T14:47:08.024407+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28246016,"num_objects":431,"num_object_clones":0,"num_object_copies":1293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":27584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'393","reported_seq":432,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:09.013916+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:47:09.013916+0000","last_peered":"2024-09-11T14:47:09.013916+0000","last_clean":"2024-09-11T14:47:09.013916+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:47:09.013916+0000","last_undegraded":"2024-09-11T14:47:09.013916+0000","last_fullsized":"2024-09-11T14:47:09.013916+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":25152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"76'420","reported_seq":459,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:08.207957+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:47:08.207957+0000","last_peered":"2024-09-11T14:47:08.207957+0000","last_clean":"2024-09-11T14:47:08.207957+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:47:08.207957+0000","last_undegraded":"2024-09-11T14:47:08.207957+0000","last_fullsized":"2024-09-11T14:47:08.207957+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27525120,"num_objects":420,"num_object_clones":0,"num_object_copies":1260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":420,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'413","reported_seq":452,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:08.000727+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:47:08.000727+0000","last_peered":"2024-09-11T14:47:08.000727+0000","last_clean":"2024-09-11T14:47:08.000727+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:47:08.000727+0000","last_undegraded":"2024-09-11T14:47:08.000727+0000","last_fullsized":"2024-09-11T14:47:08.000727+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27066368,"num_objects":413,"num_object_clones":0,"num_object_copies":1239,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":413,"num_write_kb":26432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":268,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.014461+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:46:43.014461+0000","last_peered":"2024-09-11T14:46:43.014461+0000","last_clean":"2024-09-11T14:46:43.014461+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:46:43.014461+0000","last_undegraded":"2024-09-11T14:46:43.014461+0000","last_fullsized":"2024-09-11T14:46:43.014461+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.021089+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:46:43.021089+0000","last_peered":"2024-09-11T14:46:43.021089+0000","last_clean":"2024-09-11T14:46:43.021089+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:46:43.021089+0000","last_undegraded":"2024-09-11T14:46:43.021089+0000","last_fullsized":"2024-09-11T14:46:43.021089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"76'379","reported_seq":418,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:08.737247+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:47:08.737247+0000","last_peered":"2024-09-11T14:47:08.737247+0000","last_clean":"2024-09-11T14:47:08.737247+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:47:08.737247+0000","last_undegraded":"2024-09-11T14:47:08.737247+0000","last_fullsized":"2024-09-11T14:47:08.737247+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24838144,"num_objects":379,"num_object_clones":0,"num_object_copies":1137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":379,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.040945+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:46:43.040945+0000","last_peered":"2024-09-11T14:46:43.040945+0000","last_clean":"2024-09-11T14:46:43.040945+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:46:43.040945+0000","last_undegraded":"2024-09-11T14:46:43.040945+0000","last_fullsized":"2024-09-11T14:46:43.040945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"76'392","reported_seq":431,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:07.536437+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:47:07.536437+0000","last_peered":"2024-09-11T14:47:07.536437+0000","last_clean":"2024-09-11T14:47:07.536437+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:47:07.536437+0000","last_undegraded":"2024-09-11T14:47:07.536437+0000","last_fullsized":"2024-09-11T14:47:07.536437+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25690112,"num_objects":392,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":25088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.012354+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:46:43.012354+0000","last_peered":"2024-09-11T14:46:43.012354+0000","last_clean":"2024-09-11T14:46:43.012354+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:46:43.012354+0000","last_undegraded":"2024-09-11T14:46:43.012354+0000","last_fullsized":"2024-09-11T14:46:43.012354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"76'405","reported_seq":444,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:09.134272+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:47:09.134272+0000","last_peered":"2024-09-11T14:47:09.134272+0000","last_clean":"2024-09-11T14:47:09.134272+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:47:09.134272+0000","last_undegraded":"2024-09-11T14:47:09.134272+0000","last_fullsized":"2024-09-11T14:47:09.134272+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26542080,"num_objects":405,"num_object_clones":0,"num_object_copies":1215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":25920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.036415+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:46:43.036415+0000","last_peered":"2024-09-11T14:46:43.036415+0000","last_clean":"2024-09-11T14:46:43.036415+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:46:43.036415+0000","last_undegraded":"2024-09-11T14:46:43.036415+0000","last_fullsized":"2024-09-11T14:46:43.036415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'415","reported_seq":454,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:07.918943+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:47:07.918943+0000","last_peered":"2024-09-11T14:47:07.918943+0000","last_clean":"2024-09-11T14:47:07.918943+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:47:07.918943+0000","last_undegraded":"2024-09-11T14:47:07.918943+0000","last_fullsized":"2024-09-11T14:47:07.918943+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27197440,"num_objects":415,"num_object_clones":0,"num_object_copies":1245,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":26560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.038790+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:46:43.038790+0000","last_peered":"2024-09-11T14:46:43.038790+0000","last_clean":"2024-09-11T14:46:43.038790+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:46:43.038790+0000","last_undegraded":"2024-09-11T14:46:43.038790+0000","last_fullsized":"2024-09-11T14:46:43.038790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"76'423","reported_seq":462,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:07.787935+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:47:07.787935+0000","last_peered":"2024-09-11T14:47:07.787935+0000","last_clean":"2024-09-11T14:47:07.787935+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:47:07.787935+0000","last_undegraded":"2024-09-11T14:47:07.787935+0000","last_fullsized":"2024-09-11T14:47:07.787935+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27721728,"num_objects":423,"num_object_clones":0,"num_object_copies":1269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":423,"num_write_kb":27072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.019157+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.019157+0000","last_peered":"2024-09-11T14:46:43.019157+0000","last_clean":"2024-09-11T14:46:43.019157+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:46:43.019157+0000","last_undegraded":"2024-09-11T14:46:43.019157+0000","last_fullsized":"2024-09-11T14:46:43.019157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"76'371","reported_seq":410,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:08.182409+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:47:08.182409+0000","last_peered":"2024-09-11T14:47:08.182409+0000","last_clean":"2024-09-11T14:47:08.182409+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:47:08.182409+0000","last_undegraded":"2024-09-11T14:47:08.182409+0000","last_fullsized":"2024-09-11T14:47:08.182409+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24313856,"num_objects":371,"num_object_clones":0,"num_object_copies":1113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":23744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.039999+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.039999+0000","last_peered":"2024-09-11T14:46:43.039999+0000","last_clean":"2024-09-11T14:46:43.039999+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:46:43.039999+0000","last_undegraded":"2024-09-11T14:46:43.039999+0000","last_fullsized":"2024-09-11T14:46:43.039999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"76'375","reported_seq":414,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:07.529167+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:47:07.529167+0000","last_peered":"2024-09-11T14:47:07.529167+0000","last_clean":"2024-09-11T14:47:07.529167+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:47:07.529167+0000","last_undegraded":"2024-09-11T14:47:07.529167+0000","last_fullsized":"2024-09-11T14:47:07.529167+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24576000,"num_objects":375,"num_object_clones":0,"num_object_copies":1125,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":24000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.023012+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:46:43.023012+0000","last_peered":"2024-09-11T14:46:43.023012+0000","last_clean":"2024-09-11T14:46:43.023012+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:46:43.023012+0000","last_undegraded":"2024-09-11T14:46:43.023012+0000","last_fullsized":"2024-09-11T14:46:43.023012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":414515200,"num_objects":6325,"num_object_clones":0,"num_object_copies":18975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6325,"num_write_kb":404800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211694440448,"internally_reserved":0,"allocated":2517053440,"data_stored":2517053440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6325,"ondisk_log_size":6325,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211694702592,"internally_reserved":0,"allocated":2516791296,"data_stored":2516791296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52967927808,"internally_reserved":0,"allocated":584945664,"data_stored":584945664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673624,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":567572,"kb_used_data":567572,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51730156,"statfs":{"total":53552873472,"available":52971679744,"internally_reserved":0,"allocated":581193728,"data_stored":581193728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706328,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":566560,"kb_used_data":566560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51731168,"statfs":{"total":53552873472,"available":52972716032,"internally_reserved":0,"allocated":580157440,"data_stored":580157440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706328,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":662464,"kb_used_data":662464,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51635264,"statfs":{"total":53552873472,"available":52874510336,"internally_reserved":0,"allocated":678363136,"data_stored":678363136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706328,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":652480,"kb_used_data":652480,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51645248,"statfs":{"total":53552873472,"available":52884733952,"internally_reserved":0,"allocated":668139520,"data_stored":668139520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52967927808,"internally_reserved":0,"allocated":584945664,"data_stored":584945664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52873719808,"internally_reserved":0,"allocated":679153664,"data_stored":679153664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52880736256,"internally_reserved":0,"allocated":672137216,"data_stored":672137216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52972318720,"internally_reserved":0,"allocated":580554752,"data_stored":580554752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52967927808,"internally_reserved":0,"allocated":584945664,"data_stored":584945664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":52873588736,"internally_reserved":0,"allocated":679284736,"data_stored":679284736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":52880736256,"internally_reserved":0,"allocated":672137216,"data_stored":672137216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":52972187648,"internally_reserved":0,"allocated":580685824,"data_stored":580685824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":52967927808,"internally_reserved":0,"allocated":584945664,"data_stored":584945664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:47:13.817 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:47:13.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:13.985+0000 7f8d75b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:13.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:13.996+0000 7f8d75b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:16.603 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:47:16.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:16.729+0000 7f4bcd951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:16.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:16.735+0000 7f4bcd951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:18.343 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:47:18.343 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:47:18.343 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:47:18.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:18.484+0000 7fe8a4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:18.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:18.494+0000 7fe8a4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:18.816 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:47:18.817 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:47:18.836 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2024-09-11T14:47:17.364628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":402981451,"num_objects":6145,"num_object_clones":0,"num_object_copies":18435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":6800,"num_write_kb":412565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6774,"ondisk_log_size":6774,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2404272,"kb_used_data":2404272,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206786640,"statfs":{"total":214211493888,"available":211749519360,"internally_reserved":0,"allocated":2461974528,"data_stored":2461974528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15269912,"num_objects":234,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":812,"num_write_kb":33409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002686"},"pg_stats":[{"pgid":"6.f","version":"76'378","reported_seq":417,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:12.934521+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:47:12.934521+0000","last_peered":"2024-09-11T14:47:12.934521+0000","last_clean":"2024-09-11T14:47:12.934521+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:47:12.934521+0000","last_undegraded":"2024-09-11T14:47:12.934521+0000","last_fullsized":"2024-09-11T14:47:12.934521+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":352,"num_object_clones":0,"num_object_copies":1056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":23360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'403","reported_seq":442,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:13.293500+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:47:13.293500+0000","last_peered":"2024-09-11T14:47:13.293500+0000","last_clean":"2024-09-11T14:47:13.293500+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:47:13.293500+0000","last_undegraded":"2024-09-11T14:47:13.293500+0000","last_fullsized":"2024-09-11T14:47:13.293500+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"76'395","reported_seq":435,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:12.978343+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:47:12.978343+0000","last_peered":"2024-09-11T14:47:12.978343+0000","last_clean":"2024-09-11T14:47:12.978343+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:47:12.978343+0000","last_undegraded":"2024-09-11T14:47:12.978343+0000","last_fullsized":"2024-09-11T14:47:12.978343+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855128,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":395,"num_write_kb":24257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"76'439","reported_seq":478,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:14.074150+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:47:14.074150+0000","last_peered":"2024-09-11T14:47:14.074150+0000","last_clean":"2024-09-11T14:47:14.074150+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:47:14.074150+0000","last_undegraded":"2024-09-11T14:47:14.074150+0000","last_fullsized":"2024-09-11T14:47:14.074150+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26017792,"num_objects":397,"num_object_clones":0,"num_object_copies":1191,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"76'414","reported_seq":453,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:12.799997+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:47:12.799997+0000","last_peered":"2024-09-11T14:47:12.799997+0000","last_clean":"2024-09-11T14:47:12.799997+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:47:12.799997+0000","last_undegraded":"2024-09-11T14:47:12.799997+0000","last_fullsized":"2024-09-11T14:47:12.799997+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24772608,"num_objects":378,"num_object_clones":0,"num_object_copies":1134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":414,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'457","reported_seq":496,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:13.303667+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:47:13.303667+0000","last_peered":"2024-09-11T14:47:13.303667+0000","last_clean":"2024-09-11T14:47:13.303667+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:47:13.303667+0000","last_undegraded":"2024-09-11T14:47:13.303667+0000","last_fullsized":"2024-09-11T14:47:13.303667+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27459584,"num_objects":419,"num_object_clones":0,"num_object_copies":1257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'421","reported_seq":460,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:14.392824+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:47:14.392824+0000","last_peered":"2024-09-11T14:47:14.392824+0000","last_clean":"2024-09-11T14:47:14.392824+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:47:14.392824+0000","last_undegraded":"2024-09-11T14:47:14.392824+0000","last_fullsized":"2024-09-11T14:47:14.392824+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24051712,"num_objects":367,"num_object_clones":0,"num_object_copies":1101,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"76'445","reported_seq":484,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:13.407343+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:47:13.407343+0000","last_peered":"2024-09-11T14:47:13.407343+0000","last_clean":"2024-09-11T14:47:13.407343+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:47:13.407343+0000","last_undegraded":"2024-09-11T14:47:13.407343+0000","last_fullsized":"2024-09-11T14:47:13.407343+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26935296,"num_objects":411,"num_object_clones":0,"num_object_copies":1233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":445,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'439","reported_seq":478,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:13.414354+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:47:13.414354+0000","last_peered":"2024-09-11T14:47:13.414354+0000","last_clean":"2024-09-11T14:47:13.414354+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:47:13.414354+0000","last_undegraded":"2024-09-11T14:47:13.414354+0000","last_fullsized":"2024-09-11T14:47:13.414354+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26279936,"num_objects":401,"num_object_clones":0,"num_object_copies":1203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":268,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.014461+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:46:43.014461+0000","last_peered":"2024-09-11T14:46:43.014461+0000","last_clean":"2024-09-11T14:46:43.014461+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:46:43.014461+0000","last_undegraded":"2024-09-11T14:46:43.014461+0000","last_fullsized":"2024-09-11T14:46:43.014461+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.021089+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:46:43.021089+0000","last_peered":"2024-09-11T14:46:43.021089+0000","last_clean":"2024-09-11T14:46:43.021089+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:46:43.021089+0000","last_undegraded":"2024-09-11T14:46:43.021089+0000","last_fullsized":"2024-09-11T14:46:43.021089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"76'399","reported_seq":438,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:14.342430+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:47:14.342430+0000","last_peered":"2024-09-11T14:47:14.342430+0000","last_clean":"2024-09-11T14:47:14.342430+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:47:14.342430+0000","last_undegraded":"2024-09-11T14:47:14.342430+0000","last_fullsized":"2024-09-11T14:47:14.342430+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23789568,"num_objects":363,"num_object_clones":0,"num_object_copies":1089,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":24384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.040945+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:46:43.040945+0000","last_peered":"2024-09-11T14:46:43.040945+0000","last_clean":"2024-09-11T14:46:43.040945+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:46:43.040945+0000","last_undegraded":"2024-09-11T14:46:43.040945+0000","last_fullsized":"2024-09-11T14:46:43.040945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"76'419","reported_seq":458,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:12.879508+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:47:12.879508+0000","last_peered":"2024-09-11T14:47:12.879508+0000","last_clean":"2024-09-11T14:47:12.879508+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:47:12.879508+0000","last_undegraded":"2024-09-11T14:47:12.879508+0000","last_fullsized":"2024-09-11T14:47:12.879508+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24969216,"num_objects":381,"num_object_clones":0,"num_object_copies":1143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.012354+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:46:43.012354+0000","last_peered":"2024-09-11T14:46:43.012354+0000","last_clean":"2024-09-11T14:46:43.012354+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:46:43.012354+0000","last_undegraded":"2024-09-11T14:46:43.012354+0000","last_fullsized":"2024-09-11T14:46:43.012354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"76'434","reported_seq":473,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:14.210841+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:47:14.210841+0000","last_peered":"2024-09-11T14:47:14.210841+0000","last_clean":"2024-09-11T14:47:14.210841+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:47:14.210841+0000","last_undegraded":"2024-09-11T14:47:14.210841+0000","last_fullsized":"2024-09-11T14:47:14.210841+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25034752,"num_objects":382,"num_object_clones":0,"num_object_copies":1146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":434,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.036415+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:46:43.036415+0000","last_peered":"2024-09-11T14:46:43.036415+0000","last_clean":"2024-09-11T14:46:43.036415+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:46:43.036415+0000","last_undegraded":"2024-09-11T14:46:43.036415+0000","last_fullsized":"2024-09-11T14:46:43.036415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'445","reported_seq":484,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:13.210896+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:47:13.210896+0000","last_peered":"2024-09-11T14:47:13.210896+0000","last_clean":"2024-09-11T14:47:13.210896+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:47:13.210896+0000","last_undegraded":"2024-09-11T14:47:13.210896+0000","last_fullsized":"2024-09-11T14:47:13.210896+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26935296,"num_objects":411,"num_object_clones":0,"num_object_copies":1233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":445,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.038790+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:46:43.038790+0000","last_peered":"2024-09-11T14:46:43.038790+0000","last_clean":"2024-09-11T14:46:43.038790+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:46:43.038790+0000","last_undegraded":"2024-09-11T14:46:43.038790+0000","last_fullsized":"2024-09-11T14:46:43.038790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"76'452","reported_seq":491,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:12.833501+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:47:12.833501+0000","last_peered":"2024-09-11T14:47:12.833501+0000","last_clean":"2024-09-11T14:47:12.833501+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:47:12.833501+0000","last_undegraded":"2024-09-11T14:47:12.833501+0000","last_fullsized":"2024-09-11T14:47:12.833501+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":452,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.019157+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.019157+0000","last_peered":"2024-09-11T14:46:43.019157+0000","last_clean":"2024-09-11T14:46:43.019157+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:46:43.019157+0000","last_undegraded":"2024-09-11T14:46:43.019157+0000","last_fullsized":"2024-09-11T14:46:43.019157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"76'390","reported_seq":429,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:13.211165+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:47:13.211165+0000","last_peered":"2024-09-11T14:47:13.211165+0000","last_clean":"2024-09-11T14:47:13.211165+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:47:13.211165+0000","last_undegraded":"2024-09-11T14:47:13.211165+0000","last_fullsized":"2024-09-11T14:47:13.211165+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23986176,"num_objects":366,"num_object_clones":0,"num_object_copies":1098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.039999+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.039999+0000","last_peered":"2024-09-11T14:46:43.039999+0000","last_clean":"2024-09-11T14:46:43.039999+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:46:43.039999+0000","last_undegraded":"2024-09-11T14:46:43.039999+0000","last_fullsized":"2024-09-11T14:46:43.039999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"76'389","reported_seq":428,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:13.180735+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:47:13.180735+0000","last_peered":"2024-09-11T14:47:13.180735+0000","last_clean":"2024-09-11T14:47:13.180735+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:47:13.180735+0000","last_undegraded":"2024-09-11T14:47:13.180735+0000","last_fullsized":"2024-09-11T14:47:13.180735+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24051712,"num_objects":367,"num_object_clones":0,"num_object_copies":1101,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.023012+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:46:43.023012+0000","last_peered":"2024-09-11T14:46:43.023012+0000","last_clean":"2024-09-11T14:46:43.023012+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:46:43.023012+0000","last_undegraded":"2024-09-11T14:46:43.023012+0000","last_fullsized":"2024-09-11T14:46:43.023012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":402391064,"num_objects":6141,"num_object_clones":0,"num_object_copies":18423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6719,"num_write_kb":411457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211760271360,"internally_reserved":0,"allocated":2451222528,"data_stored":2451222528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6719,"ondisk_log_size":6719,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211760009216,"internally_reserved":0,"allocated":2451484672,"data_stored":2451484672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52997869568,"internally_reserved":0,"allocated":555003904,"data_stored":555003904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673629,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":546732,"kb_used_data":546732,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51750996,"statfs":{"total":53552873472,"available":52993019904,"internally_reserved":0,"allocated":559853568,"data_stored":559853568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706333,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":556288,"kb_used_data":556288,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51741440,"statfs":{"total":53552873472,"available":52983234560,"internally_reserved":0,"allocated":569638912,"data_stored":569638912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706333,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":651556,"kb_used_data":651556,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51646172,"statfs":{"total":53552873472,"available":52885680128,"internally_reserved":0,"allocated":667193344,"data_stored":667193344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706333,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":649696,"kb_used_data":649696,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51648032,"statfs":{"total":53552873472,"available":52887584768,"internally_reserved":0,"allocated":665288704,"data_stored":665288704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52997869568,"internally_reserved":0,"allocated":555003904,"data_stored":555003904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52886859776,"internally_reserved":0,"allocated":666013696,"data_stored":666013696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52891914240,"internally_reserved":0,"allocated":660959232,"data_stored":660959232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52983365632,"internally_reserved":0,"allocated":569507840,"data_stored":569507840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52997869568,"internally_reserved":0,"allocated":555003904,"data_stored":555003904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":52886859776,"internally_reserved":0,"allocated":666013696,"data_stored":666013696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":52892045312,"internally_reserved":0,"allocated":660828160,"data_stored":660828160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":52983365632,"internally_reserved":0,"allocated":569507840,"data_stored":569507840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":52998000640,"internally_reserved":0,"allocated":554872832,"data_stored":554872832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:47:19.099 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:47:19.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:19.251+0000 7f1bfdd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:19.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:19.261+0000 7f1bfdd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:21.687 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:47:21.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:21.846+0000 7f6c4e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:21.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:21.855+0000 7f6c4e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:23.838 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:47:23.838 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:47:23.838 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:47:23.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:23.991+0000 7f8025d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:24.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:24.002+0000 7f8025d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:24.288 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:47:24.289 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:47:24.305 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":409,"stamp":"2024-09-11T14:47:23.365982+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":371786315,"num_objects":5669,"num_object_clones":0,"num_object_copies":17007,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":7276,"num_write_kb":412565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7250,"ondisk_log_size":7250,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2216948,"kb_used_data":2216948,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206973964,"statfs":{"total":214211493888,"available":211941339136,"internally_reserved":0,"allocated":2270154752,"data_stored":2270154752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-43319272,"num_objects":-660,"num_object_clones":0,"num_object_copies":-1980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":870,"num_write_kb":6657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002677"},"pg_stats":[{"pgid":"6.f","version":"76'415","reported_seq":454,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:18.302087+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:47:18.302087+0000","last_peered":"2024-09-11T14:47:18.302087+0000","last_clean":"2024-09-11T14:47:18.302087+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:47:18.302087+0000","last_undegraded":"2024-09-11T14:47:18.302087+0000","last_fullsized":"2024-09-11T14:47:18.302087+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20643840,"num_objects":315,"num_object_clones":0,"num_object_copies":945,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":23360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'433","reported_seq":472,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:18.275373+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:47:18.275373+0000","last_peered":"2024-09-11T14:47:18.275373+0000","last_clean":"2024-09-11T14:47:18.275373+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:47:18.275373+0000","last_undegraded":"2024-09-11T14:47:18.275373+0000","last_fullsized":"2024-09-11T14:47:18.275373+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"76'432","reported_seq":472,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:18.267269+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:47:18.267269+0000","last_peered":"2024-09-11T14:47:18.267269+0000","last_clean":"2024-09-11T14:47:18.267269+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:47:18.267269+0000","last_undegraded":"2024-09-11T14:47:18.267269+0000","last_fullsized":"2024-09-11T14:47:18.267269+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21430296,"num_objects":328,"num_object_clones":0,"num_object_copies":984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":432,"num_write_kb":24257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"76'466","reported_seq":505,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:19.038464+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:47:19.038464+0000","last_peered":"2024-09-11T14:47:19.038464+0000","last_clean":"2024-09-11T14:47:19.038464+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:47:19.038464+0000","last_undegraded":"2024-09-11T14:47:19.038464+0000","last_fullsized":"2024-09-11T14:47:19.038464+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24248320,"num_objects":370,"num_object_clones":0,"num_object_copies":1110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":466,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"76'436","reported_seq":475,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:18.115981+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:47:18.115981+0000","last_peered":"2024-09-11T14:47:18.115981+0000","last_clean":"2024-09-11T14:47:18.115981+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:47:18.115981+0000","last_undegraded":"2024-09-11T14:47:18.115981+0000","last_fullsized":"2024-09-11T14:47:18.115981+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23330816,"num_objects":356,"num_object_clones":0,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":436,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'494","reported_seq":533,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:17.742703+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:47:17.742703+0000","last_peered":"2024-09-11T14:47:17.742703+0000","last_clean":"2024-09-11T14:47:17.742703+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:47:17.742703+0000","last_undegraded":"2024-09-11T14:47:17.742703+0000","last_fullsized":"2024-09-11T14:47:17.742703+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25034752,"num_objects":382,"num_object_clones":0,"num_object_copies":1146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'441","reported_seq":480,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:19.089733+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:47:19.089733+0000","last_peered":"2024-09-11T14:47:19.089733+0000","last_clean":"2024-09-11T14:47:19.089733+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:47:19.089733+0000","last_undegraded":"2024-09-11T14:47:19.089733+0000","last_fullsized":"2024-09-11T14:47:19.089733+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22740992,"num_objects":347,"num_object_clones":0,"num_object_copies":1041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":441,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"76'479","reported_seq":518,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:18.257057+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:47:18.257057+0000","last_peered":"2024-09-11T14:47:18.257057+0000","last_clean":"2024-09-11T14:47:18.257057+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:47:18.257057+0000","last_undegraded":"2024-09-11T14:47:18.257057+0000","last_fullsized":"2024-09-11T14:47:18.257057+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24707072,"num_objects":377,"num_object_clones":0,"num_object_copies":1131,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":479,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'461","reported_seq":500,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:18.385990+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:47:18.385990+0000","last_peered":"2024-09-11T14:47:18.385990+0000","last_clean":"2024-09-11T14:47:18.385990+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:47:18.385990+0000","last_undegraded":"2024-09-11T14:47:18.385990+0000","last_fullsized":"2024-09-11T14:47:18.385990+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24838144,"num_objects":379,"num_object_clones":0,"num_object_copies":1137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":268,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.014461+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:46:43.014461+0000","last_peered":"2024-09-11T14:46:43.014461+0000","last_clean":"2024-09-11T14:46:43.014461+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:46:43.014461+0000","last_undegraded":"2024-09-11T14:46:43.014461+0000","last_fullsized":"2024-09-11T14:46:43.014461+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.021089+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:46:43.021089+0000","last_peered":"2024-09-11T14:46:43.021089+0000","last_clean":"2024-09-11T14:46:43.021089+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:46:43.021089+0000","last_undegraded":"2024-09-11T14:46:43.021089+0000","last_fullsized":"2024-09-11T14:46:43.021089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"76'425","reported_seq":464,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:19.245794+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:47:19.245794+0000","last_peered":"2024-09-11T14:47:19.245794+0000","last_clean":"2024-09-11T14:47:19.245794+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:47:19.245794+0000","last_undegraded":"2024-09-11T14:47:19.245794+0000","last_fullsized":"2024-09-11T14:47:19.245794+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22085632,"num_objects":337,"num_object_clones":0,"num_object_copies":1011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":24384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.040945+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:46:43.040945+0000","last_peered":"2024-09-11T14:46:43.040945+0000","last_clean":"2024-09-11T14:46:43.040945+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:46:43.040945+0000","last_undegraded":"2024-09-11T14:46:43.040945+0000","last_fullsized":"2024-09-11T14:46:43.040945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"76'449","reported_seq":488,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:17.871560+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:47:17.871560+0000","last_peered":"2024-09-11T14:47:17.871560+0000","last_clean":"2024-09-11T14:47:17.871560+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:47:17.871560+0000","last_undegraded":"2024-09-11T14:47:17.871560+0000","last_fullsized":"2024-09-11T14:47:17.871560+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23003136,"num_objects":351,"num_object_clones":0,"num_object_copies":1053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.012354+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:46:43.012354+0000","last_peered":"2024-09-11T14:46:43.012354+0000","last_clean":"2024-09-11T14:46:43.012354+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:46:43.012354+0000","last_undegraded":"2024-09-11T14:46:43.012354+0000","last_fullsized":"2024-09-11T14:46:43.012354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"76'460","reported_seq":499,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:19.072662+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:47:19.072662+0000","last_peered":"2024-09-11T14:47:19.072662+0000","last_clean":"2024-09-11T14:47:19.072662+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:47:19.072662+0000","last_undegraded":"2024-09-11T14:47:19.072662+0000","last_fullsized":"2024-09-11T14:47:19.072662+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23330816,"num_objects":356,"num_object_clones":0,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":460,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.036415+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:46:43.036415+0000","last_peered":"2024-09-11T14:46:43.036415+0000","last_clean":"2024-09-11T14:46:43.036415+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:46:43.036415+0000","last_undegraded":"2024-09-11T14:46:43.036415+0000","last_fullsized":"2024-09-11T14:46:43.036415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'474","reported_seq":513,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:17.693810+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:47:17.693810+0000","last_peered":"2024-09-11T14:47:17.693810+0000","last_clean":"2024-09-11T14:47:17.693810+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:47:17.693810+0000","last_undegraded":"2024-09-11T14:47:17.693810+0000","last_fullsized":"2024-09-11T14:47:17.693810+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25034752,"num_objects":382,"num_object_clones":0,"num_object_copies":1146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.038790+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:46:43.038790+0000","last_peered":"2024-09-11T14:46:43.038790+0000","last_clean":"2024-09-11T14:46:43.038790+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:46:43.038790+0000","last_undegraded":"2024-09-11T14:46:43.038790+0000","last_fullsized":"2024-09-11T14:46:43.038790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"76'484","reported_seq":523,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:18.147491+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:47:18.147491+0000","last_peered":"2024-09-11T14:47:18.147491+0000","last_clean":"2024-09-11T14:47:18.147491+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:47:18.147491+0000","last_undegraded":"2024-09-11T14:47:18.147491+0000","last_fullsized":"2024-09-11T14:47:18.147491+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":384,"num_object_clones":0,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":484,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.019157+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.019157+0000","last_peered":"2024-09-11T14:46:43.019157+0000","last_clean":"2024-09-11T14:46:43.019157+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:46:43.019157+0000","last_undegraded":"2024-09-11T14:46:43.019157+0000","last_fullsized":"2024-09-11T14:46:43.019157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"76'430","reported_seq":469,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:17.944593+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:47:17.944593+0000","last_peered":"2024-09-11T14:47:17.944593+0000","last_clean":"2024-09-11T14:47:17.944593+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:47:17.944593+0000","last_undegraded":"2024-09-11T14:47:17.944593+0000","last_fullsized":"2024-09-11T14:47:17.944593+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21364736,"num_objects":326,"num_object_clones":0,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":430,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.039999+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.039999+0000","last_peered":"2024-09-11T14:46:43.039999+0000","last_clean":"2024-09-11T14:46:43.039999+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:46:43.039999+0000","last_undegraded":"2024-09-11T14:46:43.039999+0000","last_fullsized":"2024-09-11T14:46:43.039999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"76'416","reported_seq":455,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:18.010158+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:47:18.010158+0000","last_peered":"2024-09-11T14:47:18.010158+0000","last_clean":"2024-09-11T14:47:18.010158+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:47:18.010158+0000","last_undegraded":"2024-09-11T14:47:18.010158+0000","last_fullsized":"2024-09-11T14:47:18.010158+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.023012+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:46:43.023012+0000","last_peered":"2024-09-11T14:46:43.023012+0000","last_clean":"2024-09-11T14:46:43.023012+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:46:43.023012+0000","last_undegraded":"2024-09-11T14:46:43.023012+0000","last_fullsized":"2024-09-11T14:46:43.023012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":371195928,"num_objects":5665,"num_object_clones":0,"num_object_copies":16995,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7195,"num_write_kb":411457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211950923776,"internally_reserved":0,"allocated":2260570112,"data_stored":2260570112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7195,"ondisk_log_size":7195,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211950923776,"internally_reserved":0,"allocated":2260570112,"data_stored":2260570112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53037109248,"internally_reserved":0,"allocated":515764224,"data_stored":515764224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":508556,"kb_used_data":508556,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51789172,"statfs":{"total":53552873472,"available":53032112128,"internally_reserved":0,"allocated":520761344,"data_stored":520761344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706338,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":511556,"kb_used_data":511556,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51786172,"statfs":{"total":53552873472,"available":53029040128,"internally_reserved":0,"allocated":523833344,"data_stored":523833344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706338,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":598260,"kb_used_data":598260,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51699468,"statfs":{"total":53552873472,"available":52940255232,"internally_reserved":0,"allocated":612618240,"data_stored":612618240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706338,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":598576,"kb_used_data":598576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51699152,"statfs":{"total":53552873472,"available":52939931648,"internally_reserved":0,"allocated":612941824,"data_stored":612941824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53037109248,"internally_reserved":0,"allocated":515764224,"data_stored":515764224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52940910592,"internally_reserved":0,"allocated":611962880,"data_stored":611962880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52943339520,"internally_reserved":0,"allocated":609533952,"data_stored":609533952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53029433344,"internally_reserved":0,"allocated":523440128,"data_stored":523440128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53037240320,"internally_reserved":0,"allocated":515633152,"data_stored":515633152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":52940910592,"internally_reserved":0,"allocated":611962880,"data_stored":611962880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":52943339520,"internally_reserved":0,"allocated":609533952,"data_stored":609533952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53029433344,"internally_reserved":0,"allocated":523440128,"data_stored":523440128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53037240320,"internally_reserved":0,"allocated":515633152,"data_stored":515633152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:47:24.416 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:47:24.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:24.539+0000 7f1a7c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:24.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:24.546+0000 7f1a7c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:26.970 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:47:27.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:27.095+0000 7fbf6f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:27.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:27.103+0000 7fbf6f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:29.307 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:47:29.307 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:47:29.308 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:47:29.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:29.434+0000 7fdfd60d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:29.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:29.444+0000 7fdfd60d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:29.555 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:47:29.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:29.712+0000 7f5f9bb48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:29.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:29.720+0000 7f5f9bb48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:29.803 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:47:29.804 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:47:29.819 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":412,"stamp":"2024-09-11T14:47:29.367322+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":326042187,"num_objects":4971,"num_object_clones":0,"num_object_copies":14913,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":7974,"num_write_kb":412565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7948,"ondisk_log_size":7948,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1941080,"kb_used_data":1941080,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207249832,"statfs":{"total":214211493888,"available":212223827968,"internally_reserved":0,"allocated":1987665920,"data_stored":1987665920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-76939264,"num_objects":-1174,"num_object_clones":0,"num_object_copies":-3522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002693"},"pg_stats":[{"pgid":"6.f","version":"76'460","reported_seq":499,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:28.031387+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:47:28.031387+0000","last_peered":"2024-09-11T14:47:28.031387+0000","last_clean":"2024-09-11T14:47:28.031387+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:47:28.031387+0000","last_undegraded":"2024-09-11T14:47:28.031387+0000","last_fullsized":"2024-09-11T14:47:28.031387+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":460,"num_write_kb":23360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'483","reported_seq":522,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:28.303838+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:47:28.303838+0000","last_peered":"2024-09-11T14:47:28.303838+0000","last_clean":"2024-09-11T14:47:28.303838+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:47:28.303838+0000","last_undegraded":"2024-09-11T14:47:28.303838+0000","last_fullsized":"2024-09-11T14:47:28.303838+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18677760,"num_objects":285,"num_object_clones":0,"num_object_copies":855,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":483,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"76'477","reported_seq":517,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:28.132100+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:47:28.132100+0000","last_peered":"2024-09-11T14:47:28.132100+0000","last_clean":"2024-09-11T14:47:28.132100+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:47:28.132100+0000","last_undegraded":"2024-09-11T14:47:28.132100+0000","last_fullsized":"2024-09-11T14:47:28.132100+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18481176,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":477,"num_write_kb":24257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"76'493","reported_seq":532,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:24.266988+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:47:24.266988+0000","last_peered":"2024-09-11T14:47:24.266988+0000","last_clean":"2024-09-11T14:47:24.266988+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:47:24.266988+0000","last_undegraded":"2024-09-11T14:47:24.266988+0000","last_fullsized":"2024-09-11T14:47:24.266988+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22478848,"num_objects":343,"num_object_clones":0,"num_object_copies":1029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":493,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"76'484","reported_seq":523,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:27.818871+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:47:27.818871+0000","last_peered":"2024-09-11T14:47:27.818871+0000","last_clean":"2024-09-11T14:47:27.818871+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:47:27.818871+0000","last_undegraded":"2024-09-11T14:47:27.818871+0000","last_fullsized":"2024-09-11T14:47:27.818871+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20185088,"num_objects":308,"num_object_clones":0,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":484,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'543","reported_seq":582,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:27.937422+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:47:27.937422+0000","last_peered":"2024-09-11T14:47:27.937422+0000","last_clean":"2024-09-11T14:47:27.937422+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:47:27.937422+0000","last_undegraded":"2024-09-11T14:47:27.937422+0000","last_fullsized":"2024-09-11T14:47:27.937422+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21823488,"num_objects":333,"num_object_clones":0,"num_object_copies":999,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'462","reported_seq":501,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:24.172885+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:47:24.172885+0000","last_peered":"2024-09-11T14:47:24.172885+0000","last_clean":"2024-09-11T14:47:24.172885+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:47:24.172885+0000","last_undegraded":"2024-09-11T14:47:24.172885+0000","last_fullsized":"2024-09-11T14:47:24.172885+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21364736,"num_objects":326,"num_object_clones":0,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"76'536","reported_seq":575,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:27.823671+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:47:27.823671+0000","last_peered":"2024-09-11T14:47:27.823671+0000","last_clean":"2024-09-11T14:47:27.823671+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:47:27.823671+0000","last_undegraded":"2024-09-11T14:47:27.823671+0000","last_fullsized":"2024-09-11T14:47:27.823671+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":320,"num_object_clones":0,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'517","reported_seq":556,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:28.206077+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:47:28.206077+0000","last_peered":"2024-09-11T14:47:28.206077+0000","last_clean":"2024-09-11T14:47:28.206077+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:47:28.206077+0000","last_undegraded":"2024-09-11T14:47:28.206077+0000","last_fullsized":"2024-09-11T14:47:28.206077+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":268,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.014461+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:46:43.014461+0000","last_peered":"2024-09-11T14:46:43.014461+0000","last_clean":"2024-09-11T14:46:43.014461+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:46:43.014461+0000","last_undegraded":"2024-09-11T14:46:43.014461+0000","last_fullsized":"2024-09-11T14:46:43.014461+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.021089+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:46:43.021089+0000","last_peered":"2024-09-11T14:46:43.021089+0000","last_clean":"2024-09-11T14:46:43.021089+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:46:43.021089+0000","last_undegraded":"2024-09-11T14:46:43.021089+0000","last_fullsized":"2024-09-11T14:46:43.021089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"76'452","reported_seq":491,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:24.041057+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:47:24.041057+0000","last_peered":"2024-09-11T14:47:24.041057+0000","last_clean":"2024-09-11T14:47:24.041057+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:47:24.041057+0000","last_undegraded":"2024-09-11T14:47:24.041057+0000","last_fullsized":"2024-09-11T14:47:24.041057+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20316160,"num_objects":310,"num_object_clones":0,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":452,"num_write_kb":24384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.040945+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:46:43.040945+0000","last_peered":"2024-09-11T14:46:43.040945+0000","last_clean":"2024-09-11T14:46:43.040945+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:46:43.040945+0000","last_undegraded":"2024-09-11T14:46:43.040945+0000","last_fullsized":"2024-09-11T14:46:43.040945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"76'497","reported_seq":536,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:27.836920+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:47:27.836920+0000","last_peered":"2024-09-11T14:47:27.836920+0000","last_clean":"2024-09-11T14:47:27.836920+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:47:27.836920+0000","last_undegraded":"2024-09-11T14:47:27.836920+0000","last_fullsized":"2024-09-11T14:47:27.836920+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.012354+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:46:43.012354+0000","last_peered":"2024-09-11T14:46:43.012354+0000","last_clean":"2024-09-11T14:46:43.012354+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:46:43.012354+0000","last_undegraded":"2024-09-11T14:46:43.012354+0000","last_fullsized":"2024-09-11T14:46:43.012354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"76'481","reported_seq":520,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:23.988128+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:47:23.988128+0000","last_peered":"2024-09-11T14:47:23.988128+0000","last_clean":"2024-09-11T14:47:23.988128+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:47:23.988128+0000","last_undegraded":"2024-09-11T14:47:23.988128+0000","last_fullsized":"2024-09-11T14:47:23.988128+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.036415+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:46:43.036415+0000","last_peered":"2024-09-11T14:46:43.036415+0000","last_clean":"2024-09-11T14:46:43.036415+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:46:43.036415+0000","last_undegraded":"2024-09-11T14:46:43.036415+0000","last_fullsized":"2024-09-11T14:46:43.036415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'529","reported_seq":568,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:28.182292+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:47:28.182292+0000","last_peered":"2024-09-11T14:47:28.182292+0000","last_clean":"2024-09-11T14:47:28.182292+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:47:28.182292+0000","last_undegraded":"2024-09-11T14:47:28.182292+0000","last_fullsized":"2024-09-11T14:47:28.182292+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21430272,"num_objects":327,"num_object_clones":0,"num_object_copies":981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.038790+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:46:43.038790+0000","last_peered":"2024-09-11T14:46:43.038790+0000","last_clean":"2024-09-11T14:46:43.038790+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:46:43.038790+0000","last_undegraded":"2024-09-11T14:46:43.038790+0000","last_fullsized":"2024-09-11T14:46:43.038790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"76'545","reported_seq":584,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:28.325608+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:47:28.325608+0000","last_peered":"2024-09-11T14:47:28.325608+0000","last_clean":"2024-09-11T14:47:28.325608+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:47:28.325608+0000","last_undegraded":"2024-09-11T14:47:28.325608+0000","last_fullsized":"2024-09-11T14:47:28.325608+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.019157+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.019157+0000","last_peered":"2024-09-11T14:46:43.019157+0000","last_clean":"2024-09-11T14:46:43.019157+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:46:43.019157+0000","last_undegraded":"2024-09-11T14:46:43.019157+0000","last_fullsized":"2024-09-11T14:46:43.019157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"76'477","reported_seq":516,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:28.089986+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:47:28.089986+0000","last_peered":"2024-09-11T14:47:28.089986+0000","last_clean":"2024-09-11T14:47:28.089986+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:47:28.089986+0000","last_undegraded":"2024-09-11T14:47:28.089986+0000","last_fullsized":"2024-09-11T14:47:28.089986+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":477,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.039999+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.039999+0000","last_peered":"2024-09-11T14:46:43.039999+0000","last_clean":"2024-09-11T14:46:43.039999+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:46:43.039999+0000","last_undegraded":"2024-09-11T14:46:43.039999+0000","last_fullsized":"2024-09-11T14:46:43.039999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"76'457","reported_seq":496,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:27.873810+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:47:27.873810+0000","last_peered":"2024-09-11T14:47:27.873810+0000","last_clean":"2024-09-11T14:47:27.873810+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:47:27.873810+0000","last_undegraded":"2024-09-11T14:47:27.873810+0000","last_fullsized":"2024-09-11T14:47:27.873810+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.023012+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:46:43.023012+0000","last_peered":"2024-09-11T14:46:43.023012+0000","last_clean":"2024-09-11T14:46:43.023012+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:46:43.023012+0000","last_undegraded":"2024-09-11T14:46:43.023012+0000","last_fullsized":"2024-09-11T14:46:43.023012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":325451800,"num_objects":4967,"num_object_clones":0,"num_object_copies":14901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7893,"num_write_kb":411457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212231659520,"internally_reserved":0,"allocated":1979834368,"data_stored":1979834368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7893,"ondisk_log_size":7893,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212231659520,"internally_reserved":0,"allocated":1979834368,"data_stored":1979834368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53072683008,"internally_reserved":0,"allocated":480190464,"data_stored":480190464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673639,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":472652,"kb_used_data":472652,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51825076,"statfs":{"total":53552873472,"available":53068877824,"internally_reserved":0,"allocated":483995648,"data_stored":483995648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706348,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":439376,"kb_used_data":439376,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51858352,"statfs":{"total":53552873472,"available":53102952448,"internally_reserved":0,"allocated":449921024,"data_stored":449921024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706348,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":514196,"kb_used_data":514196,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51783532,"statfs":{"total":53552873472,"available":53026336768,"internally_reserved":0,"allocated":526536704,"data_stored":526536704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706348,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":514856,"kb_used_data":514856,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51782872,"statfs":{"total":53552873472,"available":53025660928,"internally_reserved":0,"allocated":527212544,"data_stored":527212544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53072683008,"internally_reserved":0,"allocated":480190464,"data_stored":480190464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53027131392,"internally_reserved":0,"allocated":525742080,"data_stored":525742080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53028761600,"internally_reserved":0,"allocated":524111872,"data_stored":524111872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53103083520,"internally_reserved":0,"allocated":449789952,"data_stored":449789952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53072683008,"internally_reserved":0,"allocated":480190464,"data_stored":480190464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53027131392,"internally_reserved":0,"allocated":525742080,"data_stored":525742080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53028761600,"internally_reserved":0,"allocated":524111872,"data_stored":524111872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53103083520,"internally_reserved":0,"allocated":449789952,"data_stored":449789952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53072683008,"internally_reserved":0,"allocated":480190464,"data_stored":480190464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:47:32.231 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:47:32.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:32.357+0000 7f6f4b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:32.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:32.366+0000 7f6f4b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:34.821 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:47:34.822 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:47:34.822 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:47:34.822 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:47:34.836 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:47:34.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:34.975+0000 7f64bb551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:34.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:34.994+0000 7f64bb551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:35.041 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:47:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:47:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:47:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:47:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:47:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:47:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:47:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:47:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:47:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:47:35.043 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:47:35.043 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:47:35.046 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:47:35.047 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:47:35.047 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:47:35.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:35.042+0000 7fd76d8ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:35.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:35.052+0000 7fd76d8ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:35.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:35.190+0000 7f5f5f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:35.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:35.201+0000 7f5f5f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:35.387 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:47:35.387 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:47:35.387 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:47:35.387 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:47:35.388 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:47:35.388 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:47:35.388 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:47:35.388 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:47:35.388 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:47:35.388 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:47:35.388 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:47:35.388 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:47:35.391 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:47:35.392 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:47:35.392 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:47:35.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:35.594+0000 7fc219f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:35.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:35.612+0000 7fc219f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:35.806 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:47:35.806 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:47:35.806 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:47:35.806 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:47:35.806 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:47:35.807 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:47:35.807 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:47:35.807 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:47:35.807 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:47:35.807 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:47:35.807 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:47:35.807 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:47:35.809 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:47:35.810 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:47:35.810 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:47:36.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:36.004+0000 7f4250ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:36.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:36.016+0000 7f4250ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:36.137 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:47:36.137 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:47:36.137 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:47:36.137 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:47:36.138 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:47:36.138 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:47:36.138 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:47:36.138 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:47:36.138 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:47:36.138 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:47:36.138 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:47:36.138 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:47:36.140 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:47:36.141 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:47:37.578 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:47:37.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:37.704+0000 7f2b17eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:37.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:37.711+0000 7f2b17eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:40.303 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:47:40.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:40.426+0000 7f7c93591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:40.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:40.434+0000 7f7c93591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:41.142 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:47:41.142 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:47:41.143 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:47:41.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:41.293+0000 7ff53d591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:41.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:41.303+0000 7ff53d591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:41.611 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:47:41.612 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:47:41.631 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":418,"stamp":"2024-09-11T14:47:41.370070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":266076747,"num_objects":4056,"num_object_clones":0,"num_object_copies":12168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":8889,"num_write_kb":412565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8863,"ondisk_log_size":8863,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1607880,"kb_used_data":1607880,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207583032,"statfs":{"total":214211493888,"available":212565024768,"internally_reserved":0,"allocated":1646469120,"data_stored":1646469120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-59965440,"num_objects":-915,"num_object_clones":0,"num_object_copies":-2745,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":915,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002747"},"pg_stats":[{"pgid":"6.f","version":"76'497","reported_seq":536,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:38.098578+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:47:38.098578+0000","last_peered":"2024-09-11T14:47:38.098578+0000","last_clean":"2024-09-11T14:47:38.098578+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:47:38.098578+0000","last_undegraded":"2024-09-11T14:47:38.098578+0000","last_fullsized":"2024-09-11T14:47:38.098578+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15269888,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":23360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'533","reported_seq":572,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:37.713634+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:47:37.713634+0000","last_peered":"2024-09-11T14:47:37.713634+0000","last_clean":"2024-09-11T14:47:37.713634+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:47:37.713634+0000","last_undegraded":"2024-09-11T14:47:37.713634+0000","last_fullsized":"2024-09-11T14:47:37.713634+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"76'519","reported_seq":559,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:38.149689+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:47:38.149689+0000","last_peered":"2024-09-11T14:47:38.149689+0000","last_clean":"2024-09-11T14:47:38.149689+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:47:38.149689+0000","last_undegraded":"2024-09-11T14:47:38.149689+0000","last_fullsized":"2024-09-11T14:47:38.149689+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728664,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":519,"num_write_kb":24257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"76'568","reported_seq":607,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:39.319973+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:47:39.319973+0000","last_peered":"2024-09-11T14:47:39.319973+0000","last_clean":"2024-09-11T14:47:39.319973+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:47:39.319973+0000","last_undegraded":"2024-09-11T14:47:39.319973+0000","last_fullsized":"2024-09-11T14:47:39.319973+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"76'541","reported_seq":580,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:38.074742+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:47:38.074742+0000","last_peered":"2024-09-11T14:47:38.074742+0000","last_clean":"2024-09-11T14:47:38.074742+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:47:38.074742+0000","last_undegraded":"2024-09-11T14:47:38.074742+0000","last_fullsized":"2024-09-11T14:47:38.074742+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16449536,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'609","reported_seq":648,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:38.405697+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:47:38.405697+0000","last_peered":"2024-09-11T14:47:38.405697+0000","last_clean":"2024-09-11T14:47:38.405697+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:47:38.405697+0000","last_undegraded":"2024-09-11T14:47:38.405697+0000","last_fullsized":"2024-09-11T14:47:38.405697+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17498112,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'539","reported_seq":578,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:39.136540+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:47:39.136540+0000","last_peered":"2024-09-11T14:47:39.136540+0000","last_clean":"2024-09-11T14:47:39.136540+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:47:39.136540+0000","last_undegraded":"2024-09-11T14:47:39.136540+0000","last_fullsized":"2024-09-11T14:47:39.136540+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16318464,"num_objects":249,"num_object_clones":0,"num_object_copies":747,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"76'577","reported_seq":616,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:38.106466+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:47:38.106466+0000","last_peered":"2024-09-11T14:47:38.106466+0000","last_clean":"2024-09-11T14:47:38.106466+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:47:38.106466+0000","last_undegraded":"2024-09-11T14:47:38.106466+0000","last_fullsized":"2024-09-11T14:47:38.106466+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":577,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'574","reported_seq":613,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:38.304399+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:47:38.304399+0000","last_peered":"2024-09-11T14:47:38.304399+0000","last_clean":"2024-09-11T14:47:38.304399+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:47:38.304399+0000","last_undegraded":"2024-09-11T14:47:38.304399+0000","last_fullsized":"2024-09-11T14:47:38.304399+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17432576,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":574,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":268,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.014461+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:46:43.014461+0000","last_peered":"2024-09-11T14:46:43.014461+0000","last_clean":"2024-09-11T14:46:43.014461+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:46:43.014461+0000","last_undegraded":"2024-09-11T14:46:43.014461+0000","last_fullsized":"2024-09-11T14:46:43.014461+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.021089+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:46:43.021089+0000","last_peered":"2024-09-11T14:46:43.021089+0000","last_clean":"2024-09-11T14:46:43.021089+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:46:43.021089+0000","last_undegraded":"2024-09-11T14:46:43.021089+0000","last_fullsized":"2024-09-11T14:46:43.021089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"76'528","reported_seq":567,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:38.715348+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:47:38.715348+0000","last_peered":"2024-09-11T14:47:38.715348+0000","last_clean":"2024-09-11T14:47:38.715348+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:47:38.715348+0000","last_undegraded":"2024-09-11T14:47:38.715348+0000","last_fullsized":"2024-09-11T14:47:38.715348+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15335424,"num_objects":234,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":24384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.040945+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:46:43.040945+0000","last_peered":"2024-09-11T14:46:43.040945+0000","last_clean":"2024-09-11T14:46:43.040945+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:46:43.040945+0000","last_undegraded":"2024-09-11T14:46:43.040945+0000","last_fullsized":"2024-09-11T14:46:43.040945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"76'550","reported_seq":589,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:38.379890+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:47:38.379890+0000","last_peered":"2024-09-11T14:47:38.379890+0000","last_clean":"2024-09-11T14:47:38.379890+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:47:38.379890+0000","last_undegraded":"2024-09-11T14:47:38.379890+0000","last_fullsized":"2024-09-11T14:47:38.379890+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16384000,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.012354+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:46:43.012354+0000","last_peered":"2024-09-11T14:46:43.012354+0000","last_clean":"2024-09-11T14:46:43.012354+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:46:43.012354+0000","last_undegraded":"2024-09-11T14:46:43.012354+0000","last_fullsized":"2024-09-11T14:46:43.012354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"76'565","reported_seq":604,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:39.326871+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:47:39.326871+0000","last_peered":"2024-09-11T14:47:39.326871+0000","last_clean":"2024-09-11T14:47:39.326871+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:47:39.326871+0000","last_undegraded":"2024-09-11T14:47:39.326871+0000","last_fullsized":"2024-09-11T14:47:39.326871+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16449536,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":565,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.036415+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:46:43.036415+0000","last_peered":"2024-09-11T14:46:43.036415+0000","last_clean":"2024-09-11T14:46:43.036415+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:46:43.036415+0000","last_undegraded":"2024-09-11T14:46:43.036415+0000","last_fullsized":"2024-09-11T14:46:43.036415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'570","reported_seq":609,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:38.041392+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:47:38.041392+0000","last_peered":"2024-09-11T14:47:38.041392+0000","last_clean":"2024-09-11T14:47:38.041392+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:47:38.041392+0000","last_undegraded":"2024-09-11T14:47:38.041392+0000","last_fullsized":"2024-09-11T14:47:38.041392+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18743296,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":570,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.038790+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:46:43.038790+0000","last_peered":"2024-09-11T14:46:43.038790+0000","last_clean":"2024-09-11T14:46:43.038790+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:46:43.038790+0000","last_undegraded":"2024-09-11T14:46:43.038790+0000","last_fullsized":"2024-09-11T14:46:43.038790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"76'603","reported_seq":642,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:38.334544+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:47:38.334544+0000","last_peered":"2024-09-11T14:47:38.334544+0000","last_clean":"2024-09-11T14:47:38.334544+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:47:38.334544+0000","last_undegraded":"2024-09-11T14:47:38.334544+0000","last_fullsized":"2024-09-11T14:47:38.334544+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17367040,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.019157+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.019157+0000","last_peered":"2024-09-11T14:46:43.019157+0000","last_clean":"2024-09-11T14:46:43.019157+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:46:43.019157+0000","last_undegraded":"2024-09-11T14:46:43.019157+0000","last_fullsized":"2024-09-11T14:46:43.019157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"76'531","reported_seq":570,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:38.302623+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:47:38.302623+0000","last_peered":"2024-09-11T14:47:38.302623+0000","last_clean":"2024-09-11T14:47:38.302623+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:47:38.302623+0000","last_undegraded":"2024-09-11T14:47:38.302623+0000","last_fullsized":"2024-09-11T14:47:38.302623+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.039999+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.039999+0000","last_peered":"2024-09-11T14:46:43.039999+0000","last_clean":"2024-09-11T14:46:43.039999+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:46:43.039999+0000","last_undegraded":"2024-09-11T14:46:43.039999+0000","last_fullsized":"2024-09-11T14:46:43.039999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"76'504","reported_seq":543,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:38.265128+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:47:38.265128+0000","last_peered":"2024-09-11T14:47:38.265128+0000","last_clean":"2024-09-11T14:47:38.265128+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:47:38.265128+0000","last_undegraded":"2024-09-11T14:47:38.265128+0000","last_fullsized":"2024-09-11T14:47:38.265128+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16515072,"num_objects":252,"num_object_clones":0,"num_object_copies":756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.023012+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:46:43.023012+0000","last_peered":"2024-09-11T14:46:43.023012+0000","last_clean":"2024-09-11T14:46:43.023012+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:46:43.023012+0000","last_undegraded":"2024-09-11T14:46:43.023012+0000","last_fullsized":"2024-09-11T14:46:43.023012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":265486360,"num_objects":4052,"num_object_clones":0,"num_object_copies":12156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8808,"num_write_kb":411457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212580642816,"internally_reserved":0,"allocated":1630851072,"data_stored":1630851072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8808,"ondisk_log_size":8808,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212580511744,"internally_reserved":0,"allocated":1630982144,"data_stored":1630982144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53179219968,"internally_reserved":0,"allocated":373653504,"data_stored":373653504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673654,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":368648,"kb_used_data":368648,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51929080,"statfs":{"total":53552873472,"available":53175377920,"internally_reserved":0,"allocated":377495552,"data_stored":377495552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706358,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":376120,"kb_used_data":376120,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51921608,"statfs":{"total":53552873472,"available":53167726592,"internally_reserved":0,"allocated":385146880,"data_stored":385146880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706358,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":431996,"kb_used_data":431996,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51865732,"statfs":{"total":53552873472,"available":53110509568,"internally_reserved":0,"allocated":442363904,"data_stored":442363904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706358,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":431116,"kb_used_data":431116,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51866612,"statfs":{"total":53552873472,"available":53111410688,"internally_reserved":0,"allocated":441462784,"data_stored":441462784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53179219968,"internally_reserved":0,"allocated":373653504,"data_stored":373653504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53111296000,"internally_reserved":0,"allocated":441577472,"data_stored":441577472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53115559936,"internally_reserved":0,"allocated":437313536,"data_stored":437313536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53174173696,"internally_reserved":0,"allocated":378699776,"data_stored":378699776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53179482112,"internally_reserved":0,"allocated":373391360,"data_stored":373391360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53111296000,"internally_reserved":0,"allocated":441577472,"data_stored":441577472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53115559936,"internally_reserved":0,"allocated":437313536,"data_stored":437313536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53174173696,"internally_reserved":0,"allocated":378699776,"data_stored":378699776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53179613184,"internally_reserved":0,"allocated":373260288,"data_stored":373260288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:47:42.889 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:47:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:43.036+0000 7f1653a88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:43.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:43.044+0000 7f1653a88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:45.647 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:47:45.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:45.812+0000 7f3f56f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:45.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:45.822+0000 7f3f56f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:46.792 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:47:46.792 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:47:46.793 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:47:46.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:46.930+0000 7fc416d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:46.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:46.942+0000 7fc416d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:47.224 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:47:47.224 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:47:47.237 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":420,"stamp":"2024-09-11T14:47:45.370859+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":241041995,"num_objects":3674,"num_object_clones":0,"num_object_copies":11022,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":9271,"num_write_kb":412565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9245,"ondisk_log_size":9245,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1457084,"kb_used_data":1457084,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207733828,"statfs":{"total":214211493888,"available":212719439872,"internally_reserved":0,"allocated":1492054016,"data_stored":1492054016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-77791232,"num_objects":-1187,"num_object_clones":0,"num_object_copies":-3561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1187,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002612"},"pg_stats":[{"pgid":"6.f","version":"76'521","reported_seq":560,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:43.019423+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:47:43.019423+0000","last_peered":"2024-09-11T14:47:43.019423+0000","last_clean":"2024-09-11T14:47:43.019423+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:47:43.019423+0000","last_undegraded":"2024-09-11T14:47:43.019423+0000","last_fullsized":"2024-09-11T14:47:43.019423+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13697024,"num_objects":209,"num_object_clones":0,"num_object_copies":627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":521,"num_write_kb":23360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'552","reported_seq":591,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:42.793884+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:47:42.793884+0000","last_peered":"2024-09-11T14:47:42.793884+0000","last_clean":"2024-09-11T14:47:42.793884+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:47:42.793884+0000","last_undegraded":"2024-09-11T14:47:42.793884+0000","last_fullsized":"2024-09-11T14:47:42.793884+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14155776,"num_objects":216,"num_object_clones":0,"num_object_copies":648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"76'539","reported_seq":579,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:43.244432+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:47:43.244432+0000","last_peered":"2024-09-11T14:47:43.244432+0000","last_clean":"2024-09-11T14:47:43.244432+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:47:43.244432+0000","last_undegraded":"2024-09-11T14:47:43.244432+0000","last_fullsized":"2024-09-11T14:47:43.244432+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14417944,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":539,"num_write_kb":24257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"76'599","reported_seq":638,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:44.041114+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:47:44.041114+0000","last_peered":"2024-09-11T14:47:44.041114+0000","last_clean":"2024-09-11T14:47:44.041114+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:47:44.041114+0000","last_undegraded":"2024-09-11T14:47:44.041114+0000","last_fullsized":"2024-09-11T14:47:44.041114+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15532032,"num_objects":237,"num_object_clones":0,"num_object_copies":711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":599,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"76'561","reported_seq":600,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:42.849380+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:47:42.849380+0000","last_peered":"2024-09-11T14:47:42.849380+0000","last_clean":"2024-09-11T14:47:42.849380+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:47:42.849380+0000","last_undegraded":"2024-09-11T14:47:42.849380+0000","last_fullsized":"2024-09-11T14:47:42.849380+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15138816,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":561,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'641","reported_seq":680,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:43.352043+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:47:43.352043+0000","last_peered":"2024-09-11T14:47:43.352043+0000","last_clean":"2024-09-11T14:47:43.352043+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:47:43.352043+0000","last_undegraded":"2024-09-11T14:47:43.352043+0000","last_fullsized":"2024-09-11T14:47:43.352043+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":641,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'562","reported_seq":601,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:44.058135+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:47:44.058135+0000","last_peered":"2024-09-11T14:47:44.058135+0000","last_clean":"2024-09-11T14:47:44.058135+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:47:44.058135+0000","last_undegraded":"2024-09-11T14:47:44.058135+0000","last_fullsized":"2024-09-11T14:47:44.058135+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"76'608","reported_seq":647,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:43.299391+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:47:43.299391+0000","last_peered":"2024-09-11T14:47:43.299391+0000","last_clean":"2024-09-11T14:47:43.299391+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:47:43.299391+0000","last_undegraded":"2024-09-11T14:47:43.299391+0000","last_fullsized":"2024-09-11T14:47:43.299391+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16252928,"num_objects":248,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'595","reported_seq":634,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:43.024437+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:47:43.024437+0000","last_peered":"2024-09-11T14:47:43.024437+0000","last_clean":"2024-09-11T14:47:43.024437+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:47:43.024437+0000","last_undegraded":"2024-09-11T14:47:43.024437+0000","last_fullsized":"2024-09-11T14:47:43.024437+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056320,"num_objects":245,"num_object_clones":0,"num_object_copies":735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":595,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":268,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.014461+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:46:43.014461+0000","last_peered":"2024-09-11T14:46:43.014461+0000","last_clean":"2024-09-11T14:46:43.014461+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:46:43.014461+0000","last_undegraded":"2024-09-11T14:46:43.014461+0000","last_fullsized":"2024-09-11T14:46:43.014461+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.021089+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:46:43.021089+0000","last_peered":"2024-09-11T14:46:43.021089+0000","last_clean":"2024-09-11T14:46:43.021089+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:46:43.021089+0000","last_undegraded":"2024-09-11T14:46:43.021089+0000","last_fullsized":"2024-09-11T14:46:43.021089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"76'545","reported_seq":584,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:44.327512+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:47:44.327512+0000","last_peered":"2024-09-11T14:47:44.327512+0000","last_clean":"2024-09-11T14:47:44.327512+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:47:44.327512+0000","last_undegraded":"2024-09-11T14:47:44.327512+0000","last_fullsized":"2024-09-11T14:47:44.327512+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14221312,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":24384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.040945+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:46:43.040945+0000","last_peered":"2024-09-11T14:46:43.040945+0000","last_clean":"2024-09-11T14:46:43.040945+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:46:43.040945+0000","last_undegraded":"2024-09-11T14:46:43.040945+0000","last_fullsized":"2024-09-11T14:46:43.040945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"76'571","reported_seq":610,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:43.113971+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:47:43.113971+0000","last_peered":"2024-09-11T14:47:43.113971+0000","last_clean":"2024-09-11T14:47:43.113971+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:47:43.113971+0000","last_undegraded":"2024-09-11T14:47:43.113971+0000","last_fullsized":"2024-09-11T14:47:43.113971+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15007744,"num_objects":229,"num_object_clones":0,"num_object_copies":687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":571,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.012354+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:46:43.012354+0000","last_peered":"2024-09-11T14:46:43.012354+0000","last_clean":"2024-09-11T14:46:43.012354+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:46:43.012354+0000","last_undegraded":"2024-09-11T14:46:43.012354+0000","last_fullsized":"2024-09-11T14:46:43.012354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"76'587","reported_seq":626,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:43.916007+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:47:43.916007+0000","last_peered":"2024-09-11T14:47:43.916007+0000","last_clean":"2024-09-11T14:47:43.916007+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:47:43.916007+0000","last_undegraded":"2024-09-11T14:47:43.916007+0000","last_fullsized":"2024-09-11T14:47:43.916007+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15007744,"num_objects":229,"num_object_clones":0,"num_object_copies":687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.036415+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:46:43.036415+0000","last_peered":"2024-09-11T14:46:43.036415+0000","last_clean":"2024-09-11T14:46:43.036415+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:46:43.036415+0000","last_undegraded":"2024-09-11T14:46:43.036415+0000","last_fullsized":"2024-09-11T14:46:43.036415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'600","reported_seq":639,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:43.029708+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:47:43.029708+0000","last_peered":"2024-09-11T14:47:43.029708+0000","last_clean":"2024-09-11T14:47:43.029708+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:47:43.029708+0000","last_undegraded":"2024-09-11T14:47:43.029708+0000","last_fullsized":"2024-09-11T14:47:43.029708+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.038790+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:46:43.038790+0000","last_peered":"2024-09-11T14:46:43.038790+0000","last_clean":"2024-09-11T14:46:43.038790+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:46:43.038790+0000","last_undegraded":"2024-09-11T14:46:43.038790+0000","last_fullsized":"2024-09-11T14:46:43.038790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"76'629","reported_seq":668,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:43.237923+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:47:43.237923+0000","last_peered":"2024-09-11T14:47:43.237923+0000","last_clean":"2024-09-11T14:47:43.237923+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:47:43.237923+0000","last_undegraded":"2024-09-11T14:47:43.237923+0000","last_fullsized":"2024-09-11T14:47:43.237923+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":629,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.019157+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.019157+0000","last_peered":"2024-09-11T14:46:43.019157+0000","last_clean":"2024-09-11T14:46:43.019157+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:46:43.019157+0000","last_undegraded":"2024-09-11T14:46:43.019157+0000","last_fullsized":"2024-09-11T14:46:43.019157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"76'551","reported_seq":590,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:42.447659+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:47:42.447659+0000","last_peered":"2024-09-11T14:47:42.447659+0000","last_clean":"2024-09-11T14:47:42.447659+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:47:42.447659+0000","last_undegraded":"2024-09-11T14:47:42.447659+0000","last_fullsized":"2024-09-11T14:47:42.447659+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13434880,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":551,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.039999+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.039999+0000","last_peered":"2024-09-11T14:46:43.039999+0000","last_clean":"2024-09-11T14:46:43.039999+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:46:43.039999+0000","last_undegraded":"2024-09-11T14:46:43.039999+0000","last_fullsized":"2024-09-11T14:46:43.039999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"76'529","reported_seq":568,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:43.426917+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:47:43.426917+0000","last_peered":"2024-09-11T14:47:43.426917+0000","last_clean":"2024-09-11T14:47:43.426917+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:47:43.426917+0000","last_undegraded":"2024-09-11T14:47:43.426917+0000","last_fullsized":"2024-09-11T14:47:43.426917+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14876672,"num_objects":227,"num_object_clones":0,"num_object_copies":681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.023012+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:46:43.023012+0000","last_peered":"2024-09-11T14:46:43.023012+0000","last_clean":"2024-09-11T14:46:43.023012+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:46:43.023012+0000","last_undegraded":"2024-09-11T14:46:43.023012+0000","last_fullsized":"2024-09-11T14:46:43.023012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":240451608,"num_objects":3670,"num_object_clones":0,"num_object_copies":11010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9190,"num_write_kb":411457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212734066688,"internally_reserved":0,"allocated":1477427200,"data_stored":1477427200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9190,"ondisk_log_size":9190,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212733804544,"internally_reserved":0,"allocated":1477689344,"data_stored":1477689344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53213167616,"internally_reserved":0,"allocated":339705856,"data_stored":339705856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673659,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":334436,"kb_used_data":334436,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51963292,"statfs":{"total":53552873472,"available":53210411008,"internally_reserved":0,"allocated":342462464,"data_stored":342462464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706362,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":340520,"kb_used_data":340520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51957208,"statfs":{"total":53552873472,"available":53204180992,"internally_reserved":0,"allocated":348692480,"data_stored":348692480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706363,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":391868,"kb_used_data":391868,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51905860,"statfs":{"total":53552873472,"available":53151600640,"internally_reserved":0,"allocated":401272832,"data_stored":401272832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706363,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":390260,"kb_used_data":390260,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51907468,"statfs":{"total":53552873472,"available":53153247232,"internally_reserved":0,"allocated":399626240,"data_stored":399626240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53213167616,"internally_reserved":0,"allocated":339705856,"data_stored":339705856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53152260096,"internally_reserved":0,"allocated":400613376,"data_stored":400613376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53156597760,"internally_reserved":0,"allocated":396275712,"data_stored":396275712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53211779072,"internally_reserved":0,"allocated":341094400,"data_stored":341094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53213167616,"internally_reserved":0,"allocated":339705856,"data_stored":339705856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53152391168,"internally_reserved":0,"allocated":400482304,"data_stored":400482304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53156728832,"internally_reserved":0,"allocated":396144640,"data_stored":396144640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53211779072,"internally_reserved":0,"allocated":341094400,"data_stored":341094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53213167616,"internally_reserved":0,"allocated":339705856,"data_stored":339705856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:47:48.373 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:47:48.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:48.490+0000 7efc67d08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:48.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:48.497+0000 7efc67d08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:51.161 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:47:51.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:51.291+0000 7f961be7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:51.298+0000 7f961be7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:52.239 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:47:52.239 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:47:52.240 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:47:52.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:52.376+0000 7f74134d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:52.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:52.385+0000 7f74134d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:52.689 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:47:52.689 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:47:52.708 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":423,"stamp":"2024-09-11T14:47:51.372206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":218563147,"num_objects":3331,"num_object_clones":0,"num_object_copies":9993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":9614,"num_write_kb":412565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9588,"ondisk_log_size":9588,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1320608,"kb_used_data":1320608,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207870304,"statfs":{"total":214211493888,"available":212859191296,"internally_reserved":0,"allocated":1352302592,"data_stored":1352302592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-54722560,"num_objects":-835,"num_object_clones":0,"num_object_copies":-2505,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":835,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002589"},"pg_stats":[{"pgid":"6.f","version":"76'536","reported_seq":575,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:48.030187+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:47:48.030187+0000","last_peered":"2024-09-11T14:47:48.030187+0000","last_clean":"2024-09-11T14:47:48.030187+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:47:48.030187+0000","last_undegraded":"2024-09-11T14:47:48.030187+0000","last_fullsized":"2024-09-11T14:47:48.030187+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12713984,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":23360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'576","reported_seq":615,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:48.194429+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:47:48.194429+0000","last_peered":"2024-09-11T14:47:48.194429+0000","last_clean":"2024-09-11T14:47:48.194429+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:47:48.194429+0000","last_undegraded":"2024-09-11T14:47:48.194429+0000","last_fullsized":"2024-09-11T14:47:48.194429+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"76'556","reported_seq":596,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:47.510969+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:47:47.510969+0000","last_peered":"2024-09-11T14:47:47.510969+0000","last_clean":"2024-09-11T14:47:47.510969+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:47:47.510969+0000","last_undegraded":"2024-09-11T14:47:47.510969+0000","last_fullsized":"2024-09-11T14:47:47.510969+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303832,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":556,"num_write_kb":24257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"76'625","reported_seq":664,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:48.793930+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:47:48.793930+0000","last_peered":"2024-09-11T14:47:48.793930+0000","last_clean":"2024-09-11T14:47:48.793930+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:47:48.793930+0000","last_undegraded":"2024-09-11T14:47:48.793930+0000","last_fullsized":"2024-09-11T14:47:48.793930+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13828096,"num_objects":211,"num_object_clones":0,"num_object_copies":633,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":625,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"76'583","reported_seq":622,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:48.173736+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:47:48.173736+0000","last_peered":"2024-09-11T14:47:48.173736+0000","last_clean":"2024-09-11T14:47:48.173736+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:47:48.173736+0000","last_undegraded":"2024-09-11T14:47:48.173736+0000","last_fullsized":"2024-09-11T14:47:48.173736+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13697024,"num_objects":209,"num_object_clones":0,"num_object_copies":627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":583,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'665","reported_seq":704,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:48.220948+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:47:48.220948+0000","last_peered":"2024-09-11T14:47:48.220948+0000","last_clean":"2024-09-11T14:47:48.220948+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:47:48.220948+0000","last_undegraded":"2024-09-11T14:47:48.220948+0000","last_fullsized":"2024-09-11T14:47:48.220948+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13828096,"num_objects":211,"num_object_clones":0,"num_object_copies":633,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":665,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'586","reported_seq":625,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:49.245639+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:47:49.245639+0000","last_peered":"2024-09-11T14:47:49.245639+0000","last_clean":"2024-09-11T14:47:49.245639+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:47:49.245639+0000","last_undegraded":"2024-09-11T14:47:49.245639+0000","last_fullsized":"2024-09-11T14:47:49.245639+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13238272,"num_objects":202,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":586,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"76'624","reported_seq":663,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:48.106742+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:47:48.106742+0000","last_peered":"2024-09-11T14:47:48.106742+0000","last_clean":"2024-09-11T14:47:48.106742+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:47:48.106742+0000","last_undegraded":"2024-09-11T14:47:48.106742+0000","last_fullsized":"2024-09-11T14:47:48.106742+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15204352,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'619","reported_seq":658,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:47.324994+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:47:47.324994+0000","last_peered":"2024-09-11T14:47:47.324994+0000","last_clean":"2024-09-11T14:47:47.324994+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:47:47.324994+0000","last_undegraded":"2024-09-11T14:47:47.324994+0000","last_fullsized":"2024-09-11T14:47:47.324994+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14483456,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":268,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.014461+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:46:43.014461+0000","last_peered":"2024-09-11T14:46:43.014461+0000","last_clean":"2024-09-11T14:46:43.014461+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:46:43.014461+0000","last_undegraded":"2024-09-11T14:46:43.014461+0000","last_fullsized":"2024-09-11T14:46:43.014461+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.021089+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:46:43.021089+0000","last_peered":"2024-09-11T14:46:43.021089+0000","last_clean":"2024-09-11T14:46:43.021089+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:46:43.021089+0000","last_undegraded":"2024-09-11T14:46:43.021089+0000","last_fullsized":"2024-09-11T14:46:43.021089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"76'573","reported_seq":612,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:49.166786+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:47:49.166786+0000","last_peered":"2024-09-11T14:47:49.166786+0000","last_clean":"2024-09-11T14:47:49.166786+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:47:49.166786+0000","last_undegraded":"2024-09-11T14:47:49.166786+0000","last_fullsized":"2024-09-11T14:47:49.166786+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12386304,"num_objects":189,"num_object_clones":0,"num_object_copies":567,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":573,"num_write_kb":24384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.040945+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:46:43.040945+0000","last_peered":"2024-09-11T14:46:43.040945+0000","last_clean":"2024-09-11T14:46:43.040945+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:46:43.040945+0000","last_undegraded":"2024-09-11T14:46:43.040945+0000","last_fullsized":"2024-09-11T14:46:43.040945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"76'590","reported_seq":629,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:47.844789+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:47:47.844789+0000","last_peered":"2024-09-11T14:47:47.844789+0000","last_clean":"2024-09-11T14:47:47.844789+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:47:47.844789+0000","last_undegraded":"2024-09-11T14:47:47.844789+0000","last_fullsized":"2024-09-11T14:47:47.844789+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13762560,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":590,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.012354+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:46:43.012354+0000","last_peered":"2024-09-11T14:46:43.012354+0000","last_clean":"2024-09-11T14:46:43.012354+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:46:43.012354+0000","last_undegraded":"2024-09-11T14:46:43.012354+0000","last_fullsized":"2024-09-11T14:46:43.012354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"76'606","reported_seq":645,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:48.580001+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:47:48.580001+0000","last_peered":"2024-09-11T14:47:48.580001+0000","last_clean":"2024-09-11T14:47:48.580001+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:47:48.580001+0000","last_undegraded":"2024-09-11T14:47:48.580001+0000","last_fullsized":"2024-09-11T14:47:48.580001+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13762560,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":606,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.036415+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:46:43.036415+0000","last_peered":"2024-09-11T14:46:43.036415+0000","last_clean":"2024-09-11T14:46:43.036415+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:46:43.036415+0000","last_undegraded":"2024-09-11T14:46:43.036415+0000","last_fullsized":"2024-09-11T14:46:43.036415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'617","reported_seq":656,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:48.024425+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:47:48.024425+0000","last_peered":"2024-09-11T14:47:48.024425+0000","last_clean":"2024-09-11T14:47:48.024425+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:47:48.024425+0000","last_undegraded":"2024-09-11T14:47:48.024425+0000","last_fullsized":"2024-09-11T14:47:48.024425+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":617,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.038790+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:46:43.038790+0000","last_peered":"2024-09-11T14:46:43.038790+0000","last_clean":"2024-09-11T14:46:43.038790+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:46:43.038790+0000","last_undegraded":"2024-09-11T14:46:43.038790+0000","last_fullsized":"2024-09-11T14:46:43.038790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"76'654","reported_seq":693,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:48.185147+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:47:48.185147+0000","last_peered":"2024-09-11T14:47:48.185147+0000","last_clean":"2024-09-11T14:47:48.185147+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:47:48.185147+0000","last_undegraded":"2024-09-11T14:47:48.185147+0000","last_fullsized":"2024-09-11T14:47:48.185147+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.019157+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.019157+0000","last_peered":"2024-09-11T14:46:43.019157+0000","last_clean":"2024-09-11T14:46:43.019157+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:46:43.019157+0000","last_undegraded":"2024-09-11T14:46:43.019157+0000","last_fullsized":"2024-09-11T14:46:43.019157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"76'572","reported_seq":611,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:48.341656+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:47:48.341656+0000","last_peered":"2024-09-11T14:47:48.341656+0000","last_clean":"2024-09-11T14:47:48.341656+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:47:48.341656+0000","last_undegraded":"2024-09-11T14:47:48.341656+0000","last_fullsized":"2024-09-11T14:47:48.341656+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12058624,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":572,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.039999+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.039999+0000","last_peered":"2024-09-11T14:46:43.039999+0000","last_clean":"2024-09-11T14:46:43.039999+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:46:43.039999+0000","last_undegraded":"2024-09-11T14:46:43.039999+0000","last_fullsized":"2024-09-11T14:46:43.039999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"76'551","reported_seq":590,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:47.682843+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:47:47.682843+0000","last_peered":"2024-09-11T14:47:47.682843+0000","last_clean":"2024-09-11T14:47:47.682843+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:47:47.682843+0000","last_undegraded":"2024-09-11T14:47:47.682843+0000","last_fullsized":"2024-09-11T14:47:47.682843+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13434880,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":551,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.023012+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:46:43.023012+0000","last_peered":"2024-09-11T14:46:43.023012+0000","last_clean":"2024-09-11T14:46:43.023012+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:46:43.023012+0000","last_undegraded":"2024-09-11T14:46:43.023012+0000","last_fullsized":"2024-09-11T14:46:43.023012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":217972760,"num_objects":3327,"num_object_clones":0,"num_object_copies":9981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9533,"num_write_kb":411457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212868382720,"internally_reserved":0,"allocated":1343111168,"data_stored":1343111168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9533,"ondisk_log_size":9533,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212868382720,"internally_reserved":0,"allocated":1343111168,"data_stored":1343111168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53242634240,"internally_reserved":0,"allocated":310239232,"data_stored":310239232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673664,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":304852,"kb_used_data":304852,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51992876,"statfs":{"total":53552873472,"available":53240705024,"internally_reserved":0,"allocated":312168448,"data_stored":312168448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706367,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":309004,"kb_used_data":309004,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51988724,"statfs":{"total":53552873472,"available":53236453376,"internally_reserved":0,"allocated":316420096,"data_stored":316420096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706368,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":355680,"kb_used_data":355680,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51942048,"statfs":{"total":53552873472,"available":53188657152,"internally_reserved":0,"allocated":364216320,"data_stored":364216320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706368,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":351072,"kb_used_data":351072,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51946656,"statfs":{"total":53552873472,"available":53193375744,"internally_reserved":0,"allocated":359497728,"data_stored":359497728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53242634240,"internally_reserved":0,"allocated":310239232,"data_stored":310239232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53188657152,"internally_reserved":0,"allocated":364216320,"data_stored":364216320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53196034048,"internally_reserved":0,"allocated":356839424,"data_stored":356839424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53241057280,"internally_reserved":0,"allocated":311816192,"data_stored":311816192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53242634240,"internally_reserved":0,"allocated":310239232,"data_stored":310239232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53188657152,"internally_reserved":0,"allocated":364216320,"data_stored":364216320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53196034048,"internally_reserved":0,"allocated":356839424,"data_stored":356839424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53241057280,"internally_reserved":0,"allocated":311816192,"data_stored":311816192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53242634240,"internally_reserved":0,"allocated":310239232,"data_stored":310239232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:47:53.901 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:47:54.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:54.034+0000 7f3f7c8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:54.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:54.041+0000 7f3f7c8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:56.653 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:47:56.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:56.795+0000 7fd3c0591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:56.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:56.801+0000 7fd3c0591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:57.710 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:47:57.711 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:47:57.711 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:47:57.711 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:47:57.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:57.891+0000 7f13dee63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:57.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:57.904+0000 7f13dee63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:57.949 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:47:57.950 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:47:57.950 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:47:57.950 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:47:57.950 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:47:57.950 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:47:57.950 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:47:57.950 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:47:57.950 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:47:57.950 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:47:57.950 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:47:57.950 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:47:57.953 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:47:57.954 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:47:57.954 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:47:58.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:58.081+0000 7f67a8b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:58.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:58.094+0000 7f67a8b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:58.120 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:47:58.120 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:47:58.120 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:47:58.120 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:47:58.120 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:47:58.120 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:47:58.120 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:47:58.120 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:47:58.121 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:47:58.121 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:47:58.121 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:47:58.121 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:47:58.123 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:47:58.124 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:47:58.124 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:47:58.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:58.234+0000 7fd1ac391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:58.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:58.246+0000 7fd1ab12f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:58.401 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:47:58.402 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:47:58.402 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:47:58.402 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:47:58.402 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:47:58.402 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:47:58.402 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:47:58.402 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:47:58.402 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:47:58.402 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:47:58.402 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:47:58.402 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:47:58.405 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:47:58.405 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:47:58.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:47:58.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:58.544+0000 7fefe3151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:58.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:58.554+0000 7fefe3151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:58.768 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:47:58.768 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:47:58.768 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:47:58.769 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:47:58.769 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:47:58.769 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:47:58.769 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:47:58.769 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:47:58.769 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:47:58.769 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:47:58.769 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:47:58.769 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:47:58.771 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:47:58.771 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:47:59.391 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:47:59.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:59.518+0000 7fcf25991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:47:59.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:47:59.524+0000 7fcf25991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:02.112 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:48:02.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:02.272+0000 7f76b4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:02.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:02.279+0000 7f76b4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:03.772 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:48:03.772 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:48:03.773 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:48:03.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:03.899+0000 7fef12151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:03.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:03.909+0000 7fef12151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:04.152 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:48:04.153 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:48:04.166 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2024-09-11T14:48:03.375069+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":178258507,"num_objects":2716,"num_object_clones":0,"num_object_copies":8148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":10229,"num_write_kb":412565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10203,"ondisk_log_size":10203,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1081600,"kb_used_data":1081600,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208109312,"statfs":{"total":214211493888,"available":213103935488,"internally_reserved":0,"allocated":1107558400,"data_stored":1107558400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-40304640,"num_objects":-615,"num_object_clones":0,"num_object_copies":-1845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":615,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002863"},"pg_stats":[{"pgid":"6.f","version":"76'559","reported_seq":598,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:58.226230+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:47:58.226230+0000","last_peered":"2024-09-11T14:47:58.226230+0000","last_clean":"2024-09-11T14:47:58.226230+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:47:58.226230+0000","last_undegraded":"2024-09-11T14:47:58.226230+0000","last_fullsized":"2024-09-11T14:47:58.226230+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":559,"num_write_kb":23360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'609","reported_seq":648,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:57.181561+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:47:57.181561+0000","last_peered":"2024-09-11T14:47:57.181561+0000","last_clean":"2024-09-11T14:47:57.181561+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:47:57.181561+0000","last_undegraded":"2024-09-11T14:47:57.181561+0000","last_fullsized":"2024-09-11T14:47:57.181561+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"76'592","reported_seq":632,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:57.950029+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:47:57.950029+0000","last_peered":"2024-09-11T14:47:57.950029+0000","last_clean":"2024-09-11T14:47:57.950029+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:47:57.950029+0000","last_undegraded":"2024-09-11T14:47:57.950029+0000","last_fullsized":"2024-09-11T14:47:57.950029+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10944536,"num_objects":168,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":592,"num_write_kb":24257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"76'668","reported_seq":707,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:58.942884+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:47:58.942884+0000","last_peered":"2024-09-11T14:47:58.942884+0000","last_clean":"2024-09-11T14:47:58.942884+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:47:58.942884+0000","last_undegraded":"2024-09-11T14:47:58.942884+0000","last_fullsized":"2024-09-11T14:47:58.942884+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11010048,"num_objects":168,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":668,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"76'625","reported_seq":664,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:57.901387+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:47:57.901387+0000","last_peered":"2024-09-11T14:47:57.901387+0000","last_clean":"2024-09-11T14:47:57.901387+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:47:57.901387+0000","last_undegraded":"2024-09-11T14:47:57.901387+0000","last_fullsized":"2024-09-11T14:47:57.901387+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10944512,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":625,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'705","reported_seq":744,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:57.307128+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:47:57.307128+0000","last_peered":"2024-09-11T14:47:57.307128+0000","last_clean":"2024-09-11T14:47:57.307128+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:47:57.307128+0000","last_undegraded":"2024-09-11T14:47:57.307128+0000","last_fullsized":"2024-09-11T14:47:57.307128+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":705,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'622","reported_seq":661,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:59.391273+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:47:59.391273+0000","last_peered":"2024-09-11T14:47:59.391273+0000","last_clean":"2024-09-11T14:47:59.391273+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:47:59.391273+0000","last_undegraded":"2024-09-11T14:47:59.391273+0000","last_fullsized":"2024-09-11T14:47:59.391273+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":622,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"76'670","reported_seq":709,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:58.098055+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:47:58.098055+0000","last_peered":"2024-09-11T14:47:58.098055+0000","last_clean":"2024-09-11T14:47:58.098055+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:47:58.098055+0000","last_undegraded":"2024-09-11T14:47:58.098055+0000","last_fullsized":"2024-09-11T14:47:58.098055+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'661","reported_seq":700,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:57.662609+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:47:57.662609+0000","last_peered":"2024-09-11T14:47:57.662609+0000","last_clean":"2024-09-11T14:47:57.662609+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:47:57.662609+0000","last_undegraded":"2024-09-11T14:47:57.662609+0000","last_fullsized":"2024-09-11T14:47:57.662609+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11730944,"num_objects":179,"num_object_clones":0,"num_object_copies":537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":268,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.014461+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:46:43.014461+0000","last_peered":"2024-09-11T14:46:43.014461+0000","last_clean":"2024-09-11T14:46:43.014461+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:46:43.014461+0000","last_undegraded":"2024-09-11T14:46:43.014461+0000","last_fullsized":"2024-09-11T14:46:43.014461+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.021089+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:46:43.021089+0000","last_peered":"2024-09-11T14:46:43.021089+0000","last_clean":"2024-09-11T14:46:43.021089+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:46:43.021089+0000","last_undegraded":"2024-09-11T14:46:43.021089+0000","last_fullsized":"2024-09-11T14:46:43.021089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"76'612","reported_seq":651,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:58.771684+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:47:58.771684+0000","last_peered":"2024-09-11T14:47:58.771684+0000","last_clean":"2024-09-11T14:47:58.771684+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:47:58.771684+0000","last_undegraded":"2024-09-11T14:47:58.771684+0000","last_fullsized":"2024-09-11T14:47:58.771684+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":24384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.040945+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:46:43.040945+0000","last_peered":"2024-09-11T14:46:43.040945+0000","last_clean":"2024-09-11T14:46:43.040945+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:46:43.040945+0000","last_undegraded":"2024-09-11T14:46:43.040945+0000","last_fullsized":"2024-09-11T14:46:43.040945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"76'631","reported_seq":670,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:57.961474+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:47:57.961474+0000","last_peered":"2024-09-11T14:47:57.961474+0000","last_clean":"2024-09-11T14:47:57.961474+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:47:57.961474+0000","last_undegraded":"2024-09-11T14:47:57.961474+0000","last_fullsized":"2024-09-11T14:47:57.961474+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11075584,"num_objects":169,"num_object_clones":0,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.012354+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:46:43.012354+0000","last_peered":"2024-09-11T14:46:43.012354+0000","last_clean":"2024-09-11T14:46:43.012354+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:46:43.012354+0000","last_undegraded":"2024-09-11T14:46:43.012354+0000","last_fullsized":"2024-09-11T14:46:43.012354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"76'637","reported_seq":676,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:58.985321+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:47:58.985321+0000","last_peered":"2024-09-11T14:47:58.985321+0000","last_clean":"2024-09-11T14:47:58.985321+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:47:58.985321+0000","last_undegraded":"2024-09-11T14:47:58.985321+0000","last_fullsized":"2024-09-11T14:47:58.985321+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11730944,"num_objects":179,"num_object_clones":0,"num_object_copies":537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":637,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.036415+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:46:43.036415+0000","last_peered":"2024-09-11T14:46:43.036415+0000","last_clean":"2024-09-11T14:46:43.036415+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:46:43.036415+0000","last_undegraded":"2024-09-11T14:46:43.036415+0000","last_fullsized":"2024-09-11T14:46:43.036415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'656","reported_seq":695,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:57.588147+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:47:57.588147+0000","last_peered":"2024-09-11T14:47:57.588147+0000","last_clean":"2024-09-11T14:47:57.588147+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:47:57.588147+0000","last_undegraded":"2024-09-11T14:47:57.588147+0000","last_fullsized":"2024-09-11T14:47:57.588147+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13107200,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.038790+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:46:43.038790+0000","last_peered":"2024-09-11T14:46:43.038790+0000","last_clean":"2024-09-11T14:46:43.038790+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:46:43.038790+0000","last_undegraded":"2024-09-11T14:46:43.038790+0000","last_fullsized":"2024-09-11T14:46:43.038790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"76'688","reported_seq":727,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:57.479657+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:47:57.479657+0000","last_peered":"2024-09-11T14:47:57.479657+0000","last_clean":"2024-09-11T14:47:57.479657+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:47:57.479657+0000","last_undegraded":"2024-09-11T14:47:57.479657+0000","last_fullsized":"2024-09-11T14:47:57.479657+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.019157+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.019157+0000","last_peered":"2024-09-11T14:46:43.019157+0000","last_clean":"2024-09-11T14:46:43.019157+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:46:43.019157+0000","last_undegraded":"2024-09-11T14:46:43.019157+0000","last_fullsized":"2024-09-11T14:46:43.019157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"76'612","reported_seq":651,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:57.613389+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:47:57.613389+0000","last_peered":"2024-09-11T14:47:57.613389+0000","last_clean":"2024-09-11T14:47:57.613389+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:47:57.613389+0000","last_undegraded":"2024-09-11T14:47:57.613389+0000","last_fullsized":"2024-09-11T14:47:57.613389+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.039999+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.039999+0000","last_peered":"2024-09-11T14:46:43.039999+0000","last_clean":"2024-09-11T14:46:43.039999+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:46:43.039999+0000","last_undegraded":"2024-09-11T14:46:43.039999+0000","last_fullsized":"2024-09-11T14:46:43.039999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"76'601","reported_seq":640,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:47:57.901692+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:47:57.901692+0000","last_peered":"2024-09-11T14:47:57.901692+0000","last_clean":"2024-09-11T14:47:57.901692+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:47:57.901692+0000","last_undegraded":"2024-09-11T14:47:57.901692+0000","last_fullsized":"2024-09-11T14:47:57.901692+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":601,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.023012+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:46:43.023012+0000","last_peered":"2024-09-11T14:46:43.023012+0000","last_clean":"2024-09-11T14:46:43.023012+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:46:43.023012+0000","last_undegraded":"2024-09-11T14:46:43.023012+0000","last_fullsized":"2024-09-11T14:46:43.023012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":177668120,"num_objects":2712,"num_object_clones":0,"num_object_copies":8136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10148,"num_write_kb":411457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213111803904,"internally_reserved":0,"allocated":1099689984,"data_stored":1099689984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10148,"ondisk_log_size":10148,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213111803904,"internally_reserved":0,"allocated":1099689984,"data_stored":1099689984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53299867648,"internally_reserved":0,"allocated":253005824,"data_stored":253005824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":249848,"kb_used_data":249848,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52047880,"statfs":{"total":53552873472,"available":53297029120,"internally_reserved":0,"allocated":255844352,"data_stored":255844352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706377,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":253428,"kb_used_data":253428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52044300,"statfs":{"total":53552873472,"available":53293363200,"internally_reserved":0,"allocated":259510272,"data_stored":259510272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":292080,"kb_used_data":292080,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52005648,"statfs":{"total":53552873472,"available":53253783552,"internally_reserved":0,"allocated":299089920,"data_stored":299089920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":286244,"kb_used_data":286244,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52011484,"statfs":{"total":53552873472,"available":53259759616,"internally_reserved":0,"allocated":293113856,"data_stored":293113856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53299867648,"internally_reserved":0,"allocated":253005824,"data_stored":253005824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53253931008,"internally_reserved":0,"allocated":298942464,"data_stored":298942464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53260546048,"internally_reserved":0,"allocated":292327424,"data_stored":292327424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53297459200,"internally_reserved":0,"allocated":255414272,"data_stored":255414272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53299867648,"internally_reserved":0,"allocated":253005824,"data_stored":253005824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53253931008,"internally_reserved":0,"allocated":298942464,"data_stored":298942464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53260546048,"internally_reserved":0,"allocated":292327424,"data_stored":292327424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53297459200,"internally_reserved":0,"allocated":255414272,"data_stored":255414272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53299867648,"internally_reserved":0,"allocated":253005824,"data_stored":253005824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:48:05.053 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:48:05.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:05.173+0000 7f60e527d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:05.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:05.180+0000 7f60e527d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:07.917 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:48:08.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:08.047+0000 7efc42d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:08.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:08.056+0000 7efc42d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:09.168 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:48:09.168 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:48:09.169 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:48:09.169 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:48:09.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:09.306+0000 7eff3e348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:09.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:09.316+0000 7eff3e348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:09.341 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:09.341 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:09.341 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:09.341 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:09.341 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:09.341 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:09.341 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:09.341 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:09.341 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:09.341 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:09.341 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:09.342 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:09.343 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:09.344 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:09.344 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:48:09.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:09.471+0000 7f64af751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:09.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:09.485+0000 7f64af751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:09.655 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:09.655 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:09.655 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:09.655 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:09.655 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:09.655 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:09.655 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:09.655 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:09.655 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:09.656 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:09.656 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:09.656 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:09.658 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:09.658 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:09.659 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:48:09.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:09.770+0000 7f8d51cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:09.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:09.782+0000 7f8d51cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:09.959 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:09.960 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:09.960 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:09.960 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:09.960 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:09.960 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:09.960 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:09.960 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:09.960 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:09.960 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:09.960 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:09.960 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:09.962 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:09.963 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:09.963 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:48:10.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:10.089+0000 7f4624ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:10.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:10.101+0000 7f4624ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:10.307 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:10.307 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:10.307 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:10.307 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:10.308 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:10.308 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:10.308 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:10.308 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:10.308 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:10.308 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:10.308 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:10.308 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:10.310 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:10.311 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:10.799 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:48:10.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:10.930+0000 7f98d9e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:10.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:10.938+0000 7f98d9e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:13.627 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:48:13.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:13.757+0000 7f062886c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:13.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:13.763+0000 7f062886c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:15.312 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:48:15.312 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:48:15.312 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:48:15.313 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:48:15.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:15.458+0000 7fdafa591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:15.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:15.469+0000 7fdafa591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:15.489 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:15.489 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:15.489 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:15.489 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:15.489 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:15.493 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:15.493 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:15.493 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:48:15.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:15.623+0000 7f7cf1711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:15.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:15.642+0000 7f7cf1711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:15.840 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:15.840 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:15.841 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:15.841 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:15.841 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:15.841 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:15.841 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:15.841 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:15.841 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:15.841 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:15.841 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:15.841 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:15.844 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:15.844 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:15.845 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:48:15.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:15.987+0000 7f291328e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:16.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:16.000+0000 7f291328e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:16.178 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:16.182 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:16.183 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:16.183 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:48:16.249 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:48:16.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:16.337+0000 7f9c586c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:16.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:16.353+0000 7f9c586c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:16.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:16.412+0000 7f11c307d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:16.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:16.422+0000 7f11c307d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:16.447 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:16.447 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:16.447 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:16.447 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:16.447 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:16.447 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:16.447 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:16.447 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:16.448 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:16.448 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:16.448 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:16.448 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:16.451 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:16.452 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:18.891 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:48:19.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:19.020+0000 7f8cb9a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:19.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:19.029+0000 7f8cb9a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:21.452 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:48:21.453 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:48:21.453 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:48:21.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:21.573+0000 7ffaeb4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:21.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:21.583+0000 7ffaeb4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:21.660 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:48:21.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:21.797+0000 7f3b16b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:21.805 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:48:21.806 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:48:21.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:21.804+0000 7f3b16b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:21.826 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":438,"stamp":"2024-09-11T14:48:21.378811+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":89391691,"num_objects":1360,"num_object_clones":0,"num_object_copies":4080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":11585,"num_write_kb":412565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11559,"ondisk_log_size":11559,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":566240,"kb_used_data":566240,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208624672,"statfs":{"total":214211493888,"available":213631664128,"internally_reserved":0,"allocated":579829760,"data_stored":579829760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-53870592,"num_objects":-822,"num_object_clones":0,"num_object_copies":-2466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002578"},"pg_stats":[{"pgid":"6.f","version":"76'640","reported_seq":679,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:17.410702+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:48:17.410702+0000","last_peered":"2024-09-11T14:48:17.410702+0000","last_clean":"2024-09-11T14:48:17.410702+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:48:17.410702+0000","last_undegraded":"2024-09-11T14:48:17.410702+0000","last_fullsized":"2024-09-11T14:48:17.410702+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":23360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'685","reported_seq":724,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:18.095403+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:48:18.095403+0000","last_peered":"2024-09-11T14:48:18.095403+0000","last_clean":"2024-09-11T14:48:18.095403+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:48:18.095403+0000","last_undegraded":"2024-09-11T14:48:18.095403+0000","last_fullsized":"2024-09-11T14:48:18.095403+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":685,"log_dups_size":0,"ondisk_log_size":685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":685,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"76'679","reported_seq":719,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:18.241569+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:48:18.241569+0000","last_peered":"2024-09-11T14:48:18.241569+0000","last_clean":"2024-09-11T14:48:18.241569+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:48:18.241569+0000","last_undegraded":"2024-09-11T14:48:18.241569+0000","last_fullsized":"2024-09-11T14:48:18.241569+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242904,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":679,"num_write_kb":24257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"76'753","reported_seq":792,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:19.364026+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:48:19.364026+0000","last_peered":"2024-09-11T14:48:19.364026+0000","last_clean":"2024-09-11T14:48:19.364026+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:48:19.364026+0000","last_undegraded":"2024-09-11T14:48:19.364026+0000","last_fullsized":"2024-09-11T14:48:19.364026+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"76'714","reported_seq":753,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:17.923266+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:48:17.923266+0000","last_peered":"2024-09-11T14:48:17.923266+0000","last_clean":"2024-09-11T14:48:17.923266+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:48:17.923266+0000","last_undegraded":"2024-09-11T14:48:17.923266+0000","last_fullsized":"2024-09-11T14:48:17.923266+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":714,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'788","reported_seq":827,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:18.109446+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:48:18.109446+0000","last_peered":"2024-09-11T14:48:18.109446+0000","last_clean":"2024-09-11T14:48:18.109446+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:48:18.109446+0000","last_undegraded":"2024-09-11T14:48:18.109446+0000","last_fullsized":"2024-09-11T14:48:18.109446+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":788,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'703","reported_seq":742,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:19.184886+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:48:19.184886+0000","last_peered":"2024-09-11T14:48:19.184886+0000","last_clean":"2024-09-11T14:48:19.184886+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:48:19.184886+0000","last_undegraded":"2024-09-11T14:48:19.184886+0000","last_fullsized":"2024-09-11T14:48:19.184886+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":703,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"76'767","reported_seq":806,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:18.261752+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:48:18.261752+0000","last_peered":"2024-09-11T14:48:18.261752+0000","last_clean":"2024-09-11T14:48:18.261752+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:48:18.261752+0000","last_undegraded":"2024-09-11T14:48:18.261752+0000","last_fullsized":"2024-09-11T14:48:18.261752+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'740","reported_seq":779,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:18.127836+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:48:18.127836+0000","last_peered":"2024-09-11T14:48:18.127836+0000","last_clean":"2024-09-11T14:48:18.127836+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:48:18.127836+0000","last_undegraded":"2024-09-11T14:48:18.127836+0000","last_fullsized":"2024-09-11T14:48:18.127836+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":268,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.014461+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:46:43.014461+0000","last_peered":"2024-09-11T14:46:43.014461+0000","last_clean":"2024-09-11T14:46:43.014461+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:46:43.014461+0000","last_undegraded":"2024-09-11T14:46:43.014461+0000","last_fullsized":"2024-09-11T14:46:43.014461+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.021089+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:46:43.021089+0000","last_peered":"2024-09-11T14:46:43.021089+0000","last_clean":"2024-09-11T14:46:43.021089+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:46:43.021089+0000","last_undegraded":"2024-09-11T14:46:43.021089+0000","last_fullsized":"2024-09-11T14:46:43.021089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"76'686","reported_seq":725,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:19.066599+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:48:19.066599+0000","last_peered":"2024-09-11T14:48:19.066599+0000","last_clean":"2024-09-11T14:48:19.066599+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:48:19.066599+0000","last_undegraded":"2024-09-11T14:48:19.066599+0000","last_fullsized":"2024-09-11T14:48:19.066599+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":24384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.040945+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:46:43.040945+0000","last_peered":"2024-09-11T14:46:43.040945+0000","last_clean":"2024-09-11T14:46:43.040945+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:46:43.040945+0000","last_undegraded":"2024-09-11T14:46:43.040945+0000","last_fullsized":"2024-09-11T14:46:43.040945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"76'720","reported_seq":759,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:18.319647+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:48:18.319647+0000","last_peered":"2024-09-11T14:48:18.319647+0000","last_clean":"2024-09-11T14:48:18.319647+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:48:18.319647+0000","last_undegraded":"2024-09-11T14:48:18.319647+0000","last_fullsized":"2024-09-11T14:48:18.319647+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.012354+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:46:43.012354+0000","last_peered":"2024-09-11T14:46:43.012354+0000","last_clean":"2024-09-11T14:46:43.012354+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:46:43.012354+0000","last_undegraded":"2024-09-11T14:46:43.012354+0000","last_fullsized":"2024-09-11T14:46:43.012354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"76'736","reported_seq":775,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:19.543534+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:48:19.543534+0000","last_peered":"2024-09-11T14:48:19.543534+0000","last_clean":"2024-09-11T14:48:19.543534+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:48:19.543534+0000","last_undegraded":"2024-09-11T14:48:19.543534+0000","last_fullsized":"2024-09-11T14:48:19.543534+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":736,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.036415+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:46:43.036415+0000","last_peered":"2024-09-11T14:46:43.036415+0000","last_clean":"2024-09-11T14:46:43.036415+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:46:43.036415+0000","last_undegraded":"2024-09-11T14:46:43.036415+0000","last_fullsized":"2024-09-11T14:46:43.036415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'749","reported_seq":788,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:18.159888+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:48:18.159888+0000","last_peered":"2024-09-11T14:48:18.159888+0000","last_clean":"2024-09-11T14:48:18.159888+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:48:18.159888+0000","last_undegraded":"2024-09-11T14:48:18.159888+0000","last_fullsized":"2024-09-11T14:48:18.159888+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.038790+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:46:43.038790+0000","last_peered":"2024-09-11T14:46:43.038790+0000","last_clean":"2024-09-11T14:46:43.038790+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:46:43.038790+0000","last_undegraded":"2024-09-11T14:46:43.038790+0000","last_fullsized":"2024-09-11T14:46:43.038790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"76'773","reported_seq":812,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:17.974037+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:48:17.974037+0000","last_peered":"2024-09-11T14:48:17.974037+0000","last_clean":"2024-09-11T14:48:17.974037+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:48:17.974037+0000","last_undegraded":"2024-09-11T14:48:17.974037+0000","last_fullsized":"2024-09-11T14:48:17.974037+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.019157+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.019157+0000","last_peered":"2024-09-11T14:46:43.019157+0000","last_clean":"2024-09-11T14:46:43.019157+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:46:43.019157+0000","last_undegraded":"2024-09-11T14:46:43.019157+0000","last_fullsized":"2024-09-11T14:46:43.019157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"76'691","reported_seq":730,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:17.778804+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:48:17.778804+0000","last_peered":"2024-09-11T14:48:17.778804+0000","last_clean":"2024-09-11T14:48:17.778804+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:48:17.778804+0000","last_undegraded":"2024-09-11T14:48:17.778804+0000","last_fullsized":"2024-09-11T14:48:17.778804+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":691,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.039999+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.039999+0000","last_peered":"2024-09-11T14:46:43.039999+0000","last_clean":"2024-09-11T14:46:43.039999+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:46:43.039999+0000","last_undegraded":"2024-09-11T14:46:43.039999+0000","last_fullsized":"2024-09-11T14:46:43.039999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"76'680","reported_seq":719,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:18.359575+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:48:18.359575+0000","last_peered":"2024-09-11T14:48:18.359575+0000","last_clean":"2024-09-11T14:48:18.359575+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:48:18.359575+0000","last_undegraded":"2024-09-11T14:48:18.359575+0000","last_fullsized":"2024-09-11T14:48:18.359575+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.023012+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:46:43.023012+0000","last_peered":"2024-09-11T14:46:43.023012+0000","last_clean":"2024-09-11T14:46:43.023012+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:46:43.023012+0000","last_undegraded":"2024-09-11T14:46:43.023012+0000","last_fullsized":"2024-09-11T14:46:43.023012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":88801304,"num_objects":1356,"num_object_clones":0,"num_object_copies":4068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11504,"num_write_kb":411457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213646741504,"internally_reserved":0,"allocated":564752384,"data_stored":564752384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11504,"ondisk_log_size":11504,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213646610432,"internally_reserved":0,"allocated":564883456,"data_stored":564883456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53427974144,"internally_reserved":0,"allocated":124899328,"data_stored":124899328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":126152,"kb_used_data":126152,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52171576,"statfs":{"total":53552873472,"available":53423693824,"internally_reserved":0,"allocated":129179648,"data_stored":129179648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706397,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":137436,"kb_used_data":137436,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52160292,"statfs":{"total":53552873472,"available":53412139008,"internally_reserved":0,"allocated":140734464,"data_stored":140734464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706398,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":151016,"kb_used_data":151016,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52146712,"statfs":{"total":53552873472,"available":53398233088,"internally_reserved":0,"allocated":154640384,"data_stored":154640384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706398,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":151636,"kb_used_data":151636,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52146092,"statfs":{"total":53552873472,"available":53397598208,"internally_reserved":0,"allocated":155275264,"data_stored":155275264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53427974144,"internally_reserved":0,"allocated":124899328,"data_stored":124899328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53398233088,"internally_reserved":0,"allocated":154640384,"data_stored":154640384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53400088576,"internally_reserved":0,"allocated":152784896,"data_stored":152784896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53420314624,"internally_reserved":0,"allocated":132558848,"data_stored":132558848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53427974144,"internally_reserved":0,"allocated":124899328,"data_stored":124899328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53398233088,"internally_reserved":0,"allocated":154640384,"data_stored":154640384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53400088576,"internally_reserved":0,"allocated":152784896,"data_stored":152784896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53420445696,"internally_reserved":0,"allocated":132427776,"data_stored":132427776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53427974144,"internally_reserved":0,"allocated":124899328,"data_stored":124899328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:48:24.282 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:48:24.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:24.425+0000 7f0a21311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:24.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:24.432+0000 7f0a21311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:26.770 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:48:26.828 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:48:26.828 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:48:26.828 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:48:26.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:26.903+0000 7ffb33591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:26.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:26.912+0000 7ffb33591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:27.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:26.991+0000 7efea6591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:27.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:27.005+0000 7efea6591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:27.305 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:48:27.305 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:48:27.325 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":440,"stamp":"2024-09-11T14:48:25.379613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":61276747,"num_objects":931,"num_object_clones":0,"num_object_copies":2793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12014,"num_write_kb":412565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11988,"ondisk_log_size":11988,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":410600,"kb_used_data":410600,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208780312,"statfs":{"total":214211493888,"available":213791039488,"internally_reserved":0,"allocated":420454400,"data_stored":420454400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-76808192,"num_objects":-1172,"num_object_clones":0,"num_object_copies":-3516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1172,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002560"},"pg_stats":[{"pgid":"6.f","version":"76'666","reported_seq":705,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:23.323046+0000","last_change":"2024-09-11T14:45:39.069065+0000","last_active":"2024-09-11T14:48:23.323046+0000","last_peered":"2024-09-11T14:48:23.323046+0000","last_clean":"2024-09-11T14:48:23.323046+0000","last_became_active":"2024-09-11T14:45:39.048533+0000","last_became_peered":"2024-09-11T14:45:39.048533+0000","last_unstale":"2024-09-11T14:48:23.323046+0000","last_undegraded":"2024-09-11T14:48:23.323046+0000","last_fullsized":"2024-09-11T14:48:23.323046+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":23360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'708","reported_seq":747,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:22.989220+0000","last_change":"2024-09-11T14:45:39.131327+0000","last_active":"2024-09-11T14:48:22.989220+0000","last_peered":"2024-09-11T14:48:22.989220+0000","last_clean":"2024-09-11T14:48:22.989220+0000","last_became_active":"2024-09-11T14:45:39.095336+0000","last_became_peered":"2024-09-11T14:45:39.095336+0000","last_unstale":"2024-09-11T14:48:22.989220+0000","last_undegraded":"2024-09-11T14:48:22.989220+0000","last_fullsized":"2024-09-11T14:48:22.989220+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"76'704","reported_seq":744,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:22.663360+0000","last_change":"2024-09-11T14:45:39.120060+0000","last_active":"2024-09-11T14:48:22.663360+0000","last_peered":"2024-09-11T14:48:22.663360+0000","last_clean":"2024-09-11T14:48:22.663360+0000","last_became_active":"2024-09-11T14:45:39.085387+0000","last_became_peered":"2024-09-11T14:45:39.085387+0000","last_unstale":"2024-09-11T14:48:22.663360+0000","last_undegraded":"2024-09-11T14:48:22.663360+0000","last_fullsized":"2024-09-11T14:48:22.663360+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604504,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":704,"num_write_kb":24257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"76'775","reported_seq":814,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:23.822699+0000","last_change":"2024-09-11T14:45:39.048013+0000","last_active":"2024-09-11T14:48:23.822699+0000","last_peered":"2024-09-11T14:48:23.822699+0000","last_clean":"2024-09-11T14:48:23.822699+0000","last_became_active":"2024-09-11T14:45:39.039405+0000","last_became_peered":"2024-09-11T14:45:39.039405+0000","last_unstale":"2024-09-11T14:48:23.822699+0000","last_undegraded":"2024-09-11T14:48:23.822699+0000","last_fullsized":"2024-09-11T14:48:23.822699+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":775,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"76'731","reported_seq":770,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:23.154873+0000","last_change":"2024-09-11T14:45:39.130878+0000","last_active":"2024-09-11T14:48:23.154873+0000","last_peered":"2024-09-11T14:48:23.154873+0000","last_clean":"2024-09-11T14:48:23.154873+0000","last_became_active":"2024-09-11T14:45:39.109029+0000","last_became_peered":"2024-09-11T14:45:39.109029+0000","last_unstale":"2024-09-11T14:48:23.154873+0000","last_undegraded":"2024-09-11T14:48:23.154873+0000","last_fullsized":"2024-09-11T14:48:23.154873+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'812","reported_seq":851,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:22.987332+0000","last_change":"2024-09-11T14:45:39.228487+0000","last_active":"2024-09-11T14:48:22.987332+0000","last_peered":"2024-09-11T14:48:22.987332+0000","last_clean":"2024-09-11T14:48:22.987332+0000","last_became_active":"2024-09-11T14:45:39.220624+0000","last_became_peered":"2024-09-11T14:45:39.220624+0000","last_unstale":"2024-09-11T14:48:22.987332+0000","last_undegraded":"2024-09-11T14:48:22.987332+0000","last_fullsized":"2024-09-11T14:48:22.987332+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":812,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'731","reported_seq":770,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:24.288634+0000","last_change":"2024-09-11T14:45:39.126878+0000","last_active":"2024-09-11T14:48:24.288634+0000","last_peered":"2024-09-11T14:48:24.288634+0000","last_clean":"2024-09-11T14:48:24.288634+0000","last_became_active":"2024-09-11T14:45:39.105841+0000","last_became_peered":"2024-09-11T14:45:39.105841+0000","last_unstale":"2024-09-11T14:48:24.288634+0000","last_undegraded":"2024-09-11T14:48:24.288634+0000","last_fullsized":"2024-09-11T14:48:24.288634+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"76'797","reported_seq":836,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:23.084933+0000","last_change":"2024-09-11T14:45:39.132173+0000","last_active":"2024-09-11T14:48:23.084933+0000","last_peered":"2024-09-11T14:48:23.084933+0000","last_clean":"2024-09-11T14:48:23.084933+0000","last_became_active":"2024-09-11T14:45:39.097046+0000","last_became_peered":"2024-09-11T14:45:39.097046+0000","last_unstale":"2024-09-11T14:48:23.084933+0000","last_undegraded":"2024-09-11T14:48:23.084933+0000","last_fullsized":"2024-09-11T14:48:23.084933+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'780","reported_seq":819,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:23.113282+0000","last_change":"2024-09-11T14:45:39.078576+0000","last_active":"2024-09-11T14:48:23.113282+0000","last_peered":"2024-09-11T14:48:23.113282+0000","last_clean":"2024-09-11T14:48:23.113282+0000","last_became_active":"2024-09-11T14:45:39.067756+0000","last_became_peered":"2024-09-11T14:45:39.067756+0000","last_unstale":"2024-09-11T14:48:23.113282+0000","last_undegraded":"2024-09-11T14:48:23.113282+0000","last_fullsized":"2024-09-11T14:48:23.113282+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":780,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":268,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.014461+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:46:43.014461+0000","last_peered":"2024-09-11T14:46:43.014461+0000","last_clean":"2024-09-11T14:46:43.014461+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:46:43.014461+0000","last_undegraded":"2024-09-11T14:46:43.014461+0000","last_fullsized":"2024-09-11T14:46:43.014461+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.021089+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:46:43.021089+0000","last_peered":"2024-09-11T14:46:43.021089+0000","last_clean":"2024-09-11T14:46:43.021089+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:46:43.021089+0000","last_undegraded":"2024-09-11T14:46:43.021089+0000","last_fullsized":"2024-09-11T14:46:43.021089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"76'716","reported_seq":755,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:24.283566+0000","last_change":"2024-09-11T14:45:39.165360+0000","last_active":"2024-09-11T14:48:24.283566+0000","last_peered":"2024-09-11T14:48:24.283566+0000","last_clean":"2024-09-11T14:48:24.283566+0000","last_became_active":"2024-09-11T14:45:39.155244+0000","last_became_peered":"2024-09-11T14:45:39.155244+0000","last_unstale":"2024-09-11T14:48:24.283566+0000","last_undegraded":"2024-09-11T14:48:24.283566+0000","last_fullsized":"2024-09-11T14:48:24.283566+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":716,"num_write_kb":24384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.040945+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:46:43.040945+0000","last_peered":"2024-09-11T14:46:43.040945+0000","last_clean":"2024-09-11T14:46:43.040945+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:46:43.040945+0000","last_undegraded":"2024-09-11T14:46:43.040945+0000","last_fullsized":"2024-09-11T14:46:43.040945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"76'748","reported_seq":787,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:23.284929+0000","last_change":"2024-09-11T14:45:39.116692+0000","last_active":"2024-09-11T14:48:23.284929+0000","last_peered":"2024-09-11T14:48:23.284929+0000","last_clean":"2024-09-11T14:48:23.284929+0000","last_became_active":"2024-09-11T14:45:39.072713+0000","last_became_peered":"2024-09-11T14:45:39.072713+0000","last_unstale":"2024-09-11T14:48:23.284929+0000","last_undegraded":"2024-09-11T14:48:23.284929+0000","last_fullsized":"2024-09-11T14:48:23.284929+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.012354+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:46:43.012354+0000","last_peered":"2024-09-11T14:46:43.012354+0000","last_clean":"2024-09-11T14:46:43.012354+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:46:43.012354+0000","last_undegraded":"2024-09-11T14:46:43.012354+0000","last_fullsized":"2024-09-11T14:46:43.012354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"76'759","reported_seq":798,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:24.164797+0000","last_change":"2024-09-11T14:45:39.165256+0000","last_active":"2024-09-11T14:48:24.164797+0000","last_peered":"2024-09-11T14:48:24.164797+0000","last_clean":"2024-09-11T14:48:24.164797+0000","last_became_active":"2024-09-11T14:45:39.156661+0000","last_became_peered":"2024-09-11T14:45:39.156661+0000","last_unstale":"2024-09-11T14:48:24.164797+0000","last_undegraded":"2024-09-11T14:48:24.164797+0000","last_fullsized":"2024-09-11T14:48:24.164797+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.036415+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:46:43.036415+0000","last_peered":"2024-09-11T14:46:43.036415+0000","last_clean":"2024-09-11T14:46:43.036415+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:46:43.036415+0000","last_undegraded":"2024-09-11T14:46:43.036415+0000","last_fullsized":"2024-09-11T14:46:43.036415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'784","reported_seq":823,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:22.905937+0000","last_change":"2024-09-11T14:45:39.265454+0000","last_active":"2024-09-11T14:48:22.905937+0000","last_peered":"2024-09-11T14:48:22.905937+0000","last_clean":"2024-09-11T14:48:22.905937+0000","last_became_active":"2024-09-11T14:45:39.249729+0000","last_became_peered":"2024-09-11T14:45:39.249729+0000","last_unstale":"2024-09-11T14:48:22.905937+0000","last_undegraded":"2024-09-11T14:48:22.905937+0000","last_fullsized":"2024-09-11T14:48:22.905937+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.038790+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:46:43.038790+0000","last_peered":"2024-09-11T14:46:43.038790+0000","last_clean":"2024-09-11T14:46:43.038790+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:46:43.038790+0000","last_undegraded":"2024-09-11T14:46:43.038790+0000","last_fullsized":"2024-09-11T14:46:43.038790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"76'807","reported_seq":846,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:23.416961+0000","last_change":"2024-09-11T14:45:39.187975+0000","last_active":"2024-09-11T14:48:23.416961+0000","last_peered":"2024-09-11T14:48:23.416961+0000","last_clean":"2024-09-11T14:48:23.416961+0000","last_became_active":"2024-09-11T14:45:39.178725+0000","last_became_peered":"2024-09-11T14:45:39.178725+0000","last_unstale":"2024-09-11T14:48:23.416961+0000","last_undegraded":"2024-09-11T14:48:23.416961+0000","last_fullsized":"2024-09-11T14:48:23.416961+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.019157+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.019157+0000","last_peered":"2024-09-11T14:46:43.019157+0000","last_clean":"2024-09-11T14:46:43.019157+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:46:43.019157+0000","last_undegraded":"2024-09-11T14:46:43.019157+0000","last_fullsized":"2024-09-11T14:46:43.019157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"76'716","reported_seq":755,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:22.944248+0000","last_change":"2024-09-11T14:45:39.176828+0000","last_active":"2024-09-11T14:48:22.944248+0000","last_peered":"2024-09-11T14:48:22.944248+0000","last_clean":"2024-09-11T14:48:22.944248+0000","last_became_active":"2024-09-11T14:45:39.153021+0000","last_became_peered":"2024-09-11T14:45:39.153021+0000","last_unstale":"2024-09-11T14:48:22.944248+0000","last_undegraded":"2024-09-11T14:48:22.944248+0000","last_fullsized":"2024-09-11T14:48:22.944248+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":716,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.039999+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.039999+0000","last_peered":"2024-09-11T14:46:43.039999+0000","last_clean":"2024-09-11T14:46:43.039999+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:46:43.039999+0000","last_undegraded":"2024-09-11T14:46:43.039999+0000","last_fullsized":"2024-09-11T14:46:43.039999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"76'699","reported_seq":738,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:48:23.205723+0000","last_change":"2024-09-11T14:45:39.122651+0000","last_active":"2024-09-11T14:48:23.205723+0000","last_peered":"2024-09-11T14:48:23.205723+0000","last_clean":"2024-09-11T14:48:23.205723+0000","last_became_active":"2024-09-11T14:45:39.106472+0000","last_became_peered":"2024-09-11T14:45:39.106472+0000","last_unstale":"2024-09-11T14:48:23.205723+0000","last_undegraded":"2024-09-11T14:48:23.205723+0000","last_fullsized":"2024-09-11T14:48:23.205723+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:45:37.886901+0000","last_clean_scrub_stamp":"2024-09-11T14:45:37.886901+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":699,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.023012+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:46:43.023012+0000","last_peered":"2024-09-11T14:46:43.023012+0000","last_clean":"2024-09-11T14:46:43.023012+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:46:43.023012+0000","last_undegraded":"2024-09-11T14:46:43.023012+0000","last_fullsized":"2024-09-11T14:46:43.023012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":60686360,"num_objects":927,"num_object_clones":0,"num_object_copies":2781,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11933,"num_write_kb":411457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213815160832,"internally_reserved":0,"allocated":396333056,"data_stored":396333056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11933,"ondisk_log_size":11933,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213814882304,"internally_reserved":0,"allocated":396611584,"data_stored":396611584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53467705344,"internally_reserved":0,"allocated":85168128,"data_stored":85168128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673699,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":86708,"kb_used_data":86708,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52211020,"statfs":{"total":53552873472,"available":53464084480,"internally_reserved":0,"allocated":88788992,"data_stored":88788992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706402,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":99896,"kb_used_data":99896,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52197832,"statfs":{"total":53552873472,"available":53450579968,"internally_reserved":0,"allocated":102293504,"data_stored":102293504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706402,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":114360,"kb_used_data":114360,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52183368,"statfs":{"total":53552873472,"available":53435768832,"internally_reserved":0,"allocated":117104640,"data_stored":117104640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706403,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":109636,"kb_used_data":109636,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52188092,"statfs":{"total":53552873472,"available":53440606208,"internally_reserved":0,"allocated":112267264,"data_stored":112267264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53467705344,"internally_reserved":0,"allocated":85168128,"data_stored":85168128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53445541888,"internally_reserved":0,"allocated":107331584,"data_stored":107331584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53442985984,"internally_reserved":0,"allocated":109887488,"data_stored":109887488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53458649088,"internally_reserved":0,"allocated":94224384,"data_stored":94224384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53467705344,"internally_reserved":0,"allocated":85168128,"data_stored":85168128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53445689344,"internally_reserved":0,"allocated":107184128,"data_stored":107184128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53442985984,"internally_reserved":0,"allocated":109887488,"data_stored":109887488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53458780160,"internally_reserved":0,"allocated":94093312,"data_stored":94093312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53467705344,"internally_reserved":0,"allocated":85168128,"data_stored":85168128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:48:29.555 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:48:29.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:29.711+0000 7f9150f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:29.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:29.719+0000 7f9150f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:32.315 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:48:32.327 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:48:32.328 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:48:32.328 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:48:32.328 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:48:32.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:32.480+0000 7f89d54fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:32.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:32.493+0000 7f89d54fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:32.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:32.544+0000 7f0f48b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:32.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:32.562+0000 7f0f48b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:32.598 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:32.598 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:32.598 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:32.598 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:32.598 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:32.599 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:32.599 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:32.599 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:32.599 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:32.599 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:32.599 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:32.599 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:32.602 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:32.602 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:32.603 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:48:32.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:32.747+0000 7f51b3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:32.760+0000 7f51b3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:32.903 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:32.903 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:32.903 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:32.903 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:32.903 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:32.903 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:32.903 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:32.903 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:32.903 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:32.903 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:32.904 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:32.904 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:32.906 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:32.907 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:32.907 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:48:33.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:33.052+0000 7f007d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:33.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:33.069+0000 7f007d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:33.289 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:33.289 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:33.289 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:33.289 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:33.289 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:33.289 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:33.289 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:33.290 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:33.290 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:33.290 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:33.290 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:33.290 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:33.295 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:33.295 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:33.295 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:48:33.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:33.449+0000 7f6a6f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:33.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:33.461+0000 7f6a6f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:33.567 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:33.567 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:33.567 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:33.567 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:33.567 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:33.569 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:33.570 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:34.276 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Removed 6429 objects 2024-09-11T14:48:34.276 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Clean up completed and total clean up time :83.2416 2024-09-11T14:48:34.808 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:48:34.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:34.914+0000 7fcd93b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:34.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:34.918+0000 7fcd93b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:36.862 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_3 2024-09-11T14:48:36.863 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2024-09-11T14:48:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:36.980+0000 7f02ce09c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:36.993+0000 7f02ce09c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:37.020 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:48:37.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:37.126+0000 7fd30bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:37.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:37.131+0000 7fd30bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:37.938 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_3' removed 2024-09-11T14:48:37.963 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-11T14:48:37.964 INFO:tasks.radosbench:Beginning radosbench... 2024-09-11T14:48:37.965 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_4 2024-09-11T14:48:37.965 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_4 16 2024-09-11T14:48:38.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:38.113+0000 7f303e46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:38.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:38.133+0000 7f303e46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:38.571 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:48:38.571 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:48:38.571 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:48:38.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:38.674+0000 7ff09c311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:38.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:38.682+0000 7ff09c311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:38.865 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:48:38.866 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:48:38.878 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":447,"stamp":"2024-09-11T14:48:37.938540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":66352,"kb_used_data":66352,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209124560,"statfs":{"total":214211493888,"available":214143549440,"internally_reserved":0,"allocated":67944448,"data_stored":67944448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-60686360,"num_objects":-927,"num_object_clones":0,"num_object_copies":-2781,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-11933,"num_write_kb":-411457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.558490"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":268,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.014461+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:46:43.014461+0000","last_peered":"2024-09-11T14:46:43.014461+0000","last_clean":"2024-09-11T14:46:43.014461+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:46:43.014461+0000","last_undegraded":"2024-09-11T14:46:43.014461+0000","last_fullsized":"2024-09-11T14:46:43.014461+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.021089+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:46:43.021089+0000","last_peered":"2024-09-11T14:46:43.021089+0000","last_clean":"2024-09-11T14:46:43.021089+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:46:43.021089+0000","last_undegraded":"2024-09-11T14:46:43.021089+0000","last_fullsized":"2024-09-11T14:46:43.021089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.040945+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:46:43.040945+0000","last_peered":"2024-09-11T14:46:43.040945+0000","last_clean":"2024-09-11T14:46:43.040945+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:46:43.040945+0000","last_undegraded":"2024-09-11T14:46:43.040945+0000","last_fullsized":"2024-09-11T14:46:43.040945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.012354+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:46:43.012354+0000","last_peered":"2024-09-11T14:46:43.012354+0000","last_clean":"2024-09-11T14:46:43.012354+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:46:43.012354+0000","last_undegraded":"2024-09-11T14:46:43.012354+0000","last_fullsized":"2024-09-11T14:46:43.012354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.036415+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:46:43.036415+0000","last_peered":"2024-09-11T14:46:43.036415+0000","last_clean":"2024-09-11T14:46:43.036415+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:46:43.036415+0000","last_undegraded":"2024-09-11T14:46:43.036415+0000","last_fullsized":"2024-09-11T14:46:43.036415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.038790+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:46:43.038790+0000","last_peered":"2024-09-11T14:46:43.038790+0000","last_clean":"2024-09-11T14:46:43.038790+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:46:43.038790+0000","last_undegraded":"2024-09-11T14:46:43.038790+0000","last_fullsized":"2024-09-11T14:46:43.038790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.019157+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.019157+0000","last_peered":"2024-09-11T14:46:43.019157+0000","last_clean":"2024-09-11T14:46:43.019157+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:46:43.019157+0000","last_undegraded":"2024-09-11T14:46:43.019157+0000","last_fullsized":"2024-09-11T14:46:43.019157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.039999+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:46:43.039999+0000","last_peered":"2024-09-11T14:46:43.039999+0000","last_clean":"2024-09-11T14:46:43.039999+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:46:43.039999+0000","last_undegraded":"2024-09-11T14:46:43.039999+0000","last_fullsized":"2024-09-11T14:46:43.039999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-11T14:46:43.023012+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:46:43.023012+0000","last_peered":"2024-09-11T14:46:43.023012+0000","last_clean":"2024-09-11T14:46:43.023012+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:46:43.023012+0000","last_undegraded":"2024-09-11T14:46:43.023012+0000","last_fullsized":"2024-09-11T14:46:43.023012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214164959232,"internally_reserved":0,"allocated":46534656,"data_stored":46534656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53546577920,"internally_reserved":0,"allocated":6295552,"data_stored":6295552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6600,"kb_used_data":6600,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291128,"statfs":{"total":53552873472,"available":53546115072,"internally_reserved":0,"allocated":6758400,"data_stored":6758400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":20480,"kb_used_data":20480,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52277248,"statfs":{"total":53552873472,"available":53531901952,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":22972,"kb_used_data":22972,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52274756,"statfs":{"total":53552873472,"available":53529350144,"internally_reserved":0,"allocated":23523328,"data_stored":23523328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706413,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":16300,"kb_used_data":16300,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52281428,"statfs":{"total":53552873472,"available":53536182272,"internally_reserved":0,"allocated":16691200,"data_stored":16691200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53546577920,"internally_reserved":0,"allocated":6295552,"data_stored":6295552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53539127296,"internally_reserved":0,"allocated":13746176,"data_stored":13746176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53540089856,"internally_reserved":0,"allocated":12783616,"data_stored":12783616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53539164160,"internally_reserved":0,"allocated":13709312,"data_stored":13709312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53546577920,"internally_reserved":0,"allocated":6295552,"data_stored":6295552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:48:38.939 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_4' created 2024-09-11T14:48:38.956 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2024-09-11T14:48:39.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:39.086+0000 7f04cf111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:39.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:39.101+0000 7f04cf111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:39.249 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:48:39.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:39.353+0000 7f93944a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:39.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:39.358+0000 7f93944a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:39.948 INFO:teuthology.orchestra.run.smithi103.stderr:enabled application 'rados' on pool 'unique_pool_4' 2024-09-11T14:48:40.966 DEBUG:teuthology.orchestra.run.smithi103:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_4 bench 90 write' 2024-09-11T14:48:40.969 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-11T14:48:40.969 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-11T14:48:41.043 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:hints = 1 2024-09-11T14:48:41.043 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-11T14:48:41.043 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object prefix: benchmark_data_smithi103_58614 2024-09-11T14:48:41.043 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:48:41.043 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 0 0 0 0 0 0 - 0 2024-09-11T14:48:41.458 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:48:41.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:41.601+0000 7f838b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:41.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:41.607+0000 7f838b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:42.043 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 1 16 76 60 3.74968 3.75 0.104375 0.212865 2024-09-11T14:48:43.043 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 2 16 146 130 4.0621 4.375 0.0840114 0.226786 2024-09-11T14:48:43.813 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:48:43.880 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:48:43.880 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:48:43.880 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:48:43.881 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:48:43.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:43.947+0000 7fefafad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:43.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:43.957+0000 7fefae86f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:44.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:44.008+0000 7fa185ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:44.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:44.019+0000 7fa185ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:44.043 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 3 15 205 190 3.95798 3.75 0.156063 0.237223 2024-09-11T14:48:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:44.073 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:44.073 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:44.073 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:44.073 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:44.073 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:44.073 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:44.074 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:44.074 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:44.076 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:44.077 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:44.077 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:48:44.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:44.215+0000 7f2918c57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:44.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:44.228+0000 7f2918c57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:44.409 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:44.409 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:44.409 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:44.409 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:44.410 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:44.410 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:44.410 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:44.410 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:44.410 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:44.410 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:44.410 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:44.410 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:44.412 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:44.413 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:44.413 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:48:44.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:44.545+0000 7f2782d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:44.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:44.563+0000 7f2782d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:44.622 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:44.622 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:44.622 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:44.623 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:44.623 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:44.623 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:44.623 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:44.623 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:44.623 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:44.623 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:44.623 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:44.623 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:44.626 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:44.627 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:44.627 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:48:44.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:44.801+0000 7f39828a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:44.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:44.814+0000 7f39828a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:44.853 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:44.853 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:44.854 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:44.854 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:44.854 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:44.854 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:44.854 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:44.854 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:44.854 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:44.854 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:44.854 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:44.854 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:44.857 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:44.857 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:45.044 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 4 16 278 262 4.09338 4.5 0.112789 0.232589 2024-09-11T14:48:46.044 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 5 16 351 335 4.18712 4.5625 0.107517 0.230131 2024-09-11T14:48:46.284 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:48:46.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:46.435+0000 7fba91ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:46.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:46.442+0000 7fba91ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:47.044 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 6 16 425 409 4.26003 4.625 0.229264 0.227719 2024-09-11T14:48:48.044 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 7 16 497 481 4.29424 4.5 0.066371 0.22608 2024-09-11T14:48:48.876 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:48:49.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:49.040+0000 7f6596057640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:49.044 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 8 16 576 560 4.3746 4.9375 0.160939 0.224534 2024-09-11T14:48:49.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:49.050+0000 7f6596057640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:49.858 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:48:49.858 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:48:49.858 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:48:49.859 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:48:49.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:49.980+0000 7f9afaa6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:49.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:49.997+0000 7f9afaa6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:50.044 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 9 16 644 628 4.36071 4.25 0.568139 0.224587 2024-09-11T14:48:50.082 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:50.082 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:50.082 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:50.082 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:50.082 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:50.082 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:50.082 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:50.082 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:50.082 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:50.082 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:50.083 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:50.083 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:50.085 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:50.085 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:50.085 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:48:50.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:50.236+0000 7f94bee57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:50.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:50.250+0000 7f94bee57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:50.433 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:50.433 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:50.433 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:50.433 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:50.433 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:50.433 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:50.434 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:50.434 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:50.434 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:50.434 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:50.434 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:50.434 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:50.436 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:50.436 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:50.436 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:48:50.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:50.566+0000 7f270c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:50.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:50.578+0000 7f270c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:50.597 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:50.597 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:50.597 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:50.597 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:50.597 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:50.597 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:50.597 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:50.597 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:50.597 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:50.598 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:50.598 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:50.598 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:50.600 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:50.600 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:50.601 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:48:50.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:50.721+0000 7f861e2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:50.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:50.736+0000 7f861e2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:50.781 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:48:50.781 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:48:50.781 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:48:50.781 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:48:50.781 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:48:50.781 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:48:50.781 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:48:50.781 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:48:50.781 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:48:50.781 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:48:50.781 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:48:50.781 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:48:50.785 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:48:50.786 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:48:51.044 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 10 16 723 707 4.41834 4.9375 0.44231 0.223103 2024-09-11T14:48:51.559 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:48:51.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:51.701+0000 7f97b1591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:51.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:51.708+0000 7f97b1591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:52.044 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 11 16 799 783 4.44844 4.75 0.362447 0.220513 2024-09-11T14:48:53.044 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 12 16 876 860 4.47874 4.8125 0.276424 0.220159 2024-09-11T14:48:54.045 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 13 16 956 940 4.5188 5 0.240926 0.219585 2024-09-11T14:48:54.239 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:48:54.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:54.357+0000 7f2f29551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:54.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:54.363+0000 7f2f29551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:55.045 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 14 16 1034 1018 4.54421 4.875 0.277615 0.218713 2024-09-11T14:48:55.786 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:48:55.787 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T14:48:55.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:55.931+0000 7fce08f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:55.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:55.944+0000 7fce08f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:56.045 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 15 16 1110 1094 4.5579 4.75 0.162758 0.217408 2024-09-11T14:48:56.440 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T14:48:56.463 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T14:48:56.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:56.633+0000 7f395e093640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:56.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:56.652+0000 7f395e093640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:56.995 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:48:57.045 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 16 16 1188 1172 4.57769 4.875 0.124541 0.216891 2024-09-11T14:48:57.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:57.151+0000 7f6b21791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:57.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:57.162+0000 7f6b21791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:57.913 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T14:48:57.933 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T14:48:58.045 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 17 16 1263 1247 4.58412 4.6875 0.131324 0.216629 2024-09-11T14:48:58.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:58.107+0000 7fe5cecc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:58.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:58.123+0000 7fe5cecc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:58.913 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T14:48:58.937 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T14:48:59.045 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 18 16 1350 1334 4.6315 5.4375 0.148281 0.214332 2024-09-11T14:48:59.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:59.094+0000 7fb792b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:59.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:59.106+0000 7fb792b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:59.561 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:48:59.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:59.721+0000 7f8bd3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:59.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:48:59.733+0000 7f8bd3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:48:59.924 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T14:48:59.951 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T14:48:59.951 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:49:00.045 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 19 16 1431 1415 4.65416 5.0625 0.196496 0.213623 2024-09-11T14:49:00.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:00.106+0000 7f50e6151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:00.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:00.120+0000 7f50e6151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:00.502 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:49:00.503 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:49:00.528 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":465,"stamp":"2024-09-11T14:48:59.924391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":87884339,"num_objects":1336,"num_object_clones":0,"num_object_copies":4008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1413,"num_write_kb":86356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1387,"ondisk_log_size":1387,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":500112,"kb_used_data":500112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208690800,"statfs":{"total":214211493888,"available":213699379200,"internally_reserved":0,"allocated":512114688,"data_stored":512114688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26214400,"num_objects":400,"num_object_clones":0,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.538419"},"pg_stats":[{"pgid":"7.f","version":"83'90","reported_seq":111,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.306635+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:48:59.306635+0000","last_peered":"2024-09-11T14:48:59.306635+0000","last_clean":"2024-09-11T14:48:59.306635+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:48:59.306635+0000","last_undegraded":"2024-09-11T14:48:59.306635+0000","last_fullsized":"2024-09-11T14:48:59.306635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"82'79","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.016326+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:48:58.016326+0000","last_peered":"2024-09-11T14:48:58.016326+0000","last_clean":"2024-09-11T14:48:58.016326+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:48:58.016326+0000","last_undegraded":"2024-09-11T14:48:58.016326+0000","last_fullsized":"2024-09-11T14:48:58.016326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"82'79","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.367855+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:48:58.367855+0000","last_peered":"2024-09-11T14:48:58.367855+0000","last_clean":"2024-09-11T14:48:58.367855+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:48:58.367855+0000","last_undegraded":"2024-09-11T14:48:58.367855+0000","last_fullsized":"2024-09-11T14:48:58.367855+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"82'79","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.277528+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:48:58.277528+0000","last_peered":"2024-09-11T14:48:58.277528+0000","last_clean":"2024-09-11T14:48:58.277528+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:48:58.277528+0000","last_undegraded":"2024-09-11T14:48:58.277528+0000","last_fullsized":"2024-09-11T14:48:58.277528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"83'88","reported_seq":109,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.200983+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:48:59.200983+0000","last_peered":"2024-09-11T14:48:59.200983+0000","last_clean":"2024-09-11T14:48:59.200983+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:48:59.200983+0000","last_undegraded":"2024-09-11T14:48:59.200983+0000","last_fullsized":"2024-09-11T14:48:59.200983+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"83'93","reported_seq":114,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.481709+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:48:59.481709+0000","last_peered":"2024-09-11T14:48:59.481709+0000","last_clean":"2024-09-11T14:48:59.481709+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:48:59.481709+0000","last_undegraded":"2024-09-11T14:48:59.481709+0000","last_fullsized":"2024-09-11T14:48:59.481709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"82'71","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.443504+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:48:58.443504+0000","last_peered":"2024-09-11T14:48:58.443504+0000","last_clean":"2024-09-11T14:48:58.443504+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:48:58.443504+0000","last_undegraded":"2024-09-11T14:48:58.443504+0000","last_fullsized":"2024-09-11T14:48:58.443504+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"82'83","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.115825+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:48:58.115825+0000","last_peered":"2024-09-11T14:48:58.115825+0000","last_clean":"2024-09-11T14:48:58.115825+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:48:58.115825+0000","last_undegraded":"2024-09-11T14:48:58.115825+0000","last_fullsized":"2024-09-11T14:48:58.115825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"83'100","reported_seq":121,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.543784+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:48:59.543784+0000","last_peered":"2024-09-11T14:48:59.543784+0000","last_clean":"2024-09-11T14:48:59.543784+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:48:59.543784+0000","last_undegraded":"2024-09-11T14:48:59.543784+0000","last_fullsized":"2024-09-11T14:48:59.543784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":289,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.027582+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:48:59.027582+0000","last_peered":"2024-09-11T14:48:59.027582+0000","last_clean":"2024-09-11T14:48:59.027582+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:48:59.027582+0000","last_undegraded":"2024-09-11T14:48:59.027582+0000","last_fullsized":"2024-09-11T14:48:59.027582+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":215,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.013805+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:48:58.013805+0000","last_peered":"2024-09-11T14:48:58.013805+0000","last_clean":"2024-09-11T14:48:58.013805+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:48:58.013805+0000","last_undegraded":"2024-09-11T14:48:58.013805+0000","last_fullsized":"2024-09-11T14:48:58.013805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"82'82","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.130007+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:48:58.130007+0000","last_peered":"2024-09-11T14:48:58.130007+0000","last_clean":"2024-09-11T14:48:58.130007+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:48:58.130007+0000","last_undegraded":"2024-09-11T14:48:58.130007+0000","last_fullsized":"2024-09-11T14:48:58.130007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:57.977506+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:48:57.977506+0000","last_peered":"2024-09-11T14:48:57.977506+0000","last_clean":"2024-09-11T14:48:57.977506+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:48:57.977506+0000","last_undegraded":"2024-09-11T14:48:57.977506+0000","last_fullsized":"2024-09-11T14:48:57.977506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"82'72","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.060787+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:48:58.060787+0000","last_peered":"2024-09-11T14:48:58.060787+0000","last_clean":"2024-09-11T14:48:58.060787+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:48:58.060787+0000","last_undegraded":"2024-09-11T14:48:58.060787+0000","last_fullsized":"2024-09-11T14:48:58.060787+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.010915+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:48:58.010915+0000","last_peered":"2024-09-11T14:48:58.010915+0000","last_clean":"2024-09-11T14:48:58.010915+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:48:58.010915+0000","last_undegraded":"2024-09-11T14:48:58.010915+0000","last_fullsized":"2024-09-11T14:48:58.010915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"82'64","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.018771+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:48:58.018771+0000","last_peered":"2024-09-11T14:48:58.018771+0000","last_clean":"2024-09-11T14:48:58.018771+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:48:58.018771+0000","last_undegraded":"2024-09-11T14:48:58.018771+0000","last_fullsized":"2024-09-11T14:48:58.018771+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":216,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:57.971296+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:48:57.971296+0000","last_peered":"2024-09-11T14:48:57.971296+0000","last_clean":"2024-09-11T14:48:57.971296+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:48:57.971296+0000","last_undegraded":"2024-09-11T14:48:57.971296+0000","last_fullsized":"2024-09-11T14:48:57.971296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"82'72","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.184811+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:48:58.184811+0000","last_peered":"2024-09-11T14:48:58.184811+0000","last_clean":"2024-09-11T14:48:58.184811+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:48:58.184811+0000","last_undegraded":"2024-09-11T14:48:58.184811+0000","last_fullsized":"2024-09-11T14:48:58.184811+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.056165+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:48:58.056165+0000","last_peered":"2024-09-11T14:48:58.056165+0000","last_clean":"2024-09-11T14:48:58.056165+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:48:58.056165+0000","last_undegraded":"2024-09-11T14:48:58.056165+0000","last_fullsized":"2024-09-11T14:48:58.056165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"82'93","reported_seq":111,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.115348+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:48:58.115348+0000","last_peered":"2024-09-11T14:48:58.115348+0000","last_clean":"2024-09-11T14:48:58.115348+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:48:58.115348+0000","last_undegraded":"2024-09-11T14:48:58.115348+0000","last_fullsized":"2024-09-11T14:48:58.115348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":217,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.038535+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:48:59.038535+0000","last_peered":"2024-09-11T14:48:59.038535+0000","last_clean":"2024-09-11T14:48:59.038535+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:48:59.038535+0000","last_undegraded":"2024-09-11T14:48:59.038535+0000","last_fullsized":"2024-09-11T14:48:59.038535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"83'106","reported_seq":127,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.397888+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:48:59.397888+0000","last_peered":"2024-09-11T14:48:59.397888+0000","last_clean":"2024-09-11T14:48:59.397888+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:48:59.397888+0000","last_undegraded":"2024-09-11T14:48:59.397888+0000","last_fullsized":"2024-09-11T14:48:59.397888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":6784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.055640+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:48:58.055640+0000","last_peered":"2024-09-11T14:48:58.055640+0000","last_clean":"2024-09-11T14:48:58.055640+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:48:58.055640+0000","last_undegraded":"2024-09-11T14:48:58.055640+0000","last_fullsized":"2024-09-11T14:48:58.055640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"83'81","reported_seq":102,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.422783+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:48:59.422783+0000","last_peered":"2024-09-11T14:48:59.422783+0000","last_clean":"2024-09-11T14:48:59.422783+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:48:59.422783+0000","last_undegraded":"2024-09-11T14:48:59.422783+0000","last_fullsized":"2024-09-11T14:48:59.422783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.013593+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:48:58.013593+0000","last_peered":"2024-09-11T14:48:58.013593+0000","last_clean":"2024-09-11T14:48:58.013593+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:48:58.013593+0000","last_undegraded":"2024-09-11T14:48:58.013593+0000","last_fullsized":"2024-09-11T14:48:58.013593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":87293952,"num_objects":1332,"num_object_clones":0,"num_object_copies":3996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1332,"num_write_kb":85248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213679874048,"internally_reserved":0,"allocated":531619840,"data_stored":531619840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1332,"ondisk_log_size":1332,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213680136192,"internally_reserved":0,"allocated":531357696,"data_stored":531357696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53379207168,"internally_reserved":0,"allocated":173666304,"data_stored":173666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673734,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":164944,"kb_used_data":164944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52132784,"statfs":{"total":53552873472,"available":53383970816,"internally_reserved":0,"allocated":168902656,"data_stored":168902656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706437,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":92288,"kb_used_data":92288,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52205440,"statfs":{"total":53552873472,"available":53458370560,"internally_reserved":0,"allocated":94502912,"data_stored":94502912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706437,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":111040,"kb_used_data":111040,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52186688,"statfs":{"total":53552873472,"available":53439168512,"internally_reserved":0,"allocated":113704960,"data_stored":113704960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706438,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":131840,"kb_used_data":131840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165888,"statfs":{"total":53552873472,"available":53417869312,"internally_reserved":0,"allocated":135004160,"data_stored":135004160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53379207168,"internally_reserved":0,"allocated":173666304,"data_stored":173666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53432193024,"internally_reserved":0,"allocated":120680448,"data_stored":120680448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53415620608,"internally_reserved":0,"allocated":137252864,"data_stored":137252864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53453115392,"internally_reserved":0,"allocated":99758080,"data_stored":99758080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53379207168,"internally_reserved":0,"allocated":173666304,"data_stored":173666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53432193024,"internally_reserved":0,"allocated":120680448,"data_stored":120680448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53415489536,"internally_reserved":0,"allocated":137383936,"data_stored":137383936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53452984320,"internally_reserved":0,"allocated":99889152,"data_stored":99889152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53379207168,"internally_reserved":0,"allocated":173666304,"data_stored":173666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:49:00.530 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:49:00.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:00.687+0000 7fe1d3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:00.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:00.697+0000 7fe1d3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:00.978 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:49:00.979 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:49:01.003 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":465,"stamp":"2024-09-11T14:48:59.924391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":87884339,"num_objects":1336,"num_object_clones":0,"num_object_copies":4008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1413,"num_write_kb":86356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1387,"ondisk_log_size":1387,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":500112,"kb_used_data":500112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208690800,"statfs":{"total":214211493888,"available":213699379200,"internally_reserved":0,"allocated":512114688,"data_stored":512114688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26214400,"num_objects":400,"num_object_clones":0,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.538419"},"pg_stats":[{"pgid":"7.f","version":"83'90","reported_seq":111,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.306635+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:48:59.306635+0000","last_peered":"2024-09-11T14:48:59.306635+0000","last_clean":"2024-09-11T14:48:59.306635+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:48:59.306635+0000","last_undegraded":"2024-09-11T14:48:59.306635+0000","last_fullsized":"2024-09-11T14:48:59.306635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"82'79","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.016326+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:48:58.016326+0000","last_peered":"2024-09-11T14:48:58.016326+0000","last_clean":"2024-09-11T14:48:58.016326+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:48:58.016326+0000","last_undegraded":"2024-09-11T14:48:58.016326+0000","last_fullsized":"2024-09-11T14:48:58.016326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"82'79","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.367855+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:48:58.367855+0000","last_peered":"2024-09-11T14:48:58.367855+0000","last_clean":"2024-09-11T14:48:58.367855+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:48:58.367855+0000","last_undegraded":"2024-09-11T14:48:58.367855+0000","last_fullsized":"2024-09-11T14:48:58.367855+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"82'79","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.277528+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:48:58.277528+0000","last_peered":"2024-09-11T14:48:58.277528+0000","last_clean":"2024-09-11T14:48:58.277528+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:48:58.277528+0000","last_undegraded":"2024-09-11T14:48:58.277528+0000","last_fullsized":"2024-09-11T14:48:58.277528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"83'88","reported_seq":109,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.200983+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:48:59.200983+0000","last_peered":"2024-09-11T14:48:59.200983+0000","last_clean":"2024-09-11T14:48:59.200983+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:48:59.200983+0000","last_undegraded":"2024-09-11T14:48:59.200983+0000","last_fullsized":"2024-09-11T14:48:59.200983+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"83'93","reported_seq":114,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.481709+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:48:59.481709+0000","last_peered":"2024-09-11T14:48:59.481709+0000","last_clean":"2024-09-11T14:48:59.481709+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:48:59.481709+0000","last_undegraded":"2024-09-11T14:48:59.481709+0000","last_fullsized":"2024-09-11T14:48:59.481709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"82'71","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.443504+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:48:58.443504+0000","last_peered":"2024-09-11T14:48:58.443504+0000","last_clean":"2024-09-11T14:48:58.443504+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:48:58.443504+0000","last_undegraded":"2024-09-11T14:48:58.443504+0000","last_fullsized":"2024-09-11T14:48:58.443504+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"82'83","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.115825+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:48:58.115825+0000","last_peered":"2024-09-11T14:48:58.115825+0000","last_clean":"2024-09-11T14:48:58.115825+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:48:58.115825+0000","last_undegraded":"2024-09-11T14:48:58.115825+0000","last_fullsized":"2024-09-11T14:48:58.115825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"83'100","reported_seq":121,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.543784+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:48:59.543784+0000","last_peered":"2024-09-11T14:48:59.543784+0000","last_clean":"2024-09-11T14:48:59.543784+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:48:59.543784+0000","last_undegraded":"2024-09-11T14:48:59.543784+0000","last_fullsized":"2024-09-11T14:48:59.543784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":289,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.027582+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:48:59.027582+0000","last_peered":"2024-09-11T14:48:59.027582+0000","last_clean":"2024-09-11T14:48:59.027582+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:48:59.027582+0000","last_undegraded":"2024-09-11T14:48:59.027582+0000","last_fullsized":"2024-09-11T14:48:59.027582+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":215,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.013805+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:48:58.013805+0000","last_peered":"2024-09-11T14:48:58.013805+0000","last_clean":"2024-09-11T14:48:58.013805+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:48:58.013805+0000","last_undegraded":"2024-09-11T14:48:58.013805+0000","last_fullsized":"2024-09-11T14:48:58.013805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"82'82","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.130007+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:48:58.130007+0000","last_peered":"2024-09-11T14:48:58.130007+0000","last_clean":"2024-09-11T14:48:58.130007+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:48:58.130007+0000","last_undegraded":"2024-09-11T14:48:58.130007+0000","last_fullsized":"2024-09-11T14:48:58.130007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:57.977506+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:48:57.977506+0000","last_peered":"2024-09-11T14:48:57.977506+0000","last_clean":"2024-09-11T14:48:57.977506+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:48:57.977506+0000","last_undegraded":"2024-09-11T14:48:57.977506+0000","last_fullsized":"2024-09-11T14:48:57.977506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"82'72","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.060787+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:48:58.060787+0000","last_peered":"2024-09-11T14:48:58.060787+0000","last_clean":"2024-09-11T14:48:58.060787+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:48:58.060787+0000","last_undegraded":"2024-09-11T14:48:58.060787+0000","last_fullsized":"2024-09-11T14:48:58.060787+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.010915+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:48:58.010915+0000","last_peered":"2024-09-11T14:48:58.010915+0000","last_clean":"2024-09-11T14:48:58.010915+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:48:58.010915+0000","last_undegraded":"2024-09-11T14:48:58.010915+0000","last_fullsized":"2024-09-11T14:48:58.010915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"82'64","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.018771+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:48:58.018771+0000","last_peered":"2024-09-11T14:48:58.018771+0000","last_clean":"2024-09-11T14:48:58.018771+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:48:58.018771+0000","last_undegraded":"2024-09-11T14:48:58.018771+0000","last_fullsized":"2024-09-11T14:48:58.018771+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":216,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:57.971296+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:48:57.971296+0000","last_peered":"2024-09-11T14:48:57.971296+0000","last_clean":"2024-09-11T14:48:57.971296+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:48:57.971296+0000","last_undegraded":"2024-09-11T14:48:57.971296+0000","last_fullsized":"2024-09-11T14:48:57.971296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"82'72","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.184811+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:48:58.184811+0000","last_peered":"2024-09-11T14:48:58.184811+0000","last_clean":"2024-09-11T14:48:58.184811+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:48:58.184811+0000","last_undegraded":"2024-09-11T14:48:58.184811+0000","last_fullsized":"2024-09-11T14:48:58.184811+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.056165+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:48:58.056165+0000","last_peered":"2024-09-11T14:48:58.056165+0000","last_clean":"2024-09-11T14:48:58.056165+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:48:58.056165+0000","last_undegraded":"2024-09-11T14:48:58.056165+0000","last_fullsized":"2024-09-11T14:48:58.056165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"82'93","reported_seq":111,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.115348+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:48:58.115348+0000","last_peered":"2024-09-11T14:48:58.115348+0000","last_clean":"2024-09-11T14:48:58.115348+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:48:58.115348+0000","last_undegraded":"2024-09-11T14:48:58.115348+0000","last_fullsized":"2024-09-11T14:48:58.115348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":217,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.038535+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:48:59.038535+0000","last_peered":"2024-09-11T14:48:59.038535+0000","last_clean":"2024-09-11T14:48:59.038535+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:48:59.038535+0000","last_undegraded":"2024-09-11T14:48:59.038535+0000","last_fullsized":"2024-09-11T14:48:59.038535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"83'106","reported_seq":127,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.397888+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:48:59.397888+0000","last_peered":"2024-09-11T14:48:59.397888+0000","last_clean":"2024-09-11T14:48:59.397888+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:48:59.397888+0000","last_undegraded":"2024-09-11T14:48:59.397888+0000","last_fullsized":"2024-09-11T14:48:59.397888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":6784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.055640+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:48:58.055640+0000","last_peered":"2024-09-11T14:48:58.055640+0000","last_clean":"2024-09-11T14:48:58.055640+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:48:58.055640+0000","last_undegraded":"2024-09-11T14:48:58.055640+0000","last_fullsized":"2024-09-11T14:48:58.055640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"83'81","reported_seq":102,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.422783+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:48:59.422783+0000","last_peered":"2024-09-11T14:48:59.422783+0000","last_clean":"2024-09-11T14:48:59.422783+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:48:59.422783+0000","last_undegraded":"2024-09-11T14:48:59.422783+0000","last_fullsized":"2024-09-11T14:48:59.422783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.013593+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:48:58.013593+0000","last_peered":"2024-09-11T14:48:58.013593+0000","last_clean":"2024-09-11T14:48:58.013593+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:48:58.013593+0000","last_undegraded":"2024-09-11T14:48:58.013593+0000","last_fullsized":"2024-09-11T14:48:58.013593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":87293952,"num_objects":1332,"num_object_clones":0,"num_object_copies":3996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1332,"num_write_kb":85248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213679874048,"internally_reserved":0,"allocated":531619840,"data_stored":531619840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1332,"ondisk_log_size":1332,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213680136192,"internally_reserved":0,"allocated":531357696,"data_stored":531357696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53379207168,"internally_reserved":0,"allocated":173666304,"data_stored":173666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673734,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":164944,"kb_used_data":164944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52132784,"statfs":{"total":53552873472,"available":53383970816,"internally_reserved":0,"allocated":168902656,"data_stored":168902656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706437,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":92288,"kb_used_data":92288,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52205440,"statfs":{"total":53552873472,"available":53458370560,"internally_reserved":0,"allocated":94502912,"data_stored":94502912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706437,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":111040,"kb_used_data":111040,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52186688,"statfs":{"total":53552873472,"available":53439168512,"internally_reserved":0,"allocated":113704960,"data_stored":113704960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706438,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":131840,"kb_used_data":131840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165888,"statfs":{"total":53552873472,"available":53417869312,"internally_reserved":0,"allocated":135004160,"data_stored":135004160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53379207168,"internally_reserved":0,"allocated":173666304,"data_stored":173666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53432193024,"internally_reserved":0,"allocated":120680448,"data_stored":120680448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53415620608,"internally_reserved":0,"allocated":137252864,"data_stored":137252864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53453115392,"internally_reserved":0,"allocated":99758080,"data_stored":99758080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53379207168,"internally_reserved":0,"allocated":173666304,"data_stored":173666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53432193024,"internally_reserved":0,"allocated":120680448,"data_stored":120680448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53415489536,"internally_reserved":0,"allocated":137383936,"data_stored":137383936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53452984320,"internally_reserved":0,"allocated":99889152,"data_stored":99889152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53379207168,"internally_reserved":0,"allocated":173666304,"data_stored":173666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:49:01.004 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T14:49:01.005 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:49:01.005 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:49:01.045 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:49:01.045147+0000 min lat: 0.0273213 max lat: 1.08126 avg lat: 0.213157 2024-09-11T14:49:01.045 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:49:01.045 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 20 16 1508 1492 4.66206 4.8125 0.20029 0.213157 2024-09-11T14:49:01.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:01.148+0000 7f1a67391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:01.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:01.160+0000 7f1a67391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:01.519 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:49:01.520 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:49:01.548 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":466,"stamp":"2024-09-11T14:49:01.387325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":87884339,"num_objects":1336,"num_object_clones":0,"num_object_copies":4008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1413,"num_write_kb":86356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1387,"ondisk_log_size":1387,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":500112,"kb_used_data":500112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208690800,"statfs":{"total":214211493888,"available":213699379200,"internally_reserved":0,"allocated":512114688,"data_stored":512114688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26214400,"num_objects":400,"num_object_clones":0,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.946680"},"pg_stats":[{"pgid":"7.f","version":"83'90","reported_seq":111,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.306635+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:48:59.306635+0000","last_peered":"2024-09-11T14:48:59.306635+0000","last_clean":"2024-09-11T14:48:59.306635+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:48:59.306635+0000","last_undegraded":"2024-09-11T14:48:59.306635+0000","last_fullsized":"2024-09-11T14:48:59.306635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"82'79","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.016326+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:48:58.016326+0000","last_peered":"2024-09-11T14:48:58.016326+0000","last_clean":"2024-09-11T14:48:58.016326+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:48:58.016326+0000","last_undegraded":"2024-09-11T14:48:58.016326+0000","last_fullsized":"2024-09-11T14:48:58.016326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"82'79","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.367855+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:48:58.367855+0000","last_peered":"2024-09-11T14:48:58.367855+0000","last_clean":"2024-09-11T14:48:58.367855+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:48:58.367855+0000","last_undegraded":"2024-09-11T14:48:58.367855+0000","last_fullsized":"2024-09-11T14:48:58.367855+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"82'79","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.277528+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:48:58.277528+0000","last_peered":"2024-09-11T14:48:58.277528+0000","last_clean":"2024-09-11T14:48:58.277528+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:48:58.277528+0000","last_undegraded":"2024-09-11T14:48:58.277528+0000","last_fullsized":"2024-09-11T14:48:58.277528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"83'88","reported_seq":109,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.200983+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:48:59.200983+0000","last_peered":"2024-09-11T14:48:59.200983+0000","last_clean":"2024-09-11T14:48:59.200983+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:48:59.200983+0000","last_undegraded":"2024-09-11T14:48:59.200983+0000","last_fullsized":"2024-09-11T14:48:59.200983+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"83'93","reported_seq":114,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.481709+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:48:59.481709+0000","last_peered":"2024-09-11T14:48:59.481709+0000","last_clean":"2024-09-11T14:48:59.481709+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:48:59.481709+0000","last_undegraded":"2024-09-11T14:48:59.481709+0000","last_fullsized":"2024-09-11T14:48:59.481709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"82'71","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.443504+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:48:58.443504+0000","last_peered":"2024-09-11T14:48:58.443504+0000","last_clean":"2024-09-11T14:48:58.443504+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:48:58.443504+0000","last_undegraded":"2024-09-11T14:48:58.443504+0000","last_fullsized":"2024-09-11T14:48:58.443504+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"82'83","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.115825+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:48:58.115825+0000","last_peered":"2024-09-11T14:48:58.115825+0000","last_clean":"2024-09-11T14:48:58.115825+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:48:58.115825+0000","last_undegraded":"2024-09-11T14:48:58.115825+0000","last_fullsized":"2024-09-11T14:48:58.115825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"83'100","reported_seq":121,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.543784+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:48:59.543784+0000","last_peered":"2024-09-11T14:48:59.543784+0000","last_clean":"2024-09-11T14:48:59.543784+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:48:59.543784+0000","last_undegraded":"2024-09-11T14:48:59.543784+0000","last_fullsized":"2024-09-11T14:48:59.543784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":289,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.027582+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:48:59.027582+0000","last_peered":"2024-09-11T14:48:59.027582+0000","last_clean":"2024-09-11T14:48:59.027582+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:48:59.027582+0000","last_undegraded":"2024-09-11T14:48:59.027582+0000","last_fullsized":"2024-09-11T14:48:59.027582+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":215,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.013805+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:48:58.013805+0000","last_peered":"2024-09-11T14:48:58.013805+0000","last_clean":"2024-09-11T14:48:58.013805+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:48:58.013805+0000","last_undegraded":"2024-09-11T14:48:58.013805+0000","last_fullsized":"2024-09-11T14:48:58.013805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"82'82","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.130007+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:48:58.130007+0000","last_peered":"2024-09-11T14:48:58.130007+0000","last_clean":"2024-09-11T14:48:58.130007+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:48:58.130007+0000","last_undegraded":"2024-09-11T14:48:58.130007+0000","last_fullsized":"2024-09-11T14:48:58.130007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:57.977506+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:48:57.977506+0000","last_peered":"2024-09-11T14:48:57.977506+0000","last_clean":"2024-09-11T14:48:57.977506+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:48:57.977506+0000","last_undegraded":"2024-09-11T14:48:57.977506+0000","last_fullsized":"2024-09-11T14:48:57.977506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"82'72","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.060787+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:48:58.060787+0000","last_peered":"2024-09-11T14:48:58.060787+0000","last_clean":"2024-09-11T14:48:58.060787+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:48:58.060787+0000","last_undegraded":"2024-09-11T14:48:58.060787+0000","last_fullsized":"2024-09-11T14:48:58.060787+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.010915+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:48:58.010915+0000","last_peered":"2024-09-11T14:48:58.010915+0000","last_clean":"2024-09-11T14:48:58.010915+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:48:58.010915+0000","last_undegraded":"2024-09-11T14:48:58.010915+0000","last_fullsized":"2024-09-11T14:48:58.010915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"82'64","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.018771+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:48:58.018771+0000","last_peered":"2024-09-11T14:48:58.018771+0000","last_clean":"2024-09-11T14:48:58.018771+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:48:58.018771+0000","last_undegraded":"2024-09-11T14:48:58.018771+0000","last_fullsized":"2024-09-11T14:48:58.018771+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":216,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:57.971296+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:48:57.971296+0000","last_peered":"2024-09-11T14:48:57.971296+0000","last_clean":"2024-09-11T14:48:57.971296+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:48:57.971296+0000","last_undegraded":"2024-09-11T14:48:57.971296+0000","last_fullsized":"2024-09-11T14:48:57.971296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"82'72","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.184811+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:48:58.184811+0000","last_peered":"2024-09-11T14:48:58.184811+0000","last_clean":"2024-09-11T14:48:58.184811+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:48:58.184811+0000","last_undegraded":"2024-09-11T14:48:58.184811+0000","last_fullsized":"2024-09-11T14:48:58.184811+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.056165+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:48:58.056165+0000","last_peered":"2024-09-11T14:48:58.056165+0000","last_clean":"2024-09-11T14:48:58.056165+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:48:58.056165+0000","last_undegraded":"2024-09-11T14:48:58.056165+0000","last_fullsized":"2024-09-11T14:48:58.056165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"82'93","reported_seq":111,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.115348+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:48:58.115348+0000","last_peered":"2024-09-11T14:48:58.115348+0000","last_clean":"2024-09-11T14:48:58.115348+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:48:58.115348+0000","last_undegraded":"2024-09-11T14:48:58.115348+0000","last_fullsized":"2024-09-11T14:48:58.115348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":217,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.038535+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:48:59.038535+0000","last_peered":"2024-09-11T14:48:59.038535+0000","last_clean":"2024-09-11T14:48:59.038535+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:48:59.038535+0000","last_undegraded":"2024-09-11T14:48:59.038535+0000","last_fullsized":"2024-09-11T14:48:59.038535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"83'106","reported_seq":127,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.397888+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:48:59.397888+0000","last_peered":"2024-09-11T14:48:59.397888+0000","last_clean":"2024-09-11T14:48:59.397888+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:48:59.397888+0000","last_undegraded":"2024-09-11T14:48:59.397888+0000","last_fullsized":"2024-09-11T14:48:59.397888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":6784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.055640+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:48:58.055640+0000","last_peered":"2024-09-11T14:48:58.055640+0000","last_clean":"2024-09-11T14:48:58.055640+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:48:58.055640+0000","last_undegraded":"2024-09-11T14:48:58.055640+0000","last_fullsized":"2024-09-11T14:48:58.055640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"83'81","reported_seq":102,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.422783+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:48:59.422783+0000","last_peered":"2024-09-11T14:48:59.422783+0000","last_clean":"2024-09-11T14:48:59.422783+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:48:59.422783+0000","last_undegraded":"2024-09-11T14:48:59.422783+0000","last_fullsized":"2024-09-11T14:48:59.422783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T14:48:58.013593+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:48:58.013593+0000","last_peered":"2024-09-11T14:48:58.013593+0000","last_clean":"2024-09-11T14:48:58.013593+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:48:58.013593+0000","last_undegraded":"2024-09-11T14:48:58.013593+0000","last_fullsized":"2024-09-11T14:48:58.013593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":87293952,"num_objects":1332,"num_object_clones":0,"num_object_copies":3996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1332,"num_write_kb":85248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213679874048,"internally_reserved":0,"allocated":531619840,"data_stored":531619840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1332,"ondisk_log_size":1332,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213680136192,"internally_reserved":0,"allocated":531357696,"data_stored":531357696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53379207168,"internally_reserved":0,"allocated":173666304,"data_stored":173666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673734,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":164944,"kb_used_data":164944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52132784,"statfs":{"total":53552873472,"available":53383970816,"internally_reserved":0,"allocated":168902656,"data_stored":168902656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706437,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":92288,"kb_used_data":92288,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52205440,"statfs":{"total":53552873472,"available":53458370560,"internally_reserved":0,"allocated":94502912,"data_stored":94502912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706437,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":111040,"kb_used_data":111040,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52186688,"statfs":{"total":53552873472,"available":53439168512,"internally_reserved":0,"allocated":113704960,"data_stored":113704960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706438,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":131840,"kb_used_data":131840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165888,"statfs":{"total":53552873472,"available":53417869312,"internally_reserved":0,"allocated":135004160,"data_stored":135004160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53379207168,"internally_reserved":0,"allocated":173666304,"data_stored":173666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53432193024,"internally_reserved":0,"allocated":120680448,"data_stored":120680448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53415620608,"internally_reserved":0,"allocated":137252864,"data_stored":137252864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53453115392,"internally_reserved":0,"allocated":99758080,"data_stored":99758080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53379207168,"internally_reserved":0,"allocated":173666304,"data_stored":173666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53432193024,"internally_reserved":0,"allocated":120680448,"data_stored":120680448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53415489536,"internally_reserved":0,"allocated":137383936,"data_stored":137383936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53452984320,"internally_reserved":0,"allocated":99889152,"data_stored":99889152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53379207168,"internally_reserved":0,"allocated":173666304,"data_stored":173666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:49:02.045 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 21 16 1590 1574 4.68407 5.125 0.451921 0.211556 2024-09-11T14:49:02.310 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:49:02.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:02.463+0000 7efd836d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:02.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:02.473+0000 7efd836d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:03.045 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 22 16 1670 1654 4.69841 5 0.168442 0.211796 2024-09-11T14:49:04.045 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 23 16 1746 1730 4.70063 4.75 0.499103 0.211608 2024-09-11T14:49:05.046 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 24 16 1820 1804 4.69747 4.625 0.194553 0.211911 2024-09-11T14:49:05.102 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:49:05.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:05.280+0000 7fbaa3911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:05.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:05.288+0000 7fbaa3911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:06.045 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 25 16 1902 1886 4.71456 5.125 0.202736 0.21082 2024-09-11T14:49:06.550 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:49:06.550 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:49:06.550 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:49:06.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:06.704+0000 7f92a8c46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:06.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:06.720+0000 7f92a8c46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:07.046 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 26 16 1991 1975 4.74715 5.5625 0.128022 0.209711 2024-09-11T14:49:07.106 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:49:07.106 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:49:07.128 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":468,"stamp":"2024-09-11T14:49:05.388199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114098739,"num_objects":1736,"num_object_clones":0,"num_object_copies":5208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1813,"num_write_kb":111956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1787,"ondisk_log_size":1787,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":656380,"kb_used_data":656380,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208534532,"statfs":{"total":214211493888,"available":213539360768,"internally_reserved":0,"allocated":672133120,"data_stored":672133120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":52428800,"num_objects":800,"num_object_clones":0,"num_object_copies":2400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.475417"},"pg_stats":[{"pgid":"7.f","version":"84'115","reported_seq":139,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:04.270492+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:49:04.270492+0000","last_peered":"2024-09-11T14:49:04.270492+0000","last_clean":"2024-09-11T14:49:04.270492+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:49:04.270492+0000","last_undegraded":"2024-09-11T14:49:04.270492+0000","last_fullsized":"2024-09-11T14:49:04.270492+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"84'105","reported_seq":129,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:03.253245+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:49:03.253245+0000","last_peered":"2024-09-11T14:49:03.253245+0000","last_clean":"2024-09-11T14:49:03.253245+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:49:03.253245+0000","last_undegraded":"2024-09-11T14:49:03.253245+0000","last_fullsized":"2024-09-11T14:49:03.253245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"84'108","reported_seq":132,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:02.742058+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:49:02.742058+0000","last_peered":"2024-09-11T14:49:02.742058+0000","last_clean":"2024-09-11T14:49:02.742058+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:49:02.742058+0000","last_undegraded":"2024-09-11T14:49:02.742058+0000","last_fullsized":"2024-09-11T14:49:02.742058+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"84'103","reported_seq":127,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:03.008002+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:49:03.008002+0000","last_peered":"2024-09-11T14:49:03.008002+0000","last_clean":"2024-09-11T14:49:03.008002+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:49:03.008002+0000","last_undegraded":"2024-09-11T14:49:03.008002+0000","last_fullsized":"2024-09-11T14:49:03.008002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750208,"num_objects":103,"num_object_clones":0,"num_object_copies":309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":6592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"84'111","reported_seq":135,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:04.549473+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:49:04.549473+0000","last_peered":"2024-09-11T14:49:04.549473+0000","last_clean":"2024-09-11T14:49:04.549473+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:49:04.549473+0000","last_undegraded":"2024-09-11T14:49:04.549473+0000","last_fullsized":"2024-09-11T14:49:04.549473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"84'110","reported_seq":134,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:03.980577+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:49:03.980577+0000","last_peered":"2024-09-11T14:49:03.980577+0000","last_clean":"2024-09-11T14:49:03.980577+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:49:03.980577+0000","last_undegraded":"2024-09-11T14:49:03.980577+0000","last_fullsized":"2024-09-11T14:49:03.980577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"84'91","reported_seq":115,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:03.378404+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:49:03.378404+0000","last_peered":"2024-09-11T14:49:03.378404+0000","last_clean":"2024-09-11T14:49:03.378404+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:49:03.378404+0000","last_undegraded":"2024-09-11T14:49:03.378404+0000","last_fullsized":"2024-09-11T14:49:03.378404+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5963776,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"84'118","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:03.359075+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:49:03.359075+0000","last_peered":"2024-09-11T14:49:03.359075+0000","last_clean":"2024-09-11T14:49:03.359075+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:49:03.359075+0000","last_undegraded":"2024-09-11T14:49:03.359075+0000","last_fullsized":"2024-09-11T14:49:03.359075+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"84'125","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:04.054902+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:49:04.054902+0000","last_peered":"2024-09-11T14:49:04.054902+0000","last_clean":"2024-09-11T14:49:04.054902+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:49:04.054902+0000","last_undegraded":"2024-09-11T14:49:04.054902+0000","last_fullsized":"2024-09-11T14:49:04.054902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.038142+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:49:00.038142+0000","last_peered":"2024-09-11T14:49:00.038142+0000","last_clean":"2024-09-11T14:49:00.038142+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:49:00.038142+0000","last_undegraded":"2024-09-11T14:49:00.038142+0000","last_fullsized":"2024-09-11T14:49:00.038142+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":221,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.140082+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:49:00.140082+0000","last_peered":"2024-09-11T14:49:00.140082+0000","last_clean":"2024-09-11T14:49:00.140082+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:49:00.140082+0000","last_undegraded":"2024-09-11T14:49:00.140082+0000","last_fullsized":"2024-09-11T14:49:00.140082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"84'102","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:02.769154+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:49:02.769154+0000","last_peered":"2024-09-11T14:49:02.769154+0000","last_clean":"2024-09-11T14:49:02.769154+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:49:02.769154+0000","last_undegraded":"2024-09-11T14:49:02.769154+0000","last_fullsized":"2024-09-11T14:49:02.769154+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":6528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.999989+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:48:59.999989+0000","last_peered":"2024-09-11T14:48:59.999989+0000","last_clean":"2024-09-11T14:48:59.999989+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:48:59.999989+0000","last_undegraded":"2024-09-11T14:48:59.999989+0000","last_fullsized":"2024-09-11T14:48:59.999989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"84'98","reported_seq":122,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:03.021142+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:49:03.021142+0000","last_peered":"2024-09-11T14:49:03.021142+0000","last_clean":"2024-09-11T14:49:03.021142+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:49:03.021142+0000","last_undegraded":"2024-09-11T14:49:03.021142+0000","last_fullsized":"2024-09-11T14:49:03.021142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.132805+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:49:00.132805+0000","last_peered":"2024-09-11T14:49:00.132805+0000","last_clean":"2024-09-11T14:49:00.132805+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:49:00.132805+0000","last_undegraded":"2024-09-11T14:49:00.132805+0000","last_fullsized":"2024-09-11T14:49:00.132805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"84'92","reported_seq":116,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:03.150645+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:49:03.150645+0000","last_peered":"2024-09-11T14:49:03.150645+0000","last_clean":"2024-09-11T14:49:03.150645+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:49:03.150645+0000","last_undegraded":"2024-09-11T14:49:03.150645+0000","last_fullsized":"2024-09-11T14:49:03.150645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.994613+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:48:59.994613+0000","last_peered":"2024-09-11T14:48:59.994613+0000","last_clean":"2024-09-11T14:48:59.994613+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:48:59.994613+0000","last_undegraded":"2024-09-11T14:48:59.994613+0000","last_fullsized":"2024-09-11T14:48:59.994613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"84'105","reported_seq":129,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:03.081107+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:49:03.081107+0000","last_peered":"2024-09-11T14:49:03.081107+0000","last_clean":"2024-09-11T14:49:03.081107+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:49:03.081107+0000","last_undegraded":"2024-09-11T14:49:03.081107+0000","last_fullsized":"2024-09-11T14:49:03.081107+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.362042+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:49:00.362042+0000","last_peered":"2024-09-11T14:49:00.362042+0000","last_clean":"2024-09-11T14:49:00.362042+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:49:00.362042+0000","last_undegraded":"2024-09-11T14:49:00.362042+0000","last_fullsized":"2024-09-11T14:49:00.362042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"84'113","reported_seq":137,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:03.207387+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:49:03.207387+0000","last_peered":"2024-09-11T14:49:03.207387+0000","last_clean":"2024-09-11T14:49:03.207387+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:49:03.207387+0000","last_undegraded":"2024-09-11T14:49:03.207387+0000","last_fullsized":"2024-09-11T14:49:03.207387+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.049486+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.049486+0000","last_peered":"2024-09-11T14:49:00.049486+0000","last_clean":"2024-09-11T14:49:00.049486+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:49:00.049486+0000","last_undegraded":"2024-09-11T14:49:00.049486+0000","last_fullsized":"2024-09-11T14:49:00.049486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"84'129","reported_seq":153,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:04.149560+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:49:04.149560+0000","last_peered":"2024-09-11T14:49:04.149560+0000","last_clean":"2024-09-11T14:49:04.149560+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:49:04.149560+0000","last_undegraded":"2024-09-11T14:49:04.149560+0000","last_fullsized":"2024-09-11T14:49:04.149560+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.363620+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.363620+0000","last_peered":"2024-09-11T14:49:00.363620+0000","last_clean":"2024-09-11T14:49:00.363620+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:49:00.363620+0000","last_undegraded":"2024-09-11T14:49:00.363620+0000","last_fullsized":"2024-09-11T14:49:00.363620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"84'107","reported_seq":131,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:04.262098+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:49:04.262098+0000","last_peered":"2024-09-11T14:49:04.262098+0000","last_clean":"2024-09-11T14:49:04.262098+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:49:04.262098+0000","last_undegraded":"2024-09-11T14:49:04.262098+0000","last_fullsized":"2024-09-11T14:49:04.262098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.145019+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:49:00.145019+0000","last_peered":"2024-09-11T14:49:00.145019+0000","last_clean":"2024-09-11T14:49:00.145019+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:49:00.145019+0000","last_undegraded":"2024-09-11T14:49:00.145019+0000","last_fullsized":"2024-09-11T14:49:00.145019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":113508352,"num_objects":1732,"num_object_clones":0,"num_object_copies":5196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1732,"num_write_kb":110848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213521313792,"internally_reserved":0,"allocated":690180096,"data_stored":690180096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1732,"ondisk_log_size":1732,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213521313792,"internally_reserved":0,"allocated":690180096,"data_stored":690180096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53330288640,"internally_reserved":0,"allocated":222584832,"data_stored":222584832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":213376,"kb_used_data":213376,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52084352,"statfs":{"total":53552873472,"available":53334376448,"internally_reserved":0,"allocated":218497024,"data_stored":218497024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":120196,"kb_used_data":120196,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52177532,"statfs":{"total":53552873472,"available":53429792768,"internally_reserved":0,"allocated":123080704,"data_stored":123080704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":148108,"kb_used_data":148108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52149620,"statfs":{"total":53552873472,"available":53401210880,"internally_reserved":0,"allocated":151662592,"data_stored":151662592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":174700,"kb_used_data":174700,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52123028,"statfs":{"total":53552873472,"available":53373980672,"internally_reserved":0,"allocated":178892800,"data_stored":178892800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53330288640,"internally_reserved":0,"allocated":222584832,"data_stored":222584832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53393969152,"internally_reserved":0,"allocated":158904320,"data_stored":158904320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53371863040,"internally_reserved":0,"allocated":181010432,"data_stored":181010432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53425192960,"internally_reserved":0,"allocated":127680512,"data_stored":127680512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53330288640,"internally_reserved":0,"allocated":222584832,"data_stored":222584832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53393969152,"internally_reserved":0,"allocated":158904320,"data_stored":158904320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53371863040,"internally_reserved":0,"allocated":181010432,"data_stored":181010432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53425192960,"internally_reserved":0,"allocated":127680512,"data_stored":127680512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53330288640,"internally_reserved":0,"allocated":222584832,"data_stored":222584832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:49:07.984 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:49:08.046 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 27 16 2066 2050 4.74493 4.6875 0.173103 0.209549 2024-09-11T14:49:08.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:08.122+0000 7f860b4f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:08.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:08.132+0000 7f860b4f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:09.046 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 28 16 2135 2119 4.72947 4.3125 0.0665017 0.210401 2024-09-11T14:49:10.046 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 29 16 2202 2186 4.71077 4.1875 0.0640219 0.21114 2024-09-11T14:49:10.569 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:49:10.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:10.742+0000 7f0a9be7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:10.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:10.751+0000 7f0a9be7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:11.046 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 30 16 2278 2262 4.71206 4.75 0.159444 0.211231 2024-09-11T14:49:12.046 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 31 16 2350 2334 4.70521 4.5 0.0706902 0.211177 2024-09-11T14:49:12.131 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:49:12.131 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:49:12.131 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:49:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:12.258+0000 7f1201591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:12.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:12.270+0000 7f1201591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:12.520 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:49:12.521 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:49:12.536 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":471,"stamp":"2024-09-11T14:49:11.389515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":139592243,"num_objects":2125,"num_object_clones":0,"num_object_copies":6375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2202,"num_write_kb":136852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2176,"ondisk_log_size":2176,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":808676,"kb_used_data":808676,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208382236,"statfs":{"total":214211493888,"available":213383409664,"internally_reserved":0,"allocated":828084224,"data_stored":828084224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51707904,"num_objects":789,"num_object_clones":0,"num_object_copies":2367,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":50496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.465124"},"pg_stats":[{"pgid":"7.f","version":"84'140","reported_seq":164,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:09.461200+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:49:09.461200+0000","last_peered":"2024-09-11T14:49:09.461200+0000","last_clean":"2024-09-11T14:49:09.461200+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:49:09.461200+0000","last_undegraded":"2024-09-11T14:49:09.461200+0000","last_fullsized":"2024-09-11T14:49:09.461200+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"84'142","reported_seq":166,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:07.933057+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:49:07.933057+0000","last_peered":"2024-09-11T14:49:07.933057+0000","last_clean":"2024-09-11T14:49:07.933057+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:49:07.933057+0000","last_undegraded":"2024-09-11T14:49:07.933057+0000","last_fullsized":"2024-09-11T14:49:07.933057+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"84'143","reported_seq":167,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:08.114585+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:49:08.114585+0000","last_peered":"2024-09-11T14:49:08.114585+0000","last_clean":"2024-09-11T14:49:08.114585+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:49:08.114585+0000","last_undegraded":"2024-09-11T14:49:08.114585+0000","last_fullsized":"2024-09-11T14:49:08.114585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9371648,"num_objects":143,"num_object_clones":0,"num_object_copies":429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":9152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"84'122","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:08.301761+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:49:08.301761+0000","last_peered":"2024-09-11T14:49:08.301761+0000","last_clean":"2024-09-11T14:49:08.301761+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:49:08.301761+0000","last_undegraded":"2024-09-11T14:49:08.301761+0000","last_fullsized":"2024-09-11T14:49:08.301761+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"84'129","reported_seq":153,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:09.403640+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:49:09.403640+0000","last_peered":"2024-09-11T14:49:09.403640+0000","last_clean":"2024-09-11T14:49:09.403640+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:49:09.403640+0000","last_undegraded":"2024-09-11T14:49:09.403640+0000","last_fullsized":"2024-09-11T14:49:09.403640+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"84'132","reported_seq":156,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:08.720757+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:49:08.720757+0000","last_peered":"2024-09-11T14:49:08.720757+0000","last_clean":"2024-09-11T14:49:08.720757+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:49:08.720757+0000","last_undegraded":"2024-09-11T14:49:08.720757+0000","last_fullsized":"2024-09-11T14:49:08.720757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"84'113","reported_seq":137,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:08.327271+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:49:08.327271+0000","last_peered":"2024-09-11T14:49:08.327271+0000","last_clean":"2024-09-11T14:49:08.327271+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:49:08.327271+0000","last_undegraded":"2024-09-11T14:49:08.327271+0000","last_fullsized":"2024-09-11T14:49:08.327271+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"84'138","reported_seq":162,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:07.434952+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:49:07.434952+0000","last_peered":"2024-09-11T14:49:07.434952+0000","last_clean":"2024-09-11T14:49:07.434952+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:49:07.434952+0000","last_undegraded":"2024-09-11T14:49:07.434952+0000","last_fullsized":"2024-09-11T14:49:07.434952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"84'143","reported_seq":167,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:08.962133+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:49:08.962133+0000","last_peered":"2024-09-11T14:49:08.962133+0000","last_clean":"2024-09-11T14:49:08.962133+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:49:08.962133+0000","last_undegraded":"2024-09-11T14:49:08.962133+0000","last_fullsized":"2024-09-11T14:49:08.962133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9371648,"num_objects":143,"num_object_clones":0,"num_object_copies":429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":9152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.038142+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:49:00.038142+0000","last_peered":"2024-09-11T14:49:00.038142+0000","last_clean":"2024-09-11T14:49:00.038142+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:49:00.038142+0000","last_undegraded":"2024-09-11T14:49:00.038142+0000","last_fullsized":"2024-09-11T14:49:00.038142+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":221,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.140082+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:49:00.140082+0000","last_peered":"2024-09-11T14:49:00.140082+0000","last_clean":"2024-09-11T14:49:00.140082+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:49:00.140082+0000","last_undegraded":"2024-09-11T14:49:00.140082+0000","last_fullsized":"2024-09-11T14:49:00.140082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"84'123","reported_seq":147,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:08.096711+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:49:08.096711+0000","last_peered":"2024-09-11T14:49:08.096711+0000","last_clean":"2024-09-11T14:49:08.096711+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:49:08.096711+0000","last_undegraded":"2024-09-11T14:49:08.096711+0000","last_fullsized":"2024-09-11T14:49:08.096711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.999989+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:48:59.999989+0000","last_peered":"2024-09-11T14:48:59.999989+0000","last_clean":"2024-09-11T14:48:59.999989+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:48:59.999989+0000","last_undegraded":"2024-09-11T14:48:59.999989+0000","last_fullsized":"2024-09-11T14:48:59.999989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"84'118","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:07.792724+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:49:07.792724+0000","last_peered":"2024-09-11T14:49:07.792724+0000","last_clean":"2024-09-11T14:49:07.792724+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:49:07.792724+0000","last_undegraded":"2024-09-11T14:49:07.792724+0000","last_fullsized":"2024-09-11T14:49:07.792724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.132805+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:49:00.132805+0000","last_peered":"2024-09-11T14:49:00.132805+0000","last_clean":"2024-09-11T14:49:00.132805+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:49:00.132805+0000","last_undegraded":"2024-09-11T14:49:00.132805+0000","last_fullsized":"2024-09-11T14:49:00.132805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"84'119","reported_seq":143,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:08.085600+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:49:08.085600+0000","last_peered":"2024-09-11T14:49:08.085600+0000","last_clean":"2024-09-11T14:49:08.085600+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:49:08.085600+0000","last_undegraded":"2024-09-11T14:49:08.085600+0000","last_fullsized":"2024-09-11T14:49:08.085600+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.994613+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:48:59.994613+0000","last_peered":"2024-09-11T14:48:59.994613+0000","last_clean":"2024-09-11T14:48:59.994613+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:48:59.994613+0000","last_undegraded":"2024-09-11T14:48:59.994613+0000","last_fullsized":"2024-09-11T14:48:59.994613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"84'126","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:08.292644+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:49:08.292644+0000","last_peered":"2024-09-11T14:49:08.292644+0000","last_clean":"2024-09-11T14:49:08.292644+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:49:08.292644+0000","last_undegraded":"2024-09-11T14:49:08.292644+0000","last_fullsized":"2024-09-11T14:49:08.292644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.362042+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:49:00.362042+0000","last_peered":"2024-09-11T14:49:00.362042+0000","last_clean":"2024-09-11T14:49:00.362042+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:49:00.362042+0000","last_undegraded":"2024-09-11T14:49:00.362042+0000","last_fullsized":"2024-09-11T14:49:00.362042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"84'149","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:08.077407+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:49:08.077407+0000","last_peered":"2024-09-11T14:49:08.077407+0000","last_clean":"2024-09-11T14:49:08.077407+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:49:08.077407+0000","last_undegraded":"2024-09-11T14:49:08.077407+0000","last_fullsized":"2024-09-11T14:49:08.077407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":9536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.049486+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.049486+0000","last_peered":"2024-09-11T14:49:00.049486+0000","last_clean":"2024-09-11T14:49:00.049486+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:49:00.049486+0000","last_undegraded":"2024-09-11T14:49:00.049486+0000","last_fullsized":"2024-09-11T14:49:00.049486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"84'155","reported_seq":179,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:09.433805+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:49:09.433805+0000","last_peered":"2024-09-11T14:49:09.433805+0000","last_clean":"2024-09-11T14:49:09.433805+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:49:09.433805+0000","last_undegraded":"2024-09-11T14:49:09.433805+0000","last_fullsized":"2024-09-11T14:49:09.433805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":9920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.363620+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.363620+0000","last_peered":"2024-09-11T14:49:00.363620+0000","last_clean":"2024-09-11T14:49:00.363620+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:49:00.363620+0000","last_undegraded":"2024-09-11T14:49:00.363620+0000","last_fullsized":"2024-09-11T14:49:00.363620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"84'129","reported_seq":153,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:08.943291+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:49:08.943291+0000","last_peered":"2024-09-11T14:49:08.943291+0000","last_clean":"2024-09-11T14:49:08.943291+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:49:08.943291+0000","last_undegraded":"2024-09-11T14:49:08.943291+0000","last_fullsized":"2024-09-11T14:49:08.943291+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.145019+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:49:00.145019+0000","last_peered":"2024-09-11T14:49:00.145019+0000","last_clean":"2024-09-11T14:49:00.145019+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:49:00.145019+0000","last_undegraded":"2024-09-11T14:49:00.145019+0000","last_fullsized":"2024-09-11T14:49:00.145019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":139001856,"num_objects":2121,"num_object_clones":0,"num_object_copies":6363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2121,"num_write_kb":135744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213367304192,"internally_reserved":0,"allocated":844189696,"data_stored":844189696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2121,"ondisk_log_size":2121,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213367304192,"internally_reserved":0,"allocated":844189696,"data_stored":844189696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53285314560,"internally_reserved":0,"allocated":267558912,"data_stored":267558912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673744,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":257800,"kb_used_data":257800,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52039928,"statfs":{"total":53552873472,"available":53288886272,"internally_reserved":0,"allocated":263987200,"data_stored":263987200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":149480,"kb_used_data":149480,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52148248,"statfs":{"total":53552873472,"available":53399805952,"internally_reserved":0,"allocated":153067520,"data_stored":153067520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":183916,"kb_used_data":183916,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52113812,"statfs":{"total":53552873472,"available":53364543488,"internally_reserved":0,"allocated":188329984,"data_stored":188329984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706448,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":217480,"kb_used_data":217480,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52080248,"statfs":{"total":53552873472,"available":53330173952,"internally_reserved":0,"allocated":222699520,"data_stored":222699520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53285314560,"internally_reserved":0,"allocated":267558912,"data_stored":267558912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53359652864,"internally_reserved":0,"allocated":193220608,"data_stored":193220608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53327912960,"internally_reserved":0,"allocated":224960512,"data_stored":224960512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53394554880,"internally_reserved":0,"allocated":158318592,"data_stored":158318592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53285183488,"internally_reserved":0,"allocated":267689984,"data_stored":267689984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53359652864,"internally_reserved":0,"allocated":193220608,"data_stored":193220608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53327912960,"internally_reserved":0,"allocated":224960512,"data_stored":224960512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53394554880,"internally_reserved":0,"allocated":158318592,"data_stored":158318592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53285183488,"internally_reserved":0,"allocated":267689984,"data_stored":267689984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:49:13.046 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 32 16 2402 2386 4.65972 3.25 0.142302 0.213093 2024-09-11T14:49:13.305 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:49:13.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:13.450+0000 7f8dfe2fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:13.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:13.458+0000 7f8dfe2fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:14.046 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 33 16 2473 2457 4.65298 4.4375 0.0674339 0.213499 2024-09-11T14:49:15.046 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 34 16 2531 2515 4.62273 3.625 0.0762921 0.214409 2024-09-11T14:49:15.841 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:49:15.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:15.965+0000 7fd654711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:15.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:15.971+0000 7fd654711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:16.046 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 35 16 2586 2570 4.58885 3.4375 0.14005 0.215775 2024-09-11T14:49:17.046 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 36 16 2644 2628 4.56207 3.625 0.0395259 0.217672 2024-09-11T14:49:17.539 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:49:17.539 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:49:17.539 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:49:17.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:17.676+0000 7f200749c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:17.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:17.685+0000 7f200749c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:18.039 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:49:18.039 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:49:18.046 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 37 16 2707 2691 4.54518 3.9375 0.396432 0.219005 2024-09-11T14:49:18.055 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":474,"stamp":"2024-09-11T14:49:17.391034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":161481267,"num_objects":2459,"num_object_clones":0,"num_object_copies":7377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2536,"num_write_kb":158228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2510,"ondisk_log_size":2510,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":942164,"kb_used_data":942164,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208248748,"statfs":{"total":214211493888,"available":213246717952,"internally_reserved":0,"allocated":964775936,"data_stored":964775936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":47382528,"num_objects":723,"num_object_clones":0,"num_object_copies":2169,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":723,"num_write_kb":46272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002834"},"pg_stats":[{"pgid":"7.f","version":"84'163","reported_seq":187,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:13.668439+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:49:13.668439+0000","last_peered":"2024-09-11T14:49:13.668439+0000","last_clean":"2024-09-11T14:49:13.668439+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:49:13.668439+0000","last_undegraded":"2024-09-11T14:49:13.668439+0000","last_fullsized":"2024-09-11T14:49:13.668439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":10432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"84'159","reported_seq":183,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:12.091083+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:49:12.091083+0000","last_peered":"2024-09-11T14:49:12.091083+0000","last_clean":"2024-09-11T14:49:12.091083+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:49:12.091083+0000","last_undegraded":"2024-09-11T14:49:12.091083+0000","last_fullsized":"2024-09-11T14:49:12.091083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":10176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"84'164","reported_seq":188,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:13.409548+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:49:13.409548+0000","last_peered":"2024-09-11T14:49:13.409548+0000","last_clean":"2024-09-11T14:49:13.409548+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:49:13.409548+0000","last_undegraded":"2024-09-11T14:49:13.409548+0000","last_fullsized":"2024-09-11T14:49:13.409548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747904,"num_objects":164,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":10496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"84'143","reported_seq":167,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:12.506070+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:49:12.506070+0000","last_peered":"2024-09-11T14:49:12.506070+0000","last_clean":"2024-09-11T14:49:12.506070+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:49:12.506070+0000","last_undegraded":"2024-09-11T14:49:12.506070+0000","last_fullsized":"2024-09-11T14:49:12.506070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9371648,"num_objects":143,"num_object_clones":0,"num_object_copies":429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":9152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"84'148","reported_seq":172,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:14.385111+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:49:14.385111+0000","last_peered":"2024-09-11T14:49:14.385111+0000","last_clean":"2024-09-11T14:49:14.385111+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:49:14.385111+0000","last_undegraded":"2024-09-11T14:49:14.385111+0000","last_fullsized":"2024-09-11T14:49:14.385111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699328,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":9472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"84'152","reported_seq":176,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:14.201008+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:49:14.201008+0000","last_peered":"2024-09-11T14:49:14.201008+0000","last_clean":"2024-09-11T14:49:14.201008+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:49:14.201008+0000","last_undegraded":"2024-09-11T14:49:14.201008+0000","last_fullsized":"2024-09-11T14:49:14.201008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":9728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"84'138","reported_seq":162,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:12.947681+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:49:12.947681+0000","last_peered":"2024-09-11T14:49:12.947681+0000","last_clean":"2024-09-11T14:49:12.947681+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:49:12.947681+0000","last_undegraded":"2024-09-11T14:49:12.947681+0000","last_fullsized":"2024-09-11T14:49:12.947681+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"84'154","reported_seq":178,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:11.986743+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:49:11.986743+0000","last_peered":"2024-09-11T14:49:11.986743+0000","last_clean":"2024-09-11T14:49:11.986743+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:49:11.986743+0000","last_undegraded":"2024-09-11T14:49:11.986743+0000","last_fullsized":"2024-09-11T14:49:11.986743+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":9856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"84'164","reported_seq":188,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:14.125281+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:49:14.125281+0000","last_peered":"2024-09-11T14:49:14.125281+0000","last_clean":"2024-09-11T14:49:14.125281+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:49:14.125281+0000","last_undegraded":"2024-09-11T14:49:14.125281+0000","last_fullsized":"2024-09-11T14:49:14.125281+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747904,"num_objects":164,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":10496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.038142+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:49:00.038142+0000","last_peered":"2024-09-11T14:49:00.038142+0000","last_clean":"2024-09-11T14:49:00.038142+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:49:00.038142+0000","last_undegraded":"2024-09-11T14:49:00.038142+0000","last_fullsized":"2024-09-11T14:49:00.038142+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":221,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.140082+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:49:00.140082+0000","last_peered":"2024-09-11T14:49:00.140082+0000","last_clean":"2024-09-11T14:49:00.140082+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:49:00.140082+0000","last_undegraded":"2024-09-11T14:49:00.140082+0000","last_fullsized":"2024-09-11T14:49:00.140082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"84'145","reported_seq":169,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:13.232506+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:49:13.232506+0000","last_peered":"2024-09-11T14:49:13.232506+0000","last_clean":"2024-09-11T14:49:13.232506+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:49:13.232506+0000","last_undegraded":"2024-09-11T14:49:13.232506+0000","last_fullsized":"2024-09-11T14:49:13.232506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502720,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":9280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.999989+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:48:59.999989+0000","last_peered":"2024-09-11T14:48:59.999989+0000","last_clean":"2024-09-11T14:48:59.999989+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:48:59.999989+0000","last_undegraded":"2024-09-11T14:48:59.999989+0000","last_fullsized":"2024-09-11T14:48:59.999989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"84'141","reported_seq":165,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:12.755864+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:49:12.755864+0000","last_peered":"2024-09-11T14:49:12.755864+0000","last_clean":"2024-09-11T14:49:12.755864+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:49:12.755864+0000","last_undegraded":"2024-09-11T14:49:12.755864+0000","last_fullsized":"2024-09-11T14:49:12.755864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9240576,"num_objects":141,"num_object_clones":0,"num_object_copies":423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":9024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.132805+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:49:00.132805+0000","last_peered":"2024-09-11T14:49:00.132805+0000","last_clean":"2024-09-11T14:49:00.132805+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:49:00.132805+0000","last_undegraded":"2024-09-11T14:49:00.132805+0000","last_fullsized":"2024-09-11T14:49:00.132805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"84'132","reported_seq":156,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:11.560030+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:49:11.560030+0000","last_peered":"2024-09-11T14:49:11.560030+0000","last_clean":"2024-09-11T14:49:11.560030+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:49:11.560030+0000","last_undegraded":"2024-09-11T14:49:11.560030+0000","last_fullsized":"2024-09-11T14:49:11.560030+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.994613+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:48:59.994613+0000","last_peered":"2024-09-11T14:48:59.994613+0000","last_clean":"2024-09-11T14:48:59.994613+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:48:59.994613+0000","last_undegraded":"2024-09-11T14:48:59.994613+0000","last_fullsized":"2024-09-11T14:48:59.994613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"84'154","reported_seq":178,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:13.176627+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:49:13.176627+0000","last_peered":"2024-09-11T14:49:13.176627+0000","last_clean":"2024-09-11T14:49:13.176627+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:49:13.176627+0000","last_undegraded":"2024-09-11T14:49:13.176627+0000","last_fullsized":"2024-09-11T14:49:13.176627+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":9856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.362042+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:49:00.362042+0000","last_peered":"2024-09-11T14:49:00.362042+0000","last_clean":"2024-09-11T14:49:00.362042+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:49:00.362042+0000","last_undegraded":"2024-09-11T14:49:00.362042+0000","last_fullsized":"2024-09-11T14:49:00.362042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"84'171","reported_seq":195,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:12.381612+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:49:12.381612+0000","last_peered":"2024-09-11T14:49:12.381612+0000","last_clean":"2024-09-11T14:49:12.381612+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:49:12.381612+0000","last_undegraded":"2024-09-11T14:49:12.381612+0000","last_fullsized":"2024-09-11T14:49:12.381612+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":10944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.049486+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.049486+0000","last_peered":"2024-09-11T14:49:00.049486+0000","last_clean":"2024-09-11T14:49:00.049486+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:49:00.049486+0000","last_undegraded":"2024-09-11T14:49:00.049486+0000","last_fullsized":"2024-09-11T14:49:00.049486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"84'175","reported_seq":199,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:14.025280+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:49:14.025280+0000","last_peered":"2024-09-11T14:49:14.025280+0000","last_clean":"2024-09-11T14:49:14.025280+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:49:14.025280+0000","last_undegraded":"2024-09-11T14:49:14.025280+0000","last_fullsized":"2024-09-11T14:49:14.025280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":11200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.363620+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.363620+0000","last_peered":"2024-09-11T14:49:00.363620+0000","last_clean":"2024-09-11T14:49:00.363620+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:49:00.363620+0000","last_undegraded":"2024-09-11T14:49:00.363620+0000","last_fullsized":"2024-09-11T14:49:00.363620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"84'152","reported_seq":176,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:14.104002+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:49:14.104002+0000","last_peered":"2024-09-11T14:49:14.104002+0000","last_clean":"2024-09-11T14:49:14.104002+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:49:14.104002+0000","last_undegraded":"2024-09-11T14:49:14.104002+0000","last_fullsized":"2024-09-11T14:49:14.104002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":9728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.145019+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:49:00.145019+0000","last_peered":"2024-09-11T14:49:00.145019+0000","last_clean":"2024-09-11T14:49:00.145019+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:49:00.145019+0000","last_undegraded":"2024-09-11T14:49:00.145019+0000","last_fullsized":"2024-09-11T14:49:00.145019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":160890880,"num_objects":2455,"num_object_clones":0,"num_object_copies":7365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2455,"num_write_kb":157120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213233041408,"internally_reserved":0,"allocated":978452480,"data_stored":978452480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2455,"ondisk_log_size":2455,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213233041408,"internally_reserved":0,"allocated":978452480,"data_stored":978452480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53242404864,"internally_reserved":0,"allocated":310468608,"data_stored":310468608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673749,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":299988,"kb_used_data":299988,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51997740,"statfs":{"total":53552873472,"available":53245685760,"internally_reserved":0,"allocated":307187712,"data_stored":307187712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706452,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":176136,"kb_used_data":176136,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52121592,"statfs":{"total":53552873472,"available":53372510208,"internally_reserved":0,"allocated":180363264,"data_stored":180363264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706452,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":212920,"kb_used_data":212920,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52084808,"statfs":{"total":53552873472,"available":53334843392,"internally_reserved":0,"allocated":218030080,"data_stored":218030080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":253120,"kb_used_data":253120,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52044608,"statfs":{"total":53552873472,"available":53293678592,"internally_reserved":0,"allocated":259194880,"data_stored":259194880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53242404864,"internally_reserved":0,"allocated":310468608,"data_stored":310468608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53329584128,"internally_reserved":0,"allocated":223289344,"data_stored":223289344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53291835392,"internally_reserved":0,"allocated":261038080,"data_stored":261038080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53369217024,"internally_reserved":0,"allocated":183656448,"data_stored":183656448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53242404864,"internally_reserved":0,"allocated":310468608,"data_stored":310468608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53329584128,"internally_reserved":0,"allocated":223289344,"data_stored":223289344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53291835392,"internally_reserved":0,"allocated":261038080,"data_stored":261038080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53369217024,"internally_reserved":0,"allocated":183656448,"data_stored":183656448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53242404864,"internally_reserved":0,"allocated":310468608,"data_stored":310468608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:49:18.365 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:49:18.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:18.498+0000 7f55984c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:18.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:18.506+0000 7f55984c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:19.047 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 38 16 2768 2752 4.52589 3.8125 0.150899 0.219768 2024-09-11T14:49:20.047 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 39 16 2831 2815 4.5108 3.9375 0.614513 0.220305 2024-09-11T14:49:20.854 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:49:20.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:20.984+0000 7f8a80d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:20.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:20.990+0000 7f8a80d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:21.047 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:49:21.046978+0000 min lat: 0.0273213 max lat: 1.17626 avg lat: 0.221711 2024-09-11T14:49:21.047 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:49:21.047 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 40 16 2891 2875 4.49177 3.75 0.251642 0.221711 2024-09-11T14:49:22.047 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 41 16 2951 2935 4.47366 3.75 0.0606233 0.22192 2024-09-11T14:49:23.047 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 42 16 3022 3006 4.47279 4.4375 0.201356 0.222801 2024-09-11T14:49:23.058 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:49:23.058 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:49:23.058 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:49:23.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:23.185+0000 7f9332d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:23.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:23.194+0000 7f9332d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:23.406 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:49:23.532 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:49:23.533 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:49:23.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:23.538+0000 7f8aa68f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:23.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:23.547+0000 7f8aa68f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:23.554 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":477,"stamp":"2024-09-11T14:49:23.392292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":181404211,"num_objects":2763,"num_object_clones":0,"num_object_copies":8289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2840,"num_write_kb":177684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2814,"ondisk_log_size":2814,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1056428,"kb_used_data":1056428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208134484,"statfs":{"total":214211493888,"available":213129711616,"internally_reserved":0,"allocated":1081782272,"data_stored":1081782272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":41811968,"num_objects":638,"num_object_clones":0,"num_object_copies":1914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":638,"num_write_kb":40832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002777"},"pg_stats":[{"pgid":"7.f","version":"84'181","reported_seq":205,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:19.067013+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:49:19.067013+0000","last_peered":"2024-09-11T14:49:19.067013+0000","last_clean":"2024-09-11T14:49:19.067013+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:49:19.067013+0000","last_undegraded":"2024-09-11T14:49:19.067013+0000","last_fullsized":"2024-09-11T14:49:19.067013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11862016,"num_objects":181,"num_object_clones":0,"num_object_copies":543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":11584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"84'181","reported_seq":205,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:18.133072+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:49:18.133072+0000","last_peered":"2024-09-11T14:49:18.133072+0000","last_clean":"2024-09-11T14:49:18.133072+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:49:18.133072+0000","last_undegraded":"2024-09-11T14:49:18.133072+0000","last_fullsized":"2024-09-11T14:49:18.133072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11862016,"num_objects":181,"num_object_clones":0,"num_object_copies":543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":11584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"84'181","reported_seq":205,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:18.309727+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:49:18.309727+0000","last_peered":"2024-09-11T14:49:18.309727+0000","last_clean":"2024-09-11T14:49:18.309727+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:49:18.309727+0000","last_undegraded":"2024-09-11T14:49:18.309727+0000","last_fullsized":"2024-09-11T14:49:18.309727+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11862016,"num_objects":181,"num_object_clones":0,"num_object_copies":543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":11584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"84'161","reported_seq":185,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:18.316893+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:49:18.316893+0000","last_peered":"2024-09-11T14:49:18.316893+0000","last_clean":"2024-09-11T14:49:18.316893+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:49:18.316893+0000","last_undegraded":"2024-09-11T14:49:18.316893+0000","last_fullsized":"2024-09-11T14:49:18.316893+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"84'168","reported_seq":192,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:19.369888+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:49:19.369888+0000","last_peered":"2024-09-11T14:49:19.369888+0000","last_clean":"2024-09-11T14:49:19.369888+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:49:19.369888+0000","last_undegraded":"2024-09-11T14:49:19.369888+0000","last_fullsized":"2024-09-11T14:49:19.369888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11010048,"num_objects":168,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":10752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"84'165","reported_seq":189,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:19.361169+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:49:19.361169+0000","last_peered":"2024-09-11T14:49:19.361169+0000","last_clean":"2024-09-11T14:49:19.361169+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:49:19.361169+0000","last_undegraded":"2024-09-11T14:49:19.361169+0000","last_fullsized":"2024-09-11T14:49:19.361169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":10560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"84'167","reported_seq":191,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:18.128017+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:49:18.128017+0000","last_peered":"2024-09-11T14:49:18.128017+0000","last_clean":"2024-09-11T14:49:18.128017+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:49:18.128017+0000","last_undegraded":"2024-09-11T14:49:18.128017+0000","last_fullsized":"2024-09-11T14:49:18.128017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10944512,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":10688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"84'172","reported_seq":196,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:17.862160+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:49:17.862160+0000","last_peered":"2024-09-11T14:49:17.862160+0000","last_clean":"2024-09-11T14:49:17.862160+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:49:17.862160+0000","last_undegraded":"2024-09-11T14:49:17.862160+0000","last_fullsized":"2024-09-11T14:49:17.862160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":11008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"84'184","reported_seq":208,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:19.189225+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:49:19.189225+0000","last_peered":"2024-09-11T14:49:19.189225+0000","last_clean":"2024-09-11T14:49:19.189225+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:49:19.189225+0000","last_undegraded":"2024-09-11T14:49:19.189225+0000","last_fullsized":"2024-09-11T14:49:19.189225+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12058624,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":11776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.038142+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:49:00.038142+0000","last_peered":"2024-09-11T14:49:00.038142+0000","last_clean":"2024-09-11T14:49:00.038142+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:49:00.038142+0000","last_undegraded":"2024-09-11T14:49:00.038142+0000","last_fullsized":"2024-09-11T14:49:00.038142+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":221,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.140082+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:49:00.140082+0000","last_peered":"2024-09-11T14:49:00.140082+0000","last_clean":"2024-09-11T14:49:00.140082+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:49:00.140082+0000","last_undegraded":"2024-09-11T14:49:00.140082+0000","last_fullsized":"2024-09-11T14:49:00.140082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"84'162","reported_seq":186,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:18.173852+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:49:18.173852+0000","last_peered":"2024-09-11T14:49:18.173852+0000","last_clean":"2024-09-11T14:49:18.173852+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:49:18.173852+0000","last_undegraded":"2024-09-11T14:49:18.173852+0000","last_fullsized":"2024-09-11T14:49:18.173852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10616832,"num_objects":162,"num_object_clones":0,"num_object_copies":486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":10368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.999989+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:48:59.999989+0000","last_peered":"2024-09-11T14:48:59.999989+0000","last_clean":"2024-09-11T14:48:59.999989+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:48:59.999989+0000","last_undegraded":"2024-09-11T14:48:59.999989+0000","last_fullsized":"2024-09-11T14:48:59.999989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"84'166","reported_seq":190,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:18.169486+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:49:18.169486+0000","last_peered":"2024-09-11T14:49:18.169486+0000","last_clean":"2024-09-11T14:49:18.169486+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:49:18.169486+0000","last_undegraded":"2024-09-11T14:49:18.169486+0000","last_fullsized":"2024-09-11T14:49:18.169486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":10624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.132805+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:49:00.132805+0000","last_peered":"2024-09-11T14:49:00.132805+0000","last_clean":"2024-09-11T14:49:00.132805+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:49:00.132805+0000","last_undegraded":"2024-09-11T14:49:00.132805+0000","last_fullsized":"2024-09-11T14:49:00.132805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"84'149","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:17.690250+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:49:17.690250+0000","last_peered":"2024-09-11T14:49:17.690250+0000","last_clean":"2024-09-11T14:49:17.690250+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:49:17.690250+0000","last_undegraded":"2024-09-11T14:49:17.690250+0000","last_fullsized":"2024-09-11T14:49:17.690250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":9536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.994613+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:48:59.994613+0000","last_peered":"2024-09-11T14:48:59.994613+0000","last_clean":"2024-09-11T14:48:59.994613+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:48:59.994613+0000","last_undegraded":"2024-09-11T14:48:59.994613+0000","last_fullsized":"2024-09-11T14:48:59.994613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"84'168","reported_seq":192,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:17.767122+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:49:17.767122+0000","last_peered":"2024-09-11T14:49:17.767122+0000","last_clean":"2024-09-11T14:49:17.767122+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:49:17.767122+0000","last_undegraded":"2024-09-11T14:49:17.767122+0000","last_fullsized":"2024-09-11T14:49:17.767122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11010048,"num_objects":168,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":10752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.362042+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:49:00.362042+0000","last_peered":"2024-09-11T14:49:00.362042+0000","last_clean":"2024-09-11T14:49:00.362042+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:49:00.362042+0000","last_undegraded":"2024-09-11T14:49:00.362042+0000","last_fullsized":"2024-09-11T14:49:00.362042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"84'198","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:18.278932+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:49:18.278932+0000","last_peered":"2024-09-11T14:49:18.278932+0000","last_clean":"2024-09-11T14:49:18.278932+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:49:18.278932+0000","last_undegraded":"2024-09-11T14:49:18.278932+0000","last_fullsized":"2024-09-11T14:49:18.278932+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12976128,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.049486+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.049486+0000","last_peered":"2024-09-11T14:49:00.049486+0000","last_clean":"2024-09-11T14:49:00.049486+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:49:00.049486+0000","last_undegraded":"2024-09-11T14:49:00.049486+0000","last_fullsized":"2024-09-11T14:49:00.049486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"84'191","reported_seq":215,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:18.916526+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:49:18.916526+0000","last_peered":"2024-09-11T14:49:18.916526+0000","last_clean":"2024-09-11T14:49:18.916526+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:49:18.916526+0000","last_undegraded":"2024-09-11T14:49:18.916526+0000","last_fullsized":"2024-09-11T14:49:18.916526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12517376,"num_objects":191,"num_object_clones":0,"num_object_copies":573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":12224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.363620+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.363620+0000","last_peered":"2024-09-11T14:49:00.363620+0000","last_clean":"2024-09-11T14:49:00.363620+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:49:00.363620+0000","last_undegraded":"2024-09-11T14:49:00.363620+0000","last_fullsized":"2024-09-11T14:49:00.363620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"84'165","reported_seq":189,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:19.444780+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:49:19.444780+0000","last_peered":"2024-09-11T14:49:19.444780+0000","last_clean":"2024-09-11T14:49:19.444780+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:49:19.444780+0000","last_undegraded":"2024-09-11T14:49:19.444780+0000","last_fullsized":"2024-09-11T14:49:19.444780+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":10560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.145019+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:49:00.145019+0000","last_peered":"2024-09-11T14:49:00.145019+0000","last_clean":"2024-09-11T14:49:00.145019+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:49:00.145019+0000","last_undegraded":"2024-09-11T14:49:00.145019+0000","last_fullsized":"2024-09-11T14:49:00.145019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":180813824,"num_objects":2759,"num_object_clones":0,"num_object_copies":8277,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2759,"num_write_kb":176576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213113942016,"internally_reserved":0,"allocated":1097551872,"data_stored":1097551872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2759,"ondisk_log_size":2759,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213113942016,"internally_reserved":0,"allocated":1097551872,"data_stored":1097551872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53206548480,"internally_reserved":0,"allocated":346324992,"data_stored":346324992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673754,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":334856,"kb_used_data":334856,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51962872,"statfs":{"total":53552873472,"available":53209980928,"internally_reserved":0,"allocated":342892544,"data_stored":342892544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":198788,"kb_used_data":198788,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52098940,"statfs":{"total":53552873472,"available":53349314560,"internally_reserved":0,"allocated":203558912,"data_stored":203558912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":237920,"kb_used_data":237920,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52059808,"statfs":{"total":53552873472,"available":53309243392,"internally_reserved":0,"allocated":243630080,"data_stored":243630080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":284864,"kb_used_data":284864,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52012864,"statfs":{"total":53552873472,"available":53261172736,"internally_reserved":0,"allocated":291700736,"data_stored":291700736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53206548480,"internally_reserved":0,"allocated":346324992,"data_stored":346324992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53303734272,"internally_reserved":0,"allocated":249139200,"data_stored":249139200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53258801152,"internally_reserved":0,"allocated":294072320,"data_stored":294072320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53344858112,"internally_reserved":0,"allocated":208015360,"data_stored":208015360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53206548480,"internally_reserved":0,"allocated":346324992,"data_stored":346324992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53303734272,"internally_reserved":0,"allocated":249139200,"data_stored":249139200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53258801152,"internally_reserved":0,"allocated":294072320,"data_stored":294072320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53344858112,"internally_reserved":0,"allocated":208015360,"data_stored":208015360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53206548480,"internally_reserved":0,"allocated":346324992,"data_stored":346324992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:49:24.047 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 43 16 3085 3069 4.46034 3.9375 0.131607 0.222577 2024-09-11T14:49:25.047 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 44 16 3148 3132 4.44845 3.9375 0.15341 0.223912 2024-09-11T14:49:25.834 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:49:25.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:25.973+0000 7fd42df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:25.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:25.980+0000 7fd42df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:26.047 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 45 16 3227 3211 4.4593 4.9375 0.168085 0.223688 2024-09-11T14:49:27.048 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 46 16 3300 3284 4.46154 4.5625 0.244955 0.223509 2024-09-11T14:49:28.048 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 47 16 3383 3367 4.47697 5.1875 0.126879 0.222716 2024-09-11T14:49:28.254 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:49:28.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:28.390+0000 7fea36191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:28.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:28.399+0000 7fea36191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:28.555 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:49:28.556 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:49:28.556 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:49:28.556 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:49:28.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:28.691+0000 7f35fd391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:28.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:28.705+0000 7f35fd391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:28.743 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:49:28.743 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:49:28.743 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:49:28.743 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:49:28.743 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:49:28.743 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:49:28.743 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:49:28.744 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:49:28.744 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:49:28.744 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:49:28.744 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:49:28.744 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:49:28.746 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:49:28.746 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:49:28.746 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:49:28.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:28.860+0000 7f104a423640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:28.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:28.870+0000 7f104a423640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:29.016 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:49:29.016 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:49:29.016 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:49:29.016 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:49:29.017 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:49:29.017 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:49:29.017 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:49:29.017 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:49:29.017 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:49:29.017 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:49:29.017 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:49:29.017 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:49:29.019 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:49:29.020 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:49:29.020 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:49:29.048 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 48 16 3445 3429 4.46442 3.875 0.342856 0.223238 2024-09-11T14:49:29.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:29.142+0000 7fd0b4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:29.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:29.154+0000 7fd0b4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:29.185 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:49:29.185 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:49:29.185 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:49:29.185 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:49:29.185 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:49:29.186 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:49:29.186 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:49:29.186 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:49:29.186 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:49:29.186 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:49:29.186 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:49:29.186 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:49:29.190 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:49:29.191 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:49:29.191 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:49:29.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:29.400+0000 7fb265791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:29.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:29.412+0000 7fb265791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:29.457 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:49:29.457 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:49:29.457 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:49:29.457 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:49:29.457 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:49:29.458 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:49:29.458 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:49:29.458 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:49:29.458 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:49:29.458 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:49:29.458 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:49:29.458 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:49:29.461 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:49:29.461 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:49:30.048 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 49 16 3510 3494 4.45621 4.0625 0.121179 0.223492 2024-09-11T14:49:30.937 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:49:31.048 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 50 16 3577 3561 4.45083 4.1875 0.476802 0.224087 2024-09-11T14:49:31.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:31.092+0000 7fd7f7d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:31.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:31.099+0000 7fd7f7d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:32.048 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 51 16 3651 3635 4.45423 4.625 0.125257 0.22389 2024-09-11T14:49:33.048 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 52 16 3727 3711 4.45991 4.75 0.288751 0.223619 2024-09-11T14:49:33.347 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:49:33.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:33.503+0000 7f38af6e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:33.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:33.511+0000 7f38af6e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:34.048 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 53 16 3795 3779 4.45595 4.25 0.175042 0.223742 2024-09-11T14:49:34.464 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:49:34.465 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:49:34.465 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:49:34.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:34.599+0000 7f48e4308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:34.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:34.609+0000 7f48e4308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:34.938 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:49:34.938 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:49:34.954 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":482,"stamp":"2024-09-11T14:49:33.394481+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":225968691,"num_objects":3443,"num_object_clones":0,"num_object_copies":10329,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3520,"num_write_kb":221204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3494,"ondisk_log_size":3494,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1316572,"kb_used_data":1316572,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207874340,"statfs":{"total":214211493888,"available":212863324160,"internally_reserved":0,"allocated":1348169728,"data_stored":1348169728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":44564480,"num_objects":680,"num_object_clones":0,"num_object_copies":2040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":43520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002673"},"pg_stats":[{"pgid":"7.f","version":"84'222","reported_seq":246,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:28.965626+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:49:28.965626+0000","last_peered":"2024-09-11T14:49:28.965626+0000","last_clean":"2024-09-11T14:49:28.965626+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:49:28.965626+0000","last_undegraded":"2024-09-11T14:49:28.965626+0000","last_fullsized":"2024-09-11T14:49:28.965626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14548992,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":14208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"84'227","reported_seq":251,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:28.272223+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:49:28.272223+0000","last_peered":"2024-09-11T14:49:28.272223+0000","last_clean":"2024-09-11T14:49:28.272223+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:49:28.272223+0000","last_undegraded":"2024-09-11T14:49:28.272223+0000","last_fullsized":"2024-09-11T14:49:28.272223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14876672,"num_objects":227,"num_object_clones":0,"num_object_copies":681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":14528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"84'214","reported_seq":238,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:27.679986+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:49:27.679986+0000","last_peered":"2024-09-11T14:49:27.679986+0000","last_clean":"2024-09-11T14:49:27.679986+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:49:27.679986+0000","last_undegraded":"2024-09-11T14:49:27.679986+0000","last_fullsized":"2024-09-11T14:49:27.679986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"84'210","reported_seq":234,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:27.822823+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:49:27.822823+0000","last_peered":"2024-09-11T14:49:27.822823+0000","last_clean":"2024-09-11T14:49:27.822823+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:49:27.822823+0000","last_undegraded":"2024-09-11T14:49:27.822823+0000","last_fullsized":"2024-09-11T14:49:27.822823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13762560,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":13440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"84'215","reported_seq":239,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:29.477289+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:49:29.477289+0000","last_peered":"2024-09-11T14:49:29.477289+0000","last_clean":"2024-09-11T14:49:29.477289+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:49:29.477289+0000","last_undegraded":"2024-09-11T14:49:29.477289+0000","last_fullsized":"2024-09-11T14:49:29.477289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14090240,"num_objects":215,"num_object_clones":0,"num_object_copies":645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":13760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"84'203","reported_seq":227,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:29.213749+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:49:29.213749+0000","last_peered":"2024-09-11T14:49:29.213749+0000","last_clean":"2024-09-11T14:49:29.213749+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:49:29.213749+0000","last_undegraded":"2024-09-11T14:49:29.213749+0000","last_fullsized":"2024-09-11T14:49:29.213749+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"84'208","reported_seq":232,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:28.052082+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:49:28.052082+0000","last_peered":"2024-09-11T14:49:28.052082+0000","last_clean":"2024-09-11T14:49:28.052082+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:49:28.052082+0000","last_undegraded":"2024-09-11T14:49:28.052082+0000","last_fullsized":"2024-09-11T14:49:28.052082+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":208,"num_object_clones":0,"num_object_copies":624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"84'220","reported_seq":244,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:28.325507+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:49:28.325507+0000","last_peered":"2024-09-11T14:49:28.325507+0000","last_clean":"2024-09-11T14:49:28.325507+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:49:28.325507+0000","last_undegraded":"2024-09-11T14:49:28.325507+0000","last_fullsized":"2024-09-11T14:49:28.325507+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14417920,"num_objects":220,"num_object_clones":0,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":14080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"84'223","reported_seq":247,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:29.425403+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:49:29.425403+0000","last_peered":"2024-09-11T14:49:29.425403+0000","last_clean":"2024-09-11T14:49:29.425403+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:49:29.425403+0000","last_undegraded":"2024-09-11T14:49:29.425403+0000","last_fullsized":"2024-09-11T14:49:29.425403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14614528,"num_objects":223,"num_object_clones":0,"num_object_copies":669,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":14272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.038142+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:49:00.038142+0000","last_peered":"2024-09-11T14:49:00.038142+0000","last_clean":"2024-09-11T14:49:00.038142+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:49:00.038142+0000","last_undegraded":"2024-09-11T14:49:00.038142+0000","last_fullsized":"2024-09-11T14:49:00.038142+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":221,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.140082+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:49:00.140082+0000","last_peered":"2024-09-11T14:49:00.140082+0000","last_clean":"2024-09-11T14:49:00.140082+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:49:00.140082+0000","last_undegraded":"2024-09-11T14:49:00.140082+0000","last_fullsized":"2024-09-11T14:49:00.140082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"84'212","reported_seq":236,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:28.101727+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:49:28.101727+0000","last_peered":"2024-09-11T14:49:28.101727+0000","last_clean":"2024-09-11T14:49:28.101727+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:49:28.101727+0000","last_undegraded":"2024-09-11T14:49:28.101727+0000","last_fullsized":"2024-09-11T14:49:28.101727+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13893632,"num_objects":212,"num_object_clones":0,"num_object_copies":636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":13568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.999989+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:48:59.999989+0000","last_peered":"2024-09-11T14:48:59.999989+0000","last_clean":"2024-09-11T14:48:59.999989+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:48:59.999989+0000","last_undegraded":"2024-09-11T14:48:59.999989+0000","last_fullsized":"2024-09-11T14:48:59.999989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"84'200","reported_seq":224,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:28.350488+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:49:28.350488+0000","last_peered":"2024-09-11T14:49:28.350488+0000","last_clean":"2024-09-11T14:49:28.350488+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:49:28.350488+0000","last_undegraded":"2024-09-11T14:49:28.350488+0000","last_fullsized":"2024-09-11T14:49:28.350488+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13107200,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":12800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.132805+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:49:00.132805+0000","last_peered":"2024-09-11T14:49:00.132805+0000","last_clean":"2024-09-11T14:49:00.132805+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:49:00.132805+0000","last_undegraded":"2024-09-11T14:49:00.132805+0000","last_fullsized":"2024-09-11T14:49:00.132805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"84'196","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:27.881583+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:49:27.881583+0000","last_peered":"2024-09-11T14:49:27.881583+0000","last_clean":"2024-09-11T14:49:27.881583+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:49:27.881583+0000","last_undegraded":"2024-09-11T14:49:27.881583+0000","last_fullsized":"2024-09-11T14:49:27.881583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12845056,"num_objects":196,"num_object_clones":0,"num_object_copies":588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":196,"num_write_kb":12544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.994613+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:48:59.994613+0000","last_peered":"2024-09-11T14:48:59.994613+0000","last_clean":"2024-09-11T14:48:59.994613+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:48:59.994613+0000","last_undegraded":"2024-09-11T14:48:59.994613+0000","last_fullsized":"2024-09-11T14:48:59.994613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"84'201","reported_seq":225,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:28.395165+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:49:28.395165+0000","last_peered":"2024-09-11T14:49:28.395165+0000","last_clean":"2024-09-11T14:49:28.395165+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:49:28.395165+0000","last_undegraded":"2024-09-11T14:49:28.395165+0000","last_fullsized":"2024-09-11T14:49:28.395165+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":201,"num_write_kb":12864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.362042+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:49:00.362042+0000","last_peered":"2024-09-11T14:49:00.362042+0000","last_clean":"2024-09-11T14:49:00.362042+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:49:00.362042+0000","last_undegraded":"2024-09-11T14:49:00.362042+0000","last_fullsized":"2024-09-11T14:49:00.362042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"84'242","reported_seq":266,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:28.136873+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:49:28.136873+0000","last_peered":"2024-09-11T14:49:28.136873+0000","last_clean":"2024-09-11T14:49:28.136873+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:49:28.136873+0000","last_undegraded":"2024-09-11T14:49:28.136873+0000","last_fullsized":"2024-09-11T14:49:28.136873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859712,"num_objects":242,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":15488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.049486+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.049486+0000","last_peered":"2024-09-11T14:49:00.049486+0000","last_clean":"2024-09-11T14:49:00.049486+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:49:00.049486+0000","last_undegraded":"2024-09-11T14:49:00.049486+0000","last_fullsized":"2024-09-11T14:49:00.049486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"84'241","reported_seq":265,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:29.217158+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:49:29.217158+0000","last_peered":"2024-09-11T14:49:29.217158+0000","last_clean":"2024-09-11T14:49:29.217158+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:49:29.217158+0000","last_undegraded":"2024-09-11T14:49:29.217158+0000","last_fullsized":"2024-09-11T14:49:29.217158+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15794176,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":15424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.363620+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.363620+0000","last_peered":"2024-09-11T14:49:00.363620+0000","last_clean":"2024-09-11T14:49:00.363620+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:49:00.363620+0000","last_undegraded":"2024-09-11T14:49:00.363620+0000","last_fullsized":"2024-09-11T14:49:00.363620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"84'205","reported_seq":229,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:28.824552+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:49:28.824552+0000","last_peered":"2024-09-11T14:49:28.824552+0000","last_clean":"2024-09-11T14:49:28.824552+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:49:28.824552+0000","last_undegraded":"2024-09-11T14:49:28.824552+0000","last_fullsized":"2024-09-11T14:49:28.824552+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13434880,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":13120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.145019+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:49:00.145019+0000","last_peered":"2024-09-11T14:49:00.145019+0000","last_clean":"2024-09-11T14:49:00.145019+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:49:00.145019+0000","last_undegraded":"2024-09-11T14:49:00.145019+0000","last_fullsized":"2024-09-11T14:49:00.145019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":225378304,"num_objects":3439,"num_object_clones":0,"num_object_copies":10317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3439,"num_write_kb":220096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212846239744,"internally_reserved":0,"allocated":1365254144,"data_stored":1365254144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3439,"ondisk_log_size":3439,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212846370816,"internally_reserved":0,"allocated":1365123072,"data_stored":1365123072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53122555904,"internally_reserved":0,"allocated":430317568,"data_stored":430317568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673764,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":416000,"kb_used_data":416000,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51881728,"statfs":{"total":53552873472,"available":53126889472,"internally_reserved":0,"allocated":425984000,"data_stored":425984000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":248616,"kb_used_data":248616,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52049112,"statfs":{"total":53552873472,"available":53298290688,"internally_reserved":0,"allocated":254582784,"data_stored":254582784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":295984,"kb_used_data":295984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52001744,"statfs":{"total":53552873472,"available":53249785856,"internally_reserved":0,"allocated":303087616,"data_stored":303087616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":355972,"kb_used_data":355972,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51941756,"statfs":{"total":53552873472,"available":53188358144,"internally_reserved":0,"allocated":364515328,"data_stored":364515328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53122555904,"internally_reserved":0,"allocated":430317568,"data_stored":430317568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53244002304,"internally_reserved":0,"allocated":308871168,"data_stored":308871168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53186396160,"internally_reserved":0,"allocated":366477312,"data_stored":366477312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53293547520,"internally_reserved":0,"allocated":259325952,"data_stored":259325952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53122424832,"internally_reserved":0,"allocated":430448640,"data_stored":430448640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53243871232,"internally_reserved":0,"allocated":309002240,"data_stored":309002240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53186396160,"internally_reserved":0,"allocated":366477312,"data_stored":366477312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53293547520,"internally_reserved":0,"allocated":259325952,"data_stored":259325952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53122424832,"internally_reserved":0,"allocated":430448640,"data_stored":430448640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:49:35.048 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 54 16 3855 3839 4.44287 3.75 0.187141 0.223992 2024-09-11T14:49:35.913 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:49:36.048 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 55 16 3913 3897 4.42799 3.625 0.0655411 0.225055 2024-09-11T14:49:36.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:36.062+0000 7f73872fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:36.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:36.072+0000 7f73872fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:37.049 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 56 16 3977 3961 4.42034 4 0.620655 0.225566 2024-09-11T14:49:38.049 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 57 16 4044 4028 4.41625 4.1875 0.0968963 0.225705 2024-09-11T14:49:38.363 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:49:38.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:38.483+0000 7fae53ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:38.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:38.491+0000 7fae53ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:39.049 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 58 16 4109 4093 4.41014 4.0625 0.151117 0.225674 2024-09-11T14:49:39.957 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:49:39.957 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:49:39.957 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:49:39.957 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:49:40.049 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 59 16 4170 4154 4.40001 3.8125 0.442227 0.226393 2024-09-11T14:49:40.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:40.081+0000 7fe0e8f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:40.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:40.091+0000 7fe0e8f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:40.123 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:49:40.123 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:49:40.123 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:49:40.123 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:49:40.123 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:49:40.123 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:49:40.124 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:49:40.124 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:49:40.124 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:49:40.124 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:49:40.124 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:49:40.124 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:49:40.127 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:49:40.128 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:49:40.128 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:49:40.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:40.264+0000 7f3c24f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:40.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:40.276+0000 7f3c24f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:40.301 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:49:40.301 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:49:40.301 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:49:40.301 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:49:40.301 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:49:40.301 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:49:40.301 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:49:40.301 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:49:40.301 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:49:40.302 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:49:40.302 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:49:40.302 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:49:40.303 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:49:40.304 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:49:40.304 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:49:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:40.451+0000 7fd459751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:40.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:40.465+0000 7fd459751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:40.490 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:49:40.490 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:49:40.491 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:49:40.491 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:49:40.491 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:49:40.491 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:49:40.491 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:49:40.491 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:49:40.491 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:49:40.491 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:49:40.491 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:49:40.491 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:49:40.493 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:49:40.494 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:49:40.494 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:49:40.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:40.644+0000 7f9a83ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:40.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:40.656+0000 7f9a83ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:40.680 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:49:40.680 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:49:40.680 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:49:40.681 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:49:40.681 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:49:40.681 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:49:40.681 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:49:40.681 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:49:40.681 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:49:40.681 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:49:40.681 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:49:40.681 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:49:40.684 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:49:40.684 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:49:40.864 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:49:41.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:41.000+0000 7fa7a9911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:41.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:41.007+0000 7fa7a9911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:41.049 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:49:41.048877+0000 min lat: 0.0273213 max lat: 1.44892 avg lat: 0.226795 2024-09-11T14:49:41.049 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:49:41.049 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 60 16 4235 4219 4.39438 4.0625 0.163076 0.226795 2024-09-11T14:49:42.049 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 61 16 4305 4289 4.39405 4.375 0.251216 0.226718 2024-09-11T14:49:43.049 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 62 16 4377 4361 4.39575 4.5 0.332793 0.226862 2024-09-11T14:49:43.191 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:49:43.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:43.304+0000 7f290ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:43.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:43.310+0000 7f290ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:44.049 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 63 16 4456 4440 4.40435 4.9375 0.432078 0.226676 2024-09-11T14:49:45.049 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 64 16 4543 4527 4.42048 5.4375 0.202342 0.225925 2024-09-11T14:49:45.560 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:49:45.685 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:49:45.685 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:49:45.685 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:49:45.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:45.707+0000 7f8f35f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:45.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:45.719+0000 7f8f35f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:45.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:45.860+0000 7fd681d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:45.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:45.871+0000 7fd681d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:46.049 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 65 16 4615 4599 4.4217 4.5 0.110523 0.225577 2024-09-11T14:49:46.138 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:49:46.139 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:49:46.160 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":488,"stamp":"2024-09-11T14:49:45.397161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":291045939,"num_objects":4436,"num_object_clones":0,"num_object_copies":13308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4513,"num_write_kb":284756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4487,"ondisk_log_size":4487,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1708664,"kb_used_data":1708664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207482248,"statfs":{"total":214211493888,"available":212461821952,"internally_reserved":0,"allocated":1749671936,"data_stored":1749671936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":65077248,"num_objects":993,"num_object_clones":0,"num_object_copies":2979,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":993,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002680"},"pg_stats":[{"pgid":"7.f","version":"84'288","reported_seq":312,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:44.015035+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:49:44.015035+0000","last_peered":"2024-09-11T14:49:44.015035+0000","last_clean":"2024-09-11T14:49:44.015035+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:49:44.015035+0000","last_undegraded":"2024-09-11T14:49:44.015035+0000","last_fullsized":"2024-09-11T14:49:44.015035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"84'289","reported_seq":313,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:43.356838+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:49:43.356838+0000","last_peered":"2024-09-11T14:49:43.356838+0000","last_clean":"2024-09-11T14:49:43.356838+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:49:43.356838+0000","last_undegraded":"2024-09-11T14:49:43.356838+0000","last_fullsized":"2024-09-11T14:49:43.356838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18939904,"num_objects":289,"num_object_clones":0,"num_object_copies":867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":18496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"84'273","reported_seq":297,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:43.047712+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:49:43.047712+0000","last_peered":"2024-09-11T14:49:43.047712+0000","last_clean":"2024-09-11T14:49:43.047712+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:49:43.047712+0000","last_undegraded":"2024-09-11T14:49:43.047712+0000","last_fullsized":"2024-09-11T14:49:43.047712+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17891328,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":17472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"84'268","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:43.073124+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:49:43.073124+0000","last_peered":"2024-09-11T14:49:43.073124+0000","last_clean":"2024-09-11T14:49:43.073124+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:49:43.073124+0000","last_undegraded":"2024-09-11T14:49:43.073124+0000","last_fullsized":"2024-09-11T14:49:43.073124+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":268,"num_write_kb":17152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"84'275","reported_seq":299,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:43.321496+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:49:43.321496+0000","last_peered":"2024-09-11T14:49:43.321496+0000","last_clean":"2024-09-11T14:49:43.321496+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:49:43.321496+0000","last_undegraded":"2024-09-11T14:49:43.321496+0000","last_fullsized":"2024-09-11T14:49:43.321496+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18022400,"num_objects":275,"num_object_clones":0,"num_object_copies":825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":17600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"84'261","reported_seq":285,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:43.526690+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:49:43.526690+0000","last_peered":"2024-09-11T14:49:43.526690+0000","last_clean":"2024-09-11T14:49:43.526690+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:49:43.526690+0000","last_undegraded":"2024-09-11T14:49:43.526690+0000","last_fullsized":"2024-09-11T14:49:43.526690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104896,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":16704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"84'273","reported_seq":297,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:43.177310+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:49:43.177310+0000","last_peered":"2024-09-11T14:49:43.177310+0000","last_clean":"2024-09-11T14:49:43.177310+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:49:43.177310+0000","last_undegraded":"2024-09-11T14:49:43.177310+0000","last_fullsized":"2024-09-11T14:49:43.177310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17891328,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":17472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"84'283","reported_seq":307,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:42.306160+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:49:42.306160+0000","last_peered":"2024-09-11T14:49:42.306160+0000","last_clean":"2024-09-11T14:49:42.306160+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:49:42.306160+0000","last_undegraded":"2024-09-11T14:49:42.306160+0000","last_fullsized":"2024-09-11T14:49:42.306160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"84'293","reported_seq":317,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:44.291301+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:49:44.291301+0000","last_peered":"2024-09-11T14:49:44.291301+0000","last_clean":"2024-09-11T14:49:44.291301+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:49:44.291301+0000","last_undegraded":"2024-09-11T14:49:44.291301+0000","last_fullsized":"2024-09-11T14:49:44.291301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":18752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.038142+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:49:00.038142+0000","last_peered":"2024-09-11T14:49:00.038142+0000","last_clean":"2024-09-11T14:49:00.038142+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:49:00.038142+0000","last_undegraded":"2024-09-11T14:49:00.038142+0000","last_fullsized":"2024-09-11T14:49:00.038142+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":221,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.140082+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:49:00.140082+0000","last_peered":"2024-09-11T14:49:00.140082+0000","last_clean":"2024-09-11T14:49:00.140082+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:49:00.140082+0000","last_undegraded":"2024-09-11T14:49:00.140082+0000","last_fullsized":"2024-09-11T14:49:00.140082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"84'271","reported_seq":295,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:43.095238+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:49:43.095238+0000","last_peered":"2024-09-11T14:49:43.095238+0000","last_clean":"2024-09-11T14:49:43.095238+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:49:43.095238+0000","last_undegraded":"2024-09-11T14:49:43.095238+0000","last_fullsized":"2024-09-11T14:49:43.095238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17760256,"num_objects":271,"num_object_clones":0,"num_object_copies":813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":17344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.999989+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:48:59.999989+0000","last_peered":"2024-09-11T14:48:59.999989+0000","last_clean":"2024-09-11T14:48:59.999989+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:48:59.999989+0000","last_undegraded":"2024-09-11T14:48:59.999989+0000","last_fullsized":"2024-09-11T14:48:59.999989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"84'255","reported_seq":279,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:42.961724+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:49:42.961724+0000","last_peered":"2024-09-11T14:49:42.961724+0000","last_clean":"2024-09-11T14:49:42.961724+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:49:42.961724+0000","last_undegraded":"2024-09-11T14:49:42.961724+0000","last_fullsized":"2024-09-11T14:49:42.961724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16711680,"num_objects":255,"num_object_clones":0,"num_object_copies":765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":16320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.132805+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:49:00.132805+0000","last_peered":"2024-09-11T14:49:00.132805+0000","last_clean":"2024-09-11T14:49:00.132805+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:49:00.132805+0000","last_undegraded":"2024-09-11T14:49:00.132805+0000","last_fullsized":"2024-09-11T14:49:00.132805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"84'259","reported_seq":283,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:42.896463+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:49:42.896463+0000","last_peered":"2024-09-11T14:49:42.896463+0000","last_clean":"2024-09-11T14:49:42.896463+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:49:42.896463+0000","last_undegraded":"2024-09-11T14:49:42.896463+0000","last_fullsized":"2024-09-11T14:49:42.896463+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16973824,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":16576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.994613+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:48:59.994613+0000","last_peered":"2024-09-11T14:48:59.994613+0000","last_clean":"2024-09-11T14:48:59.994613+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:48:59.994613+0000","last_undegraded":"2024-09-11T14:48:59.994613+0000","last_fullsized":"2024-09-11T14:48:59.994613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"84'259","reported_seq":283,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:43.167883+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:49:43.167883+0000","last_peered":"2024-09-11T14:49:43.167883+0000","last_clean":"2024-09-11T14:49:43.167883+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:49:43.167883+0000","last_undegraded":"2024-09-11T14:49:43.167883+0000","last_fullsized":"2024-09-11T14:49:43.167883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16973824,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":16576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.362042+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:49:00.362042+0000","last_peered":"2024-09-11T14:49:00.362042+0000","last_clean":"2024-09-11T14:49:00.362042+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:49:00.362042+0000","last_undegraded":"2024-09-11T14:49:00.362042+0000","last_fullsized":"2024-09-11T14:49:00.362042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"84'306","reported_seq":330,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:42.961098+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:49:42.961098+0000","last_peered":"2024-09-11T14:49:42.961098+0000","last_clean":"2024-09-11T14:49:42.961098+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:49:42.961098+0000","last_undegraded":"2024-09-11T14:49:42.961098+0000","last_fullsized":"2024-09-11T14:49:42.961098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20054016,"num_objects":306,"num_object_clones":0,"num_object_copies":918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":19584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.049486+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.049486+0000","last_peered":"2024-09-11T14:49:00.049486+0000","last_clean":"2024-09-11T14:49:00.049486+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:49:00.049486+0000","last_undegraded":"2024-09-11T14:49:00.049486+0000","last_fullsized":"2024-09-11T14:49:00.049486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"84'303","reported_seq":327,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:44.576544+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:49:44.576544+0000","last_peered":"2024-09-11T14:49:44.576544+0000","last_clean":"2024-09-11T14:49:44.576544+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:49:44.576544+0000","last_undegraded":"2024-09-11T14:49:44.576544+0000","last_fullsized":"2024-09-11T14:49:44.576544+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":19392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.363620+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.363620+0000","last_peered":"2024-09-11T14:49:00.363620+0000","last_clean":"2024-09-11T14:49:00.363620+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:49:00.363620+0000","last_undegraded":"2024-09-11T14:49:00.363620+0000","last_fullsized":"2024-09-11T14:49:00.363620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"84'276","reported_seq":300,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:44.336425+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:49:44.336425+0000","last_peered":"2024-09-11T14:49:44.336425+0000","last_clean":"2024-09-11T14:49:44.336425+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:49:44.336425+0000","last_undegraded":"2024-09-11T14:49:44.336425+0000","last_fullsized":"2024-09-11T14:49:44.336425+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18087936,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":17664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.145019+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:49:00.145019+0000","last_peered":"2024-09-11T14:49:00.145019+0000","last_clean":"2024-09-11T14:49:00.145019+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:49:00.145019+0000","last_undegraded":"2024-09-11T14:49:00.145019+0000","last_fullsized":"2024-09-11T14:49:00.145019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":290455552,"num_objects":4432,"num_object_clones":0,"num_object_copies":13296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4432,"num_write_kb":283648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212445593600,"internally_reserved":0,"allocated":1765900288,"data_stored":1765900288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4432,"ondisk_log_size":4432,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212445724672,"internally_reserved":0,"allocated":1765769216,"data_stored":1765769216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52995825664,"internally_reserved":0,"allocated":557047808,"data_stored":557047808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673779,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":539356,"kb_used_data":539356,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51758372,"statfs":{"total":53552873472,"available":53000572928,"internally_reserved":0,"allocated":552300544,"data_stored":552300544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":319816,"kb_used_data":319816,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51977912,"statfs":{"total":53552873472,"available":53225381888,"internally_reserved":0,"allocated":327491584,"data_stored":327491584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":386312,"kb_used_data":386312,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51911416,"statfs":{"total":53552873472,"available":53157289984,"internally_reserved":0,"allocated":395583488,"data_stored":395583488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":463180,"kb_used_data":463180,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51834548,"statfs":{"total":53552873472,"available":53078577152,"internally_reserved":0,"allocated":474296320,"data_stored":474296320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52995825664,"internally_reserved":0,"allocated":557047808,"data_stored":557047808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53152124928,"internally_reserved":0,"allocated":400748544,"data_stored":400748544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53076873216,"internally_reserved":0,"allocated":476000256,"data_stored":476000256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53221163008,"internally_reserved":0,"allocated":331710464,"data_stored":331710464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52995563520,"internally_reserved":0,"allocated":557309952,"data_stored":557309952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53152124928,"internally_reserved":0,"allocated":400748544,"data_stored":400748544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53076873216,"internally_reserved":0,"allocated":476000256,"data_stored":476000256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53221031936,"internally_reserved":0,"allocated":331841536,"data_stored":331841536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52995563520,"internally_reserved":0,"allocated":557309952,"data_stored":557309952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:49:47.049 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 66 16 4690 4674 4.42572 4.6875 0.121452 0.225332 2024-09-11T14:49:48.050 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 67 16 4745 4729 4.41096 3.4375 0.131806 0.225674 2024-09-11T14:49:48.159 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:49:48.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:48.275+0000 7f27ef791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:48.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:48.283+0000 7f27ef791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:49.050 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 68 16 4830 4814 4.42421 5.3125 0.107602 0.225632 2024-09-11T14:49:50.050 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 69 16 4921 4905 4.44251 5.6875 0.214799 0.224728 2024-09-11T14:49:50.608 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:49:50.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:50.760+0000 7fa8ad4f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:50.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:50.768+0000 7fa8ad4f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:51.050 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 70 16 5008 4992 4.45672 5.4375 0.118453 0.224031 2024-09-11T14:49:51.162 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:49:51.162 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:49:51.162 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:49:51.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:51.299+0000 7fe566191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:51.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:51.310+0000 7fe566191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:51.648 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:49:51.649 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:49:51.664 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":491,"stamp":"2024-09-11T14:49:51.398345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":315753011,"num_objects":4813,"num_object_clones":0,"num_object_copies":14439,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4890,"num_write_kb":308884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4864,"ondisk_log_size":4864,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1853072,"kb_used_data":1853072,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207337840,"statfs":{"total":214211493888,"available":212313948160,"internally_reserved":0,"allocated":1897545728,"data_stored":1897545728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":54198272,"num_objects":827,"num_object_clones":0,"num_object_copies":2481,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":827,"num_write_kb":52928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002550"},"pg_stats":[{"pgid":"7.f","version":"84'311","reported_seq":335,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:49.090792+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:49:49.090792+0000","last_peered":"2024-09-11T14:49:49.090792+0000","last_clean":"2024-09-11T14:49:49.090792+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:49:49.090792+0000","last_undegraded":"2024-09-11T14:49:49.090792+0000","last_fullsized":"2024-09-11T14:49:49.090792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20381696,"num_objects":311,"num_object_clones":0,"num_object_copies":933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":19904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"84'320","reported_seq":344,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:48.162024+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:49:48.162024+0000","last_peered":"2024-09-11T14:49:48.162024+0000","last_clean":"2024-09-11T14:49:48.162024+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:49:48.162024+0000","last_undegraded":"2024-09-11T14:49:48.162024+0000","last_fullsized":"2024-09-11T14:49:48.162024+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":320,"num_object_clones":0,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"84'293","reported_seq":317,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:48.241549+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:49:48.241549+0000","last_peered":"2024-09-11T14:49:48.241549+0000","last_clean":"2024-09-11T14:49:48.241549+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:49:48.241549+0000","last_undegraded":"2024-09-11T14:49:48.241549+0000","last_fullsized":"2024-09-11T14:49:48.241549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":18752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"84'288","reported_seq":312,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:47.779835+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:49:47.779835+0000","last_peered":"2024-09-11T14:49:47.779835+0000","last_clean":"2024-09-11T14:49:47.779835+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:49:47.779835+0000","last_undegraded":"2024-09-11T14:49:47.779835+0000","last_fullsized":"2024-09-11T14:49:47.779835+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"84'297","reported_seq":321,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:49.259873+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:49:49.259873+0000","last_peered":"2024-09-11T14:49:49.259873+0000","last_clean":"2024-09-11T14:49:49.259873+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:49:49.259873+0000","last_undegraded":"2024-09-11T14:49:49.259873+0000","last_fullsized":"2024-09-11T14:49:49.259873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":19008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"84'283","reported_seq":307,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:49.582444+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:49:49.582444+0000","last_peered":"2024-09-11T14:49:49.582444+0000","last_clean":"2024-09-11T14:49:49.582444+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:49:49.582444+0000","last_undegraded":"2024-09-11T14:49:49.582444+0000","last_fullsized":"2024-09-11T14:49:49.582444+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"84'300","reported_seq":324,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:48.212956+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:49:48.212956+0000","last_peered":"2024-09-11T14:49:48.212956+0000","last_clean":"2024-09-11T14:49:48.212956+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:49:48.212956+0000","last_undegraded":"2024-09-11T14:49:48.212956+0000","last_fullsized":"2024-09-11T14:49:48.212956+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":300,"num_write_kb":19200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"84'311","reported_seq":335,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:46.543421+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:49:46.543421+0000","last_peered":"2024-09-11T14:49:46.543421+0000","last_clean":"2024-09-11T14:49:46.543421+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:49:46.543421+0000","last_undegraded":"2024-09-11T14:49:46.543421+0000","last_fullsized":"2024-09-11T14:49:46.543421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20381696,"num_objects":311,"num_object_clones":0,"num_object_copies":933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":19904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"84'306","reported_seq":330,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:49.391896+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:49:49.391896+0000","last_peered":"2024-09-11T14:49:49.391896+0000","last_clean":"2024-09-11T14:49:49.391896+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:49:49.391896+0000","last_undegraded":"2024-09-11T14:49:49.391896+0000","last_fullsized":"2024-09-11T14:49:49.391896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20054016,"num_objects":306,"num_object_clones":0,"num_object_copies":918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":19584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.038142+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:49:00.038142+0000","last_peered":"2024-09-11T14:49:00.038142+0000","last_clean":"2024-09-11T14:49:00.038142+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:49:00.038142+0000","last_undegraded":"2024-09-11T14:49:00.038142+0000","last_fullsized":"2024-09-11T14:49:00.038142+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":221,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.140082+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:49:00.140082+0000","last_peered":"2024-09-11T14:49:00.140082+0000","last_clean":"2024-09-11T14:49:00.140082+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:49:00.140082+0000","last_undegraded":"2024-09-11T14:49:00.140082+0000","last_fullsized":"2024-09-11T14:49:00.140082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"84'289","reported_seq":313,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:47.327690+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:49:47.327690+0000","last_peered":"2024-09-11T14:49:47.327690+0000","last_clean":"2024-09-11T14:49:47.327690+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:49:47.327690+0000","last_undegraded":"2024-09-11T14:49:47.327690+0000","last_fullsized":"2024-09-11T14:49:47.327690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18939904,"num_objects":289,"num_object_clones":0,"num_object_copies":867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":18496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.999989+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:48:59.999989+0000","last_peered":"2024-09-11T14:48:59.999989+0000","last_clean":"2024-09-11T14:48:59.999989+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:48:59.999989+0000","last_undegraded":"2024-09-11T14:48:59.999989+0000","last_fullsized":"2024-09-11T14:48:59.999989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"84'290","reported_seq":314,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:48.270601+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:49:48.270601+0000","last_peered":"2024-09-11T14:49:48.270601+0000","last_clean":"2024-09-11T14:49:48.270601+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:49:48.270601+0000","last_undegraded":"2024-09-11T14:49:48.270601+0000","last_fullsized":"2024-09-11T14:49:48.270601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19005440,"num_objects":290,"num_object_clones":0,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":18560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.132805+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:49:00.132805+0000","last_peered":"2024-09-11T14:49:00.132805+0000","last_clean":"2024-09-11T14:49:00.132805+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:49:00.132805+0000","last_undegraded":"2024-09-11T14:49:00.132805+0000","last_fullsized":"2024-09-11T14:49:00.132805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"84'282","reported_seq":306,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:48.067671+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:49:48.067671+0000","last_peered":"2024-09-11T14:49:48.067671+0000","last_clean":"2024-09-11T14:49:48.067671+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:49:48.067671+0000","last_undegraded":"2024-09-11T14:49:48.067671+0000","last_fullsized":"2024-09-11T14:49:48.067671+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18481152,"num_objects":282,"num_object_clones":0,"num_object_copies":846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":282,"num_write_kb":18048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.994613+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:48:59.994613+0000","last_peered":"2024-09-11T14:48:59.994613+0000","last_clean":"2024-09-11T14:48:59.994613+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:48:59.994613+0000","last_undegraded":"2024-09-11T14:48:59.994613+0000","last_fullsized":"2024-09-11T14:48:59.994613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"84'279","reported_seq":303,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:47.396979+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:49:47.396979+0000","last_peered":"2024-09-11T14:49:47.396979+0000","last_clean":"2024-09-11T14:49:47.396979+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:49:47.396979+0000","last_undegraded":"2024-09-11T14:49:47.396979+0000","last_fullsized":"2024-09-11T14:49:47.396979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":17856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.362042+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:49:00.362042+0000","last_peered":"2024-09-11T14:49:00.362042+0000","last_clean":"2024-09-11T14:49:00.362042+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:49:00.362042+0000","last_undegraded":"2024-09-11T14:49:00.362042+0000","last_fullsized":"2024-09-11T14:49:00.362042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"84'329","reported_seq":353,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:48.203709+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:49:48.203709+0000","last_peered":"2024-09-11T14:49:48.203709+0000","last_clean":"2024-09-11T14:49:48.203709+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:49:48.203709+0000","last_undegraded":"2024-09-11T14:49:48.203709+0000","last_fullsized":"2024-09-11T14:49:48.203709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":329,"num_write_kb":21056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.049486+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.049486+0000","last_peered":"2024-09-11T14:49:00.049486+0000","last_clean":"2024-09-11T14:49:00.049486+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:49:00.049486+0000","last_undegraded":"2024-09-11T14:49:00.049486+0000","last_fullsized":"2024-09-11T14:49:00.049486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"84'326","reported_seq":350,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:49.016229+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:49:49.016229+0000","last_peered":"2024-09-11T14:49:49.016229+0000","last_clean":"2024-09-11T14:49:49.016229+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:49:49.016229+0000","last_undegraded":"2024-09-11T14:49:49.016229+0000","last_fullsized":"2024-09-11T14:49:49.016229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21364736,"num_objects":326,"num_object_clones":0,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.363620+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.363620+0000","last_peered":"2024-09-11T14:49:00.363620+0000","last_clean":"2024-09-11T14:49:00.363620+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:49:00.363620+0000","last_undegraded":"2024-09-11T14:49:00.363620+0000","last_fullsized":"2024-09-11T14:49:00.363620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"84'305","reported_seq":329,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:49.539561+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:49:49.539561+0000","last_peered":"2024-09-11T14:49:49.539561+0000","last_clean":"2024-09-11T14:49:49.539561+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:49:49.539561+0000","last_undegraded":"2024-09-11T14:49:49.539561+0000","last_fullsized":"2024-09-11T14:49:49.539561+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19988480,"num_objects":305,"num_object_clones":0,"num_object_copies":915,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":19520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.145019+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:49:00.145019+0000","last_peered":"2024-09-11T14:49:00.145019+0000","last_clean":"2024-09-11T14:49:00.145019+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:49:00.145019+0000","last_undegraded":"2024-09-11T14:49:00.145019+0000","last_fullsized":"2024-09-11T14:49:00.145019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":315162624,"num_objects":4809,"num_object_clones":0,"num_object_copies":14427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4809,"num_write_kb":307776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212296171520,"internally_reserved":0,"allocated":1915322368,"data_stored":1915322368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4809,"ondisk_log_size":4809,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212296302592,"internally_reserved":0,"allocated":1915191296,"data_stored":1915191296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52949663744,"internally_reserved":0,"allocated":603209728,"data_stored":603209728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673784,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":584180,"kb_used_data":584180,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51713548,"statfs":{"total":53552873472,"available":52954673152,"internally_reserved":0,"allocated":598200320,"data_stored":598200320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":346740,"kb_used_data":346740,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51950988,"statfs":{"total":53552873472,"available":53197811712,"internally_reserved":0,"allocated":355061760,"data_stored":355061760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":420664,"kb_used_data":420664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51877064,"statfs":{"total":53552873472,"available":53122113536,"internally_reserved":0,"allocated":430759936,"data_stored":430759936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":501488,"kb_used_data":501488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51796240,"statfs":{"total":53552873472,"available":53039349760,"internally_reserved":0,"allocated":513523712,"data_stored":513523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52949663744,"internally_reserved":0,"allocated":603209728,"data_stored":603209728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53116858368,"internally_reserved":0,"allocated":436015104,"data_stored":436015104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53037633536,"internally_reserved":0,"allocated":515239936,"data_stored":515239936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53192409088,"internally_reserved":0,"allocated":360464384,"data_stored":360464384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52949401600,"internally_reserved":0,"allocated":603471872,"data_stored":603471872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53116858368,"internally_reserved":0,"allocated":436015104,"data_stored":436015104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53037633536,"internally_reserved":0,"allocated":515239936,"data_stored":515239936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53192278016,"internally_reserved":0,"allocated":360595456,"data_stored":360595456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52949401600,"internally_reserved":0,"allocated":603471872,"data_stored":603471872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:49:52.050 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 71 16 5091 5075 4.46701 5.1875 0.314245 0.223389 2024-09-11T14:49:53.050 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 72 16 5179 5163 4.48135 5.5 0.211121 0.222839 2024-09-11T14:49:53.238 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:49:53.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:53.396+0000 7fea30b08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:53.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:53.407+0000 7fea30b08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:54.050 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 73 16 5259 5243 4.48844 5 0.208831 0.222491 2024-09-11T14:49:55.050 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 74 16 5336 5320 4.49281 4.8125 0.450016 0.22213 2024-09-11T14:49:55.783 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:49:55.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:55.909+0000 7f1e8fc63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:55.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:55.916+0000 7f1e8fc63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:56.050 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 75 16 5408 5392 4.4929 4.5 0.131134 0.222112 2024-09-11T14:49:56.666 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:49:56.666 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:49:56.666 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:49:56.667 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:49:56.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:56.808+0000 7fc53b951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:56.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:56.820+0000 7fc53b951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:56.871 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:49:56.871 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:49:56.871 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:49:56.871 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:49:56.871 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:49:56.871 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:49:56.871 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:49:56.871 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:49:56.871 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:49:56.871 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:49:56.871 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:49:56.871 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:49:56.874 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:49:56.875 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:49:56.875 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:49:57.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:57.016+0000 7f55304a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:57.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:57.028+0000 7f55304a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:57.050 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 76 16 5485 5469 4.4971 4.8125 0.0914152 0.221915 2024-09-11T14:49:57.090 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:49:57.090 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:49:57.090 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:49:57.090 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:49:57.090 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:49:57.090 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:49:57.090 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:49:57.090 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:49:57.090 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:49:57.090 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:49:57.090 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:49:57.091 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:49:57.093 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:49:57.094 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:49:57.094 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:49:57.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:57.248+0000 7fdfa8f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:57.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:57.260+0000 7fdfa8f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:57.415 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:49:57.415 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:49:57.415 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:49:57.415 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:49:57.415 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:49:57.415 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:49:57.415 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:49:57.416 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:49:57.416 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:49:57.416 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:49:57.416 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:49:57.416 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:49:57.418 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:49:57.418 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:49:57.419 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:49:57.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:57.580+0000 7fc4f2b08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:57.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:57.598+0000 7fc4f2b08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:57.654 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:49:57.654 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:49:57.654 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:49:57.654 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:49:57.654 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:49:57.654 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:49:57.654 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:49:57.654 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:49:57.654 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:49:57.655 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:49:57.655 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:49:57.655 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:49:57.657 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:49:57.658 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:49:58.051 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 77 16 5569 5553 4.50687 5.25 0.11995 0.221492 2024-09-11T14:49:58.207 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:49:58.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:58.341+0000 7f85cfcc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:58.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:49:58.350+0000 7f85cfcc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:59.052 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 78 16 5656 5640 4.5188 5.4375 0.177707 0.221061 2024-09-11T14:50:00.051 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 79 16 5743 5727 4.53042 5.4375 0.152851 0.220474 2024-09-11T14:50:00.904 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:50:01.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:01.024+0000 7f0489846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:01.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:01.032+0000 7f0489846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:01.051 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-11T14:50:01.050865+0000 min lat: 0.0273213 max lat: 1.44892 avg lat: 0.220233 2024-09-11T14:50:01.051 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-11T14:50:01.051 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 80 16 5820 5804 4.53394 4.8125 0.147418 0.220233 2024-09-11T14:50:02.051 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 81 16 5896 5880 4.5366 4.75 0.122596 0.219968 2024-09-11T14:50:02.659 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:50:02.659 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:50:02.659 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:50:02.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:02.800+0000 7f94b6591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:02.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:02.812+0000 7f94b6591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:03.051 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 82 16 5967 5951 4.53539 4.4375 0.347843 0.220191 2024-09-11T14:50:03.107 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:50:03.107 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:50:03.124 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":496,"stamp":"2024-09-11T14:50:01.400730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":369820211,"num_objects":5638,"num_object_clones":0,"num_object_copies":16914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5715,"num_write_kb":361684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5689,"ondisk_log_size":5689,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2170032,"kb_used_data":2170032,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207020880,"statfs":{"total":214211493888,"available":211989381120,"internally_reserved":0,"allocated":2222112768,"data_stored":2222112768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":62717952,"num_objects":957,"num_object_clones":0,"num_object_copies":2871,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":957,"num_write_kb":61248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002771"},"pg_stats":[{"pgid":"7.f","version":"84'361","reported_seq":385,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:59.167677+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:49:59.167677+0000","last_peered":"2024-09-11T14:49:59.167677+0000","last_clean":"2024-09-11T14:49:59.167677+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:49:59.167677+0000","last_undegraded":"2024-09-11T14:49:59.167677+0000","last_fullsized":"2024-09-11T14:49:59.167677+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23658496,"num_objects":361,"num_object_clones":0,"num_object_copies":1083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":23104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"84'370","reported_seq":394,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:57.605146+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:49:57.605146+0000","last_peered":"2024-09-11T14:49:57.605146+0000","last_clean":"2024-09-11T14:49:57.605146+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:49:57.605146+0000","last_undegraded":"2024-09-11T14:49:57.605146+0000","last_fullsized":"2024-09-11T14:49:57.605146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24248320,"num_objects":370,"num_object_clones":0,"num_object_copies":1110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":23680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"84'342","reported_seq":366,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:58.173926+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:49:58.173926+0000","last_peered":"2024-09-11T14:49:58.173926+0000","last_clean":"2024-09-11T14:49:58.173926+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:49:58.173926+0000","last_undegraded":"2024-09-11T14:49:58.173926+0000","last_fullsized":"2024-09-11T14:49:58.173926+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22413312,"num_objects":342,"num_object_clones":0,"num_object_copies":1026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":342,"num_write_kb":21888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"84'335","reported_seq":359,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:58.183532+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:49:58.183532+0000","last_peered":"2024-09-11T14:49:58.183532+0000","last_clean":"2024-09-11T14:49:58.183532+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:49:58.183532+0000","last_undegraded":"2024-09-11T14:49:58.183532+0000","last_fullsized":"2024-09-11T14:49:58.183532+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":21440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"84'354","reported_seq":378,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:58.981205+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:49:58.981205+0000","last_peered":"2024-09-11T14:49:58.981205+0000","last_clean":"2024-09-11T14:49:58.981205+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:49:58.981205+0000","last_undegraded":"2024-09-11T14:49:58.981205+0000","last_fullsized":"2024-09-11T14:49:58.981205+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23199744,"num_objects":354,"num_object_clones":0,"num_object_copies":1062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":22656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"84'322","reported_seq":346,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:59.276686+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:49:59.276686+0000","last_peered":"2024-09-11T14:49:59.276686+0000","last_clean":"2024-09-11T14:49:59.276686+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:49:59.276686+0000","last_undegraded":"2024-09-11T14:49:59.276686+0000","last_fullsized":"2024-09-11T14:49:59.276686+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21102592,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":20608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"84'357","reported_seq":381,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:57.923950+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:49:57.923950+0000","last_peered":"2024-09-11T14:49:57.923950+0000","last_clean":"2024-09-11T14:49:57.923950+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:49:57.923950+0000","last_undegraded":"2024-09-11T14:49:57.923950+0000","last_fullsized":"2024-09-11T14:49:57.923950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23396352,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":22848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"84'364","reported_seq":388,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:57.860673+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:49:57.860673+0000","last_peered":"2024-09-11T14:49:57.860673+0000","last_clean":"2024-09-11T14:49:57.860673+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:49:57.860673+0000","last_undegraded":"2024-09-11T14:49:57.860673+0000","last_fullsized":"2024-09-11T14:49:57.860673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":23296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"84'366","reported_seq":390,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:59.488806+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:49:59.488806+0000","last_peered":"2024-09-11T14:49:59.488806+0000","last_clean":"2024-09-11T14:49:59.488806+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:49:59.488806+0000","last_undegraded":"2024-09-11T14:49:59.488806+0000","last_fullsized":"2024-09-11T14:49:59.488806+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23986176,"num_objects":366,"num_object_clones":0,"num_object_copies":1098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":23424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.038142+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:49:00.038142+0000","last_peered":"2024-09-11T14:49:00.038142+0000","last_clean":"2024-09-11T14:49:00.038142+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:49:00.038142+0000","last_undegraded":"2024-09-11T14:49:00.038142+0000","last_fullsized":"2024-09-11T14:49:00.038142+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":221,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.140082+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:49:00.140082+0000","last_peered":"2024-09-11T14:49:00.140082+0000","last_clean":"2024-09-11T14:49:00.140082+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:49:00.140082+0000","last_undegraded":"2024-09-11T14:49:00.140082+0000","last_fullsized":"2024-09-11T14:49:00.140082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"84'342","reported_seq":366,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:57.960216+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:49:57.960216+0000","last_peered":"2024-09-11T14:49:57.960216+0000","last_clean":"2024-09-11T14:49:57.960216+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:49:57.960216+0000","last_undegraded":"2024-09-11T14:49:57.960216+0000","last_fullsized":"2024-09-11T14:49:57.960216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22413312,"num_objects":342,"num_object_clones":0,"num_object_copies":1026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":342,"num_write_kb":21888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.999989+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:48:59.999989+0000","last_peered":"2024-09-11T14:48:59.999989+0000","last_clean":"2024-09-11T14:48:59.999989+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:48:59.999989+0000","last_undegraded":"2024-09-11T14:48:59.999989+0000","last_fullsized":"2024-09-11T14:48:59.999989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"84'341","reported_seq":365,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:57.922673+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:49:57.922673+0000","last_peered":"2024-09-11T14:49:57.922673+0000","last_clean":"2024-09-11T14:49:57.922673+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:49:57.922673+0000","last_undegraded":"2024-09-11T14:49:57.922673+0000","last_fullsized":"2024-09-11T14:49:57.922673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.132805+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:49:00.132805+0000","last_peered":"2024-09-11T14:49:00.132805+0000","last_clean":"2024-09-11T14:49:00.132805+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:49:00.132805+0000","last_undegraded":"2024-09-11T14:49:00.132805+0000","last_fullsized":"2024-09-11T14:49:00.132805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"84'335","reported_seq":359,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:58.241306+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:49:58.241306+0000","last_peered":"2024-09-11T14:49:58.241306+0000","last_clean":"2024-09-11T14:49:58.241306+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:49:58.241306+0000","last_undegraded":"2024-09-11T14:49:58.241306+0000","last_fullsized":"2024-09-11T14:49:58.241306+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":21440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.994613+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:48:59.994613+0000","last_peered":"2024-09-11T14:48:59.994613+0000","last_clean":"2024-09-11T14:48:59.994613+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:48:59.994613+0000","last_undegraded":"2024-09-11T14:48:59.994613+0000","last_fullsized":"2024-09-11T14:48:59.994613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"84'327","reported_seq":351,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:57.866900+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:49:57.866900+0000","last_peered":"2024-09-11T14:49:57.866900+0000","last_clean":"2024-09-11T14:49:57.866900+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:49:57.866900+0000","last_undegraded":"2024-09-11T14:49:57.866900+0000","last_fullsized":"2024-09-11T14:49:57.866900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21430272,"num_objects":327,"num_object_clones":0,"num_object_copies":981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":20928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.362042+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:49:00.362042+0000","last_peered":"2024-09-11T14:49:00.362042+0000","last_clean":"2024-09-11T14:49:00.362042+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:49:00.362042+0000","last_undegraded":"2024-09-11T14:49:00.362042+0000","last_fullsized":"2024-09-11T14:49:00.362042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"84'381","reported_seq":405,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:58.013726+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:49:58.013726+0000","last_peered":"2024-09-11T14:49:58.013726+0000","last_clean":"2024-09-11T14:49:58.013726+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:49:58.013726+0000","last_undegraded":"2024-09-11T14:49:58.013726+0000","last_fullsized":"2024-09-11T14:49:58.013726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24969216,"num_objects":381,"num_object_clones":0,"num_object_copies":1143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":381,"num_write_kb":24384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.049486+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.049486+0000","last_peered":"2024-09-11T14:49:00.049486+0000","last_clean":"2024-09-11T14:49:00.049486+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:49:00.049486+0000","last_undegraded":"2024-09-11T14:49:00.049486+0000","last_fullsized":"2024-09-11T14:49:00.049486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"84'385","reported_seq":409,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:59.443499+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:49:59.443499+0000","last_peered":"2024-09-11T14:49:59.443499+0000","last_clean":"2024-09-11T14:49:59.443499+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:49:59.443499+0000","last_undegraded":"2024-09-11T14:49:59.443499+0000","last_fullsized":"2024-09-11T14:49:59.443499+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25231360,"num_objects":385,"num_object_clones":0,"num_object_copies":1155,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":385,"num_write_kb":24640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.363620+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.363620+0000","last_peered":"2024-09-11T14:49:00.363620+0000","last_clean":"2024-09-11T14:49:00.363620+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:49:00.363620+0000","last_undegraded":"2024-09-11T14:49:00.363620+0000","last_fullsized":"2024-09-11T14:49:00.363620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"84'352","reported_seq":376,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:59.356235+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:49:59.356235+0000","last_peered":"2024-09-11T14:49:59.356235+0000","last_clean":"2024-09-11T14:49:59.356235+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:49:59.356235+0000","last_undegraded":"2024-09-11T14:49:59.356235+0000","last_fullsized":"2024-09-11T14:49:59.356235+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":352,"num_object_clones":0,"num_object_copies":1056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.145019+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:49:00.145019+0000","last_peered":"2024-09-11T14:49:00.145019+0000","last_clean":"2024-09-11T14:49:00.145019+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:49:00.145019+0000","last_undegraded":"2024-09-11T14:49:00.145019+0000","last_fullsized":"2024-09-11T14:49:00.145019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":369229824,"num_objects":5634,"num_object_clones":0,"num_object_copies":16902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5634,"num_write_kb":360576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211971653632,"internally_reserved":0,"allocated":2239840256,"data_stored":2239840256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5634,"ondisk_log_size":5634,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211972046848,"internally_reserved":0,"allocated":2239447040,"data_stored":2239447040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52848664576,"internally_reserved":0,"allocated":704208896,"data_stored":704208896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673794,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":683720,"kb_used_data":683720,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51614008,"statfs":{"total":53552873472,"available":52852744192,"internally_reserved":0,"allocated":700129280,"data_stored":700129280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":406616,"kb_used_data":406616,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51891112,"statfs":{"total":53552873472,"available":53136498688,"internally_reserved":0,"allocated":416374784,"data_stored":416374784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":491672,"kb_used_data":491672,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51806056,"statfs":{"total":53552873472,"available":53049401344,"internally_reserved":0,"allocated":503472128,"data_stored":503472128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":588024,"kb_used_data":588024,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51709704,"statfs":{"total":53552873472,"available":52950736896,"internally_reserved":0,"allocated":602136576,"data_stored":602136576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52848664576,"internally_reserved":0,"allocated":704208896,"data_stored":704208896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53042241536,"internally_reserved":0,"allocated":510631936,"data_stored":510631936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52948791296,"internally_reserved":0,"allocated":604082176,"data_stored":604082176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53132480512,"internally_reserved":0,"allocated":420392960,"data_stored":420392960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52848533504,"internally_reserved":0,"allocated":704339968,"data_stored":704339968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53042241536,"internally_reserved":0,"allocated":510631936,"data_stored":510631936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":52948660224,"internally_reserved":0,"allocated":604213248,"data_stored":604213248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53132218368,"internally_reserved":0,"allocated":420655104,"data_stored":420655104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52848533504,"internally_reserved":0,"allocated":704339968,"data_stored":704339968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:50:03.475 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:50:03.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:03.641+0000 7fc419f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:03.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:03.649+0000 7fc419f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:04.051 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 83 16 6043 6027 4.53797 4.75 0.455744 0.219917 2024-09-11T14:50:05.051 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 84 16 6130 6114 4.54867 5.4375 0.208864 0.219554 2024-09-11T14:50:06.020 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:50:06.051 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 85 16 6210 6194 4.55397 5 0.0838535 0.219241 2024-09-11T14:50:06.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:06.144+0000 7f360f711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:06.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:06.151+0000 7f360f711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:07.051 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 86 16 6285 6269 4.55552 4.6875 0.320604 0.219184 2024-09-11T14:50:08.053 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 87 16 6373 6357 4.56637 5.5 0.149715 0.218686 2024-09-11T14:50:08.126 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:50:08.126 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:50:08.126 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:50:08.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:08.298+0000 7f55a4e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:08.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:08.308+0000 7f55a4e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:08.544 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:50:08.591 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:50:08.591 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:50:08.615 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":499,"stamp":"2024-09-11T14:50:07.402202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":395641395,"num_objects":6032,"num_object_clones":0,"num_object_copies":18096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6109,"num_write_kb":386900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6083,"ondisk_log_size":6083,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2323428,"kb_used_data":2323428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206867484,"statfs":{"total":214211493888,"available":211832303616,"internally_reserved":0,"allocated":2379190272,"data_stored":2379190272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":50987008,"num_objects":778,"num_object_clones":0,"num_object_copies":2334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":778,"num_write_kb":49792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003069"},"pg_stats":[{"pgid":"7.f","version":"84'390","reported_seq":414,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:04.317083+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:50:04.317083+0000","last_peered":"2024-09-11T14:50:04.317083+0000","last_clean":"2024-09-11T14:50:04.317083+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:50:04.317083+0000","last_undegraded":"2024-09-11T14:50:04.317083+0000","last_fullsized":"2024-09-11T14:50:04.317083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25559040,"num_objects":390,"num_object_clones":0,"num_object_copies":1170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":24960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"84'395","reported_seq":419,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:02.833673+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:50:02.833673+0000","last_peered":"2024-09-11T14:50:02.833673+0000","last_clean":"2024-09-11T14:50:02.833673+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:50:02.833673+0000","last_undegraded":"2024-09-11T14:50:02.833673+0000","last_fullsized":"2024-09-11T14:50:02.833673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25886720,"num_objects":395,"num_object_clones":0,"num_object_copies":1185,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":395,"num_write_kb":25280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"84'364","reported_seq":388,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:02.729499+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:50:02.729499+0000","last_peered":"2024-09-11T14:50:02.729499+0000","last_clean":"2024-09-11T14:50:02.729499+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:50:02.729499+0000","last_undegraded":"2024-09-11T14:50:02.729499+0000","last_fullsized":"2024-09-11T14:50:02.729499+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":23296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"84'364","reported_seq":388,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:03.041921+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:50:03.041921+0000","last_peered":"2024-09-11T14:50:03.041921+0000","last_clean":"2024-09-11T14:50:03.041921+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:50:03.041921+0000","last_undegraded":"2024-09-11T14:50:03.041921+0000","last_fullsized":"2024-09-11T14:50:03.041921+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":23296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"84'376","reported_seq":400,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:03.706302+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:50:03.706302+0000","last_peered":"2024-09-11T14:50:03.706302+0000","last_clean":"2024-09-11T14:50:03.706302+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:50:03.706302+0000","last_undegraded":"2024-09-11T14:50:03.706302+0000","last_fullsized":"2024-09-11T14:50:03.706302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24641536,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"84'347","reported_seq":371,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:04.182019+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:50:04.182019+0000","last_peered":"2024-09-11T14:50:04.182019+0000","last_clean":"2024-09-11T14:50:04.182019+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:50:04.182019+0000","last_undegraded":"2024-09-11T14:50:04.182019+0000","last_fullsized":"2024-09-11T14:50:04.182019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22740992,"num_objects":347,"num_object_clones":0,"num_object_copies":1041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":22208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"84'384","reported_seq":408,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:03.277694+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:50:03.277694+0000","last_peered":"2024-09-11T14:50:03.277694+0000","last_clean":"2024-09-11T14:50:03.277694+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:50:03.277694+0000","last_undegraded":"2024-09-11T14:50:03.277694+0000","last_fullsized":"2024-09-11T14:50:03.277694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":384,"num_object_clones":0,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"84'393","reported_seq":417,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:03.151893+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:50:03.151893+0000","last_peered":"2024-09-11T14:50:03.151893+0000","last_clean":"2024-09-11T14:50:03.151893+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:50:03.151893+0000","last_undegraded":"2024-09-11T14:50:03.151893+0000","last_fullsized":"2024-09-11T14:50:03.151893+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":25152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"84'388","reported_seq":412,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:04.437070+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:50:04.437070+0000","last_peered":"2024-09-11T14:50:04.437070+0000","last_clean":"2024-09-11T14:50:04.437070+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:50:04.437070+0000","last_undegraded":"2024-09-11T14:50:04.437070+0000","last_fullsized":"2024-09-11T14:50:04.437070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25427968,"num_objects":388,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":24832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.038142+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:49:00.038142+0000","last_peered":"2024-09-11T14:49:00.038142+0000","last_clean":"2024-09-11T14:49:00.038142+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:49:00.038142+0000","last_undegraded":"2024-09-11T14:49:00.038142+0000","last_fullsized":"2024-09-11T14:49:00.038142+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":221,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.140082+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:49:00.140082+0000","last_peered":"2024-09-11T14:49:00.140082+0000","last_clean":"2024-09-11T14:49:00.140082+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:49:00.140082+0000","last_undegraded":"2024-09-11T14:49:00.140082+0000","last_fullsized":"2024-09-11T14:49:00.140082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"84'371","reported_seq":395,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:02.908811+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:50:02.908811+0000","last_peered":"2024-09-11T14:50:02.908811+0000","last_clean":"2024-09-11T14:50:02.908811+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:50:02.908811+0000","last_undegraded":"2024-09-11T14:50:02.908811+0000","last_fullsized":"2024-09-11T14:50:02.908811+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24313856,"num_objects":371,"num_object_clones":0,"num_object_copies":1113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":23744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.999989+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:48:59.999989+0000","last_peered":"2024-09-11T14:48:59.999989+0000","last_clean":"2024-09-11T14:48:59.999989+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:48:59.999989+0000","last_undegraded":"2024-09-11T14:48:59.999989+0000","last_fullsized":"2024-09-11T14:48:59.999989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"84'366","reported_seq":390,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:03.330648+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:50:03.330648+0000","last_peered":"2024-09-11T14:50:03.330648+0000","last_clean":"2024-09-11T14:50:03.330648+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:50:03.330648+0000","last_undegraded":"2024-09-11T14:50:03.330648+0000","last_fullsized":"2024-09-11T14:50:03.330648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23986176,"num_objects":366,"num_object_clones":0,"num_object_copies":1098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":23424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.132805+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:49:00.132805+0000","last_peered":"2024-09-11T14:49:00.132805+0000","last_clean":"2024-09-11T14:49:00.132805+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:49:00.132805+0000","last_undegraded":"2024-09-11T14:49:00.132805+0000","last_fullsized":"2024-09-11T14:49:00.132805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"84'363","reported_seq":387,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:03.039358+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:50:03.039358+0000","last_peered":"2024-09-11T14:50:03.039358+0000","last_clean":"2024-09-11T14:50:03.039358+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:50:03.039358+0000","last_undegraded":"2024-09-11T14:50:03.039358+0000","last_fullsized":"2024-09-11T14:50:03.039358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23789568,"num_objects":363,"num_object_clones":0,"num_object_copies":1089,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":23232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.994613+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:48:59.994613+0000","last_peered":"2024-09-11T14:48:59.994613+0000","last_clean":"2024-09-11T14:48:59.994613+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:48:59.994613+0000","last_undegraded":"2024-09-11T14:48:59.994613+0000","last_fullsized":"2024-09-11T14:48:59.994613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"84'348","reported_seq":372,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:03.397236+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:50:03.397236+0000","last_peered":"2024-09-11T14:50:03.397236+0000","last_clean":"2024-09-11T14:50:03.397236+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:50:03.397236+0000","last_undegraded":"2024-09-11T14:50:03.397236+0000","last_fullsized":"2024-09-11T14:50:03.397236+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22806528,"num_objects":348,"num_object_clones":0,"num_object_copies":1044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":348,"num_write_kb":22272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.362042+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:49:00.362042+0000","last_peered":"2024-09-11T14:49:00.362042+0000","last_clean":"2024-09-11T14:49:00.362042+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:49:00.362042+0000","last_undegraded":"2024-09-11T14:49:00.362042+0000","last_fullsized":"2024-09-11T14:49:00.362042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"84'400","reported_seq":424,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:02.480244+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:50:02.480244+0000","last_peered":"2024-09-11T14:50:02.480244+0000","last_clean":"2024-09-11T14:50:02.480244+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:50:02.480244+0000","last_undegraded":"2024-09-11T14:50:02.480244+0000","last_fullsized":"2024-09-11T14:50:02.480244+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26214400,"num_objects":400,"num_object_clones":0,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.049486+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.049486+0000","last_peered":"2024-09-11T14:49:00.049486+0000","last_clean":"2024-09-11T14:49:00.049486+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:49:00.049486+0000","last_undegraded":"2024-09-11T14:49:00.049486+0000","last_fullsized":"2024-09-11T14:49:00.049486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"84'405","reported_seq":429,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:04.502528+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:50:04.502528+0000","last_peered":"2024-09-11T14:50:04.502528+0000","last_clean":"2024-09-11T14:50:04.502528+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:50:04.502528+0000","last_undegraded":"2024-09-11T14:50:04.502528+0000","last_fullsized":"2024-09-11T14:50:04.502528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26542080,"num_objects":405,"num_object_clones":0,"num_object_copies":1215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":25920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.363620+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.363620+0000","last_peered":"2024-09-11T14:49:00.363620+0000","last_clean":"2024-09-11T14:49:00.363620+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:49:00.363620+0000","last_undegraded":"2024-09-11T14:49:00.363620+0000","last_fullsized":"2024-09-11T14:49:00.363620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"84'374","reported_seq":398,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:04.341941+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:50:04.341941+0000","last_peered":"2024-09-11T14:50:04.341941+0000","last_clean":"2024-09-11T14:50:04.341941+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:50:04.341941+0000","last_undegraded":"2024-09-11T14:50:04.341941+0000","last_fullsized":"2024-09-11T14:50:04.341941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24510464,"num_objects":374,"num_object_clones":0,"num_object_copies":1122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.145019+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:49:00.145019+0000","last_peered":"2024-09-11T14:49:00.145019+0000","last_clean":"2024-09-11T14:49:00.145019+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:49:00.145019+0000","last_undegraded":"2024-09-11T14:49:00.145019+0000","last_fullsized":"2024-09-11T14:49:00.145019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":395051008,"num_objects":6028,"num_object_clones":0,"num_object_copies":18084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6028,"num_write_kb":385792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211813654528,"internally_reserved":0,"allocated":2397839360,"data_stored":2397839360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6028,"ondisk_log_size":6028,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211813785600,"internally_reserved":0,"allocated":2397708288,"data_stored":2397708288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52799291392,"internally_reserved":0,"allocated":753582080,"data_stored":753582080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":730808,"kb_used_data":730808,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51566920,"statfs":{"total":53552873472,"available":52804526080,"internally_reserved":0,"allocated":748347392,"data_stored":748347392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":434884,"kb_used_data":434884,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51862844,"statfs":{"total":53552873472,"available":53107552256,"internally_reserved":0,"allocated":445321216,"data_stored":445321216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":527800,"kb_used_data":527800,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51769928,"statfs":{"total":53552873472,"available":53012406272,"internally_reserved":0,"allocated":540467200,"data_stored":540467200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":629936,"kb_used_data":629936,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51667792,"statfs":{"total":53552873472,"available":52907819008,"internally_reserved":0,"allocated":645054464,"data_stored":645054464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52799291392,"internally_reserved":0,"allocated":753582080,"data_stored":753582080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53006221312,"internally_reserved":0,"allocated":546652160,"data_stored":546652160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52905459712,"internally_reserved":0,"allocated":647413760,"data_stored":647413760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53102813184,"internally_reserved":0,"allocated":450060288,"data_stored":450060288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52799291392,"internally_reserved":0,"allocated":753582080,"data_stored":753582080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53006090240,"internally_reserved":0,"allocated":546783232,"data_stored":546783232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":52905459712,"internally_reserved":0,"allocated":647413760,"data_stored":647413760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53102813184,"internally_reserved":0,"allocated":450060288,"data_stored":450060288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52799291392,"internally_reserved":0,"allocated":753582080,"data_stored":753582080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:50:08.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:08.708+0000 7fab47ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:08.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:08.719+0000 7fab47ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:09.052 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 88 16 6448 6432 4.56774 4.6875 0.0874066 0.218497 2024-09-11T14:50:10.052 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 89 16 6531 6515 4.5747 5.1875 0.116238 0.218381 2024-09-11T14:50:11.052 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 90 15 6610 6595 4.57942 5 0.152858 0.218081 2024-09-11T14:50:11.213 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:50:11.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:11.317+0000 7f62598c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:11.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:11.323+0000 7f62598c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:12.052 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total time run: 90.1268 2024-09-11T14:50:12.052 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total writes made: 6610 2024-09-11T14:50:12.052 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Write size: 65536 2024-09-11T14:50:12.052 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object size: 65536 2024-09-11T14:50:12.053 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Bandwidth (MB/sec): 4.58382 2024-09-11T14:50:12.053 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Bandwidth: 0.57359 2024-09-11T14:50:12.053 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max bandwidth (MB/sec): 5.6875 2024-09-11T14:50:12.053 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min bandwidth (MB/sec): 3.25 2024-09-11T14:50:12.053 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average IOPS: 73 2024-09-11T14:50:12.053 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev IOPS: 9.17744 2024-09-11T14:50:12.053 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max IOPS: 91 2024-09-11T14:50:12.053 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min IOPS: 52 2024-09-11T14:50:12.053 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average Latency(s): 0.217994 2024-09-11T14:50:12.053 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Latency(s): 0.151994 2024-09-11T14:50:12.053 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max latency(s): 1.44892 2024-09-11T14:50:12.053 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min latency(s): 0.0273213 2024-09-11T14:50:12.093 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Cleaning up (deleting benchmark objects) 2024-09-11T14:50:13.423 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:50:13.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:13.581+0000 7f5407c7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:13.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:13.588+0000 7f5407c7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:13.617 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:50:13.617 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:50:13.618 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:50:13.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:13.759+0000 7f0c918fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:13.770+0000 7f0c918fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:14.082 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:50:14.082 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:50:14.098 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":502,"stamp":"2024-09-11T14:50:13.403489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":422511155,"num_objects":6442,"num_object_clones":0,"num_object_copies":19326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6519,"num_write_kb":413140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6493,"ondisk_log_size":6493,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2480008,"kb_used_data":2480008,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206710904,"statfs":{"total":214211493888,"available":211671965696,"internally_reserved":0,"allocated":2539528192,"data_stored":2539528192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":52690944,"num_objects":804,"num_object_clones":0,"num_object_copies":2412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":51456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002759"},"pg_stats":[{"pgid":"7.f","version":"84'419","reported_seq":443,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:09.562538+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:50:09.562538+0000","last_peered":"2024-09-11T14:50:09.562538+0000","last_clean":"2024-09-11T14:50:09.562538+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:50:09.562538+0000","last_undegraded":"2024-09-11T14:50:09.562538+0000","last_fullsized":"2024-09-11T14:50:09.562538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27459584,"num_objects":419,"num_object_clones":0,"num_object_copies":1257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":26816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"84'422","reported_seq":446,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:08.037412+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:50:08.037412+0000","last_peered":"2024-09-11T14:50:08.037412+0000","last_clean":"2024-09-11T14:50:08.037412+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:50:08.037412+0000","last_undegraded":"2024-09-11T14:50:08.037412+0000","last_fullsized":"2024-09-11T14:50:08.037412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27656192,"num_objects":422,"num_object_clones":0,"num_object_copies":1266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":422,"num_write_kb":27008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"84'393","reported_seq":417,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:07.837954+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:50:07.837954+0000","last_peered":"2024-09-11T14:50:07.837954+0000","last_clean":"2024-09-11T14:50:07.837954+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:50:07.837954+0000","last_undegraded":"2024-09-11T14:50:07.837954+0000","last_fullsized":"2024-09-11T14:50:07.837954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":25152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"84'390","reported_seq":414,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:08.233463+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:50:08.233463+0000","last_peered":"2024-09-11T14:50:08.233463+0000","last_clean":"2024-09-11T14:50:08.233463+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:50:08.233463+0000","last_undegraded":"2024-09-11T14:50:08.233463+0000","last_fullsized":"2024-09-11T14:50:08.233463+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25559040,"num_objects":390,"num_object_clones":0,"num_object_copies":1170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":24960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"84'401","reported_seq":425,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:09.411628+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:50:09.411628+0000","last_peered":"2024-09-11T14:50:09.411628+0000","last_clean":"2024-09-11T14:50:09.411628+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:50:09.411628+0000","last_undegraded":"2024-09-11T14:50:09.411628+0000","last_fullsized":"2024-09-11T14:50:09.411628+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26279936,"num_objects":401,"num_object_clones":0,"num_object_copies":1203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":401,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"84'368","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:09.338506+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:50:09.338506+0000","last_peered":"2024-09-11T14:50:09.338506+0000","last_clean":"2024-09-11T14:50:09.338506+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:50:09.338506+0000","last_undegraded":"2024-09-11T14:50:09.338506+0000","last_fullsized":"2024-09-11T14:50:09.338506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24117248,"num_objects":368,"num_object_clones":0,"num_object_copies":1104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":23552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"84'406","reported_seq":430,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:07.556290+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:50:07.556290+0000","last_peered":"2024-09-11T14:50:07.556290+0000","last_clean":"2024-09-11T14:50:07.556290+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:50:07.556290+0000","last_undegraded":"2024-09-11T14:50:07.556290+0000","last_fullsized":"2024-09-11T14:50:07.556290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26607616,"num_objects":406,"num_object_clones":0,"num_object_copies":1218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":25984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"84'421","reported_seq":445,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:07.813801+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:50:07.813801+0000","last_peered":"2024-09-11T14:50:07.813801+0000","last_clean":"2024-09-11T14:50:07.813801+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:50:07.813801+0000","last_undegraded":"2024-09-11T14:50:07.813801+0000","last_fullsized":"2024-09-11T14:50:07.813801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"84'414","reported_seq":438,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:08.983633+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:50:08.983633+0000","last_peered":"2024-09-11T14:50:08.983633+0000","last_clean":"2024-09-11T14:50:08.983633+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:50:08.983633+0000","last_undegraded":"2024-09-11T14:50:08.983633+0000","last_fullsized":"2024-09-11T14:50:08.983633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27131904,"num_objects":414,"num_object_clones":0,"num_object_copies":1242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":414,"num_write_kb":26496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.038142+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:49:00.038142+0000","last_peered":"2024-09-11T14:49:00.038142+0000","last_clean":"2024-09-11T14:49:00.038142+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:49:00.038142+0000","last_undegraded":"2024-09-11T14:49:00.038142+0000","last_fullsized":"2024-09-11T14:49:00.038142+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":221,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.140082+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:49:00.140082+0000","last_peered":"2024-09-11T14:49:00.140082+0000","last_clean":"2024-09-11T14:49:00.140082+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:49:00.140082+0000","last_undegraded":"2024-09-11T14:49:00.140082+0000","last_fullsized":"2024-09-11T14:49:00.140082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"84'395","reported_seq":419,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:07.951072+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:50:07.951072+0000","last_peered":"2024-09-11T14:50:07.951072+0000","last_clean":"2024-09-11T14:50:07.951072+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:50:07.951072+0000","last_undegraded":"2024-09-11T14:50:07.951072+0000","last_fullsized":"2024-09-11T14:50:07.951072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25886720,"num_objects":395,"num_object_clones":0,"num_object_copies":1185,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":395,"num_write_kb":25280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.999989+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:48:59.999989+0000","last_peered":"2024-09-11T14:48:59.999989+0000","last_clean":"2024-09-11T14:48:59.999989+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:48:59.999989+0000","last_undegraded":"2024-09-11T14:48:59.999989+0000","last_fullsized":"2024-09-11T14:48:59.999989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"84'391","reported_seq":415,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:08.221582+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:50:08.221582+0000","last_peered":"2024-09-11T14:50:08.221582+0000","last_clean":"2024-09-11T14:50:08.221582+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:50:08.221582+0000","last_undegraded":"2024-09-11T14:50:08.221582+0000","last_fullsized":"2024-09-11T14:50:08.221582+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25624576,"num_objects":391,"num_object_clones":0,"num_object_copies":1173,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":391,"num_write_kb":25024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.132805+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:49:00.132805+0000","last_peered":"2024-09-11T14:49:00.132805+0000","last_clean":"2024-09-11T14:49:00.132805+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:49:00.132805+0000","last_undegraded":"2024-09-11T14:49:00.132805+0000","last_fullsized":"2024-09-11T14:49:00.132805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"84'391","reported_seq":415,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:07.871508+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:50:07.871508+0000","last_peered":"2024-09-11T14:50:07.871508+0000","last_clean":"2024-09-11T14:50:07.871508+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:50:07.871508+0000","last_undegraded":"2024-09-11T14:50:07.871508+0000","last_fullsized":"2024-09-11T14:50:07.871508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25624576,"num_objects":391,"num_object_clones":0,"num_object_copies":1173,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":391,"num_write_kb":25024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.994613+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:48:59.994613+0000","last_peered":"2024-09-11T14:48:59.994613+0000","last_clean":"2024-09-11T14:48:59.994613+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:48:59.994613+0000","last_undegraded":"2024-09-11T14:48:59.994613+0000","last_fullsized":"2024-09-11T14:48:59.994613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"84'374","reported_seq":398,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:08.262083+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:50:08.262083+0000","last_peered":"2024-09-11T14:50:08.262083+0000","last_clean":"2024-09-11T14:50:08.262083+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:50:08.262083+0000","last_undegraded":"2024-09-11T14:50:08.262083+0000","last_fullsized":"2024-09-11T14:50:08.262083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24510464,"num_objects":374,"num_object_clones":0,"num_object_copies":1122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.362042+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:49:00.362042+0000","last_peered":"2024-09-11T14:49:00.362042+0000","last_clean":"2024-09-11T14:49:00.362042+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:49:00.362042+0000","last_undegraded":"2024-09-11T14:49:00.362042+0000","last_fullsized":"2024-09-11T14:49:00.362042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"84'424","reported_seq":448,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:08.140470+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:50:08.140470+0000","last_peered":"2024-09-11T14:50:08.140470+0000","last_clean":"2024-09-11T14:50:08.140470+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:50:08.140470+0000","last_undegraded":"2024-09-11T14:50:08.140470+0000","last_fullsized":"2024-09-11T14:50:08.140470+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27787264,"num_objects":424,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":27136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.049486+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.049486+0000","last_peered":"2024-09-11T14:49:00.049486+0000","last_clean":"2024-09-11T14:49:00.049486+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:49:00.049486+0000","last_undegraded":"2024-09-11T14:49:00.049486+0000","last_fullsized":"2024-09-11T14:49:00.049486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"84'427","reported_seq":451,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:09.379003+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:50:09.379003+0000","last_peered":"2024-09-11T14:50:09.379003+0000","last_clean":"2024-09-11T14:50:09.379003+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:50:09.379003+0000","last_undegraded":"2024-09-11T14:50:09.379003+0000","last_fullsized":"2024-09-11T14:50:09.379003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27983872,"num_objects":427,"num_object_clones":0,"num_object_copies":1281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.363620+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.363620+0000","last_peered":"2024-09-11T14:49:00.363620+0000","last_clean":"2024-09-11T14:49:00.363620+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:49:00.363620+0000","last_undegraded":"2024-09-11T14:49:00.363620+0000","last_fullsized":"2024-09-11T14:49:00.363620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"84'402","reported_seq":426,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:09.386974+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:50:09.386974+0000","last_peered":"2024-09-11T14:50:09.386974+0000","last_clean":"2024-09-11T14:50:09.386974+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:50:09.386974+0000","last_undegraded":"2024-09-11T14:50:09.386974+0000","last_fullsized":"2024-09-11T14:50:09.386974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26345472,"num_objects":402,"num_object_clones":0,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":25728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.145019+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:49:00.145019+0000","last_peered":"2024-09-11T14:49:00.145019+0000","last_clean":"2024-09-11T14:49:00.145019+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:49:00.145019+0000","last_undegraded":"2024-09-11T14:49:00.145019+0000","last_fullsized":"2024-09-11T14:49:00.145019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":421920768,"num_objects":6438,"num_object_clones":0,"num_object_copies":19314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6438,"num_write_kb":412032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211653918720,"internally_reserved":0,"allocated":2557575168,"data_stored":2557575168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6438,"ondisk_log_size":6438,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211654049792,"internally_reserved":0,"allocated":2557444096,"data_stored":2557444096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52750385152,"internally_reserved":0,"allocated":802488320,"data_stored":802488320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673804,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":779752,"kb_used_data":779752,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51517976,"statfs":{"total":53552873472,"available":52754407424,"internally_reserved":0,"allocated":798466048,"data_stored":798466048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706507,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":463972,"kb_used_data":463972,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51833756,"statfs":{"total":53552873472,"available":53077766144,"internally_reserved":0,"allocated":475107328,"data_stored":475107328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706507,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":562912,"kb_used_data":562912,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51734816,"statfs":{"total":53552873472,"available":52976451584,"internally_reserved":0,"allocated":576421888,"data_stored":576421888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706508,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":673372,"kb_used_data":673372,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51624356,"statfs":{"total":53552873472,"available":52863340544,"internally_reserved":0,"allocated":689532928,"data_stored":689532928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52750385152,"internally_reserved":0,"allocated":802488320,"data_stored":802488320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52969402368,"internally_reserved":0,"allocated":583471104,"data_stored":583471104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52861112320,"internally_reserved":0,"allocated":691761152,"data_stored":691761152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53073281024,"internally_reserved":0,"allocated":479592448,"data_stored":479592448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52750254080,"internally_reserved":0,"allocated":802619392,"data_stored":802619392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":52969402368,"internally_reserved":0,"allocated":583471104,"data_stored":583471104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":52861112320,"internally_reserved":0,"allocated":691761152,"data_stored":691761152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53073281024,"internally_reserved":0,"allocated":479592448,"data_stored":479592448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52750123008,"internally_reserved":0,"allocated":802750464,"data_stored":802750464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:50:15.898 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:50:16.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:16.051+0000 7fcaa326c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:16.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:16.058+0000 7fcaa326c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:18.675 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:50:18.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:18.818+0000 7f589c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:18.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:18.828+0000 7f589c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:19.100 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:50:19.101 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:50:19.101 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:50:19.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:19.264+0000 7fbc57711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:19.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:19.281+0000 7fbc57711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:19.586 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:50:19.586 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:50:19.609 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":505,"stamp":"2024-09-11T14:50:19.404744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":399704651,"num_objects":6095,"num_object_clones":0,"num_object_copies":18285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":7212,"num_write_kb":424149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7186,"ondisk_log_size":7186,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2386044,"kb_used_data":2386044,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206804868,"statfs":{"total":214211493888,"available":211768184832,"internally_reserved":0,"allocated":2443309056,"data_stored":2443309056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4063256,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1103,"num_write_kb":37249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002541"},"pg_stats":[{"pgid":"7.f","version":"84'451","reported_seq":475,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:14.597097+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:50:14.597097+0000","last_peered":"2024-09-11T14:50:14.597097+0000","last_clean":"2024-09-11T14:50:14.597097+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:50:14.597097+0000","last_undegraded":"2024-09-11T14:50:14.597097+0000","last_fullsized":"2024-09-11T14:50:14.597097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26411008,"num_objects":403,"num_object_clones":0,"num_object_copies":1209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"84'472","reported_seq":496,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:18.379961+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:50:18.379961+0000","last_peered":"2024-09-11T14:50:18.379961+0000","last_clean":"2024-09-11T14:50:18.379961+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:50:18.379961+0000","last_undegraded":"2024-09-11T14:50:18.379961+0000","last_fullsized":"2024-09-11T14:50:18.379961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25821184,"num_objects":394,"num_object_clones":0,"num_object_copies":1182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":27712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"84'447","reported_seq":472,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:18.319286+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:50:18.319286+0000","last_peered":"2024-09-11T14:50:18.319286+0000","last_clean":"2024-09-11T14:50:18.319286+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:50:18.319286+0000","last_undegraded":"2024-09-11T14:50:18.319286+0000","last_fullsized":"2024-09-11T14:50:18.319286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855128,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":447,"num_write_kb":25921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"84'436","reported_seq":460,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:17.966147+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:50:17.966147+0000","last_peered":"2024-09-11T14:50:17.966147+0000","last_clean":"2024-09-11T14:50:17.966147+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:50:17.966147+0000","last_undegraded":"2024-09-11T14:50:17.966147+0000","last_fullsized":"2024-09-11T14:50:17.966147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23986176,"num_objects":366,"num_object_clones":0,"num_object_copies":1098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":436,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"84'424","reported_seq":448,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:14.412834+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:50:14.412834+0000","last_peered":"2024-09-11T14:50:14.412834+0000","last_clean":"2024-09-11T14:50:14.412834+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:50:14.412834+0000","last_undegraded":"2024-09-11T14:50:14.412834+0000","last_fullsized":"2024-09-11T14:50:14.412834+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25559040,"num_objects":390,"num_object_clones":0,"num_object_copies":1170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":26048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"84'399","reported_seq":423,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:14.105090+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:50:14.105090+0000","last_peered":"2024-09-11T14:50:14.105090+0000","last_clean":"2024-09-11T14:50:14.105090+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:50:14.105090+0000","last_undegraded":"2024-09-11T14:50:14.105090+0000","last_fullsized":"2024-09-11T14:50:14.105090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23527424,"num_objects":359,"num_object_clones":0,"num_object_copies":1077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"84'457","reported_seq":481,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:18.288541+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:50:18.288541+0000","last_peered":"2024-09-11T14:50:18.288541+0000","last_clean":"2024-09-11T14:50:18.288541+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:50:18.288541+0000","last_undegraded":"2024-09-11T14:50:18.288541+0000","last_fullsized":"2024-09-11T14:50:18.288541+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24576000,"num_objects":375,"num_object_clones":0,"num_object_copies":1125,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"84'468","reported_seq":492,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:17.842718+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:50:17.842718+0000","last_peered":"2024-09-11T14:50:17.842718+0000","last_clean":"2024-09-11T14:50:17.842718+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:50:17.842718+0000","last_undegraded":"2024-09-11T14:50:17.842718+0000","last_fullsized":"2024-09-11T14:50:17.842718+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26214400,"num_objects":400,"num_object_clones":0,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":468,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"84'445","reported_seq":469,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:14.458304+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:50:14.458304+0000","last_peered":"2024-09-11T14:50:14.458304+0000","last_clean":"2024-09-11T14:50:14.458304+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:50:14.458304+0000","last_undegraded":"2024-09-11T14:50:14.458304+0000","last_fullsized":"2024-09-11T14:50:14.458304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25886720,"num_objects":395,"num_object_clones":0,"num_object_copies":1185,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":445,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.038142+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:49:00.038142+0000","last_peered":"2024-09-11T14:49:00.038142+0000","last_clean":"2024-09-11T14:49:00.038142+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:49:00.038142+0000","last_undegraded":"2024-09-11T14:49:00.038142+0000","last_fullsized":"2024-09-11T14:49:00.038142+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":221,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.140082+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:49:00.140082+0000","last_peered":"2024-09-11T14:49:00.140082+0000","last_clean":"2024-09-11T14:49:00.140082+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:49:00.140082+0000","last_undegraded":"2024-09-11T14:49:00.140082+0000","last_fullsized":"2024-09-11T14:49:00.140082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"84'467","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:18.160291+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:50:18.160291+0000","last_peered":"2024-09-11T14:50:18.160291+0000","last_clean":"2024-09-11T14:50:18.160291+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:50:18.160291+0000","last_undegraded":"2024-09-11T14:50:18.160291+0000","last_fullsized":"2024-09-11T14:50:18.160291+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24182784,"num_objects":369,"num_object_clones":0,"num_object_copies":1107,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.999989+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:48:59.999989+0000","last_peered":"2024-09-11T14:48:59.999989+0000","last_clean":"2024-09-11T14:48:59.999989+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:48:59.999989+0000","last_undegraded":"2024-09-11T14:48:59.999989+0000","last_fullsized":"2024-09-11T14:48:59.999989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"84'437","reported_seq":461,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:18.169394+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:50:18.169394+0000","last_peered":"2024-09-11T14:50:18.169394+0000","last_clean":"2024-09-11T14:50:18.169394+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:50:18.169394+0000","last_undegraded":"2024-09-11T14:50:18.169394+0000","last_fullsized":"2024-09-11T14:50:18.169394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":437,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.132805+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:49:00.132805+0000","last_peered":"2024-09-11T14:49:00.132805+0000","last_clean":"2024-09-11T14:49:00.132805+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:49:00.132805+0000","last_undegraded":"2024-09-11T14:49:00.132805+0000","last_fullsized":"2024-09-11T14:49:00.132805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"84'433","reported_seq":457,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:17.669113+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:50:17.669113+0000","last_peered":"2024-09-11T14:50:17.669113+0000","last_clean":"2024-09-11T14:50:17.669113+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:50:17.669113+0000","last_undegraded":"2024-09-11T14:50:17.669113+0000","last_fullsized":"2024-09-11T14:50:17.669113+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24182784,"num_objects":369,"num_object_clones":0,"num_object_copies":1107,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:48:59.994613+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:48:59.994613+0000","last_peered":"2024-09-11T14:48:59.994613+0000","last_clean":"2024-09-11T14:48:59.994613+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:48:59.994613+0000","last_undegraded":"2024-09-11T14:48:59.994613+0000","last_fullsized":"2024-09-11T14:48:59.994613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"84'419","reported_seq":443,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:18.430792+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:50:18.430792+0000","last_peered":"2024-09-11T14:50:18.430792+0000","last_clean":"2024-09-11T14:50:18.430792+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:50:18.430792+0000","last_undegraded":"2024-09-11T14:50:18.430792+0000","last_fullsized":"2024-09-11T14:50:18.430792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22872064,"num_objects":349,"num_object_clones":0,"num_object_copies":1047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.362042+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:49:00.362042+0000","last_peered":"2024-09-11T14:49:00.362042+0000","last_clean":"2024-09-11T14:49:00.362042+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:49:00.362042+0000","last_undegraded":"2024-09-11T14:49:00.362042+0000","last_fullsized":"2024-09-11T14:49:00.362042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"84'485","reported_seq":509,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:18.346167+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:50:18.346167+0000","last_peered":"2024-09-11T14:50:18.346167+0000","last_clean":"2024-09-11T14:50:18.346167+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:50:18.346167+0000","last_undegraded":"2024-09-11T14:50:18.346167+0000","last_fullsized":"2024-09-11T14:50:18.346167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25624576,"num_objects":391,"num_object_clones":0,"num_object_copies":1173,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.049486+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.049486+0000","last_peered":"2024-09-11T14:49:00.049486+0000","last_clean":"2024-09-11T14:49:00.049486+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:49:00.049486+0000","last_undegraded":"2024-09-11T14:49:00.049486+0000","last_fullsized":"2024-09-11T14:49:00.049486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"84'460","reported_seq":484,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:14.590760+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:50:14.590760+0000","last_peered":"2024-09-11T14:50:14.590760+0000","last_clean":"2024-09-11T14:50:14.590760+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:50:14.590760+0000","last_undegraded":"2024-09-11T14:50:14.590760+0000","last_fullsized":"2024-09-11T14:50:14.590760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":460,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.363620+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.363620+0000","last_peered":"2024-09-11T14:49:00.363620+0000","last_clean":"2024-09-11T14:49:00.363620+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:49:00.363620+0000","last_undegraded":"2024-09-11T14:49:00.363620+0000","last_fullsized":"2024-09-11T14:49:00.363620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"84'431","reported_seq":455,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:14.391429+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:50:14.391429+0000","last_peered":"2024-09-11T14:50:14.391429+0000","last_clean":"2024-09-11T14:50:14.391429+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:50:14.391429+0000","last_undegraded":"2024-09-11T14:50:14.391429+0000","last_fullsized":"2024-09-11T14:50:14.391429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25231360,"num_objects":385,"num_object_clones":0,"num_object_copies":1155,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.145019+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:49:00.145019+0000","last_peered":"2024-09-11T14:49:00.145019+0000","last_clean":"2024-09-11T14:49:00.145019+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:49:00.145019+0000","last_undegraded":"2024-09-11T14:49:00.145019+0000","last_fullsized":"2024-09-11T14:49:00.145019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":399114264,"num_objects":6091,"num_object_clones":0,"num_object_copies":18273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7131,"num_write_kb":423041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211791138816,"internally_reserved":0,"allocated":2420355072,"data_stored":2420355072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7131,"ondisk_log_size":7131,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211790876672,"internally_reserved":0,"allocated":2420617216,"data_stored":2420617216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52766941184,"internally_reserved":0,"allocated":785932288,"data_stored":785932288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673809,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":773024,"kb_used_data":773024,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51524704,"statfs":{"total":53552873472,"available":52761296896,"internally_reserved":0,"allocated":791576576,"data_stored":791576576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":442596,"kb_used_data":442596,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51855132,"statfs":{"total":53552873472,"available":53099655168,"internally_reserved":0,"allocated":453218304,"data_stored":453218304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":538108,"kb_used_data":538108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51759620,"statfs":{"total":53552873472,"available":53001850880,"internally_reserved":0,"allocated":551022592,"data_stored":551022592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":632316,"kb_used_data":632316,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51665412,"statfs":{"total":53552873472,"available":52905381888,"internally_reserved":0,"allocated":647491584,"data_stored":647491584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52766941184,"internally_reserved":0,"allocated":785932288,"data_stored":785932288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53010112512,"internally_reserved":0,"allocated":542760960,"data_stored":542760960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52907610112,"internally_reserved":0,"allocated":645263360,"data_stored":645263360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53106081792,"internally_reserved":0,"allocated":446791680,"data_stored":446791680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52767072256,"internally_reserved":0,"allocated":785801216,"data_stored":785801216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53010112512,"internally_reserved":0,"allocated":542760960,"data_stored":542760960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":52907741184,"internally_reserved":0,"allocated":645132288,"data_stored":645132288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53106081792,"internally_reserved":0,"allocated":446791680,"data_stored":446791680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52767203328,"internally_reserved":0,"allocated":785670144,"data_stored":785670144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:50:21.444 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:50:21.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:21.594+0000 7f429f751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:21.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:21.602+0000 7f429f751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:24.124 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:50:24.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:24.288+0000 7f8f5e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:24.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:24.295+0000 7f8f5e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:24.611 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:50:24.612 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:50:24.612 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:50:24.612 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:50:24.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:24.777+0000 7fc6374ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:24.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:24.795+0000 7fc6374ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:24.960 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:50:24.960 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:50:24.960 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:50:24.960 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:50:24.960 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:50:24.960 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:50:24.961 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:50:24.961 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:50:24.961 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:50:24.961 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:50:24.961 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:50:24.961 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:50:24.964 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:50:24.964 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:50:24.964 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:50:25.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:25.142+0000 7fcbffad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:25.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:25.154+0000 7fcbffad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:25.311 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:50:25.311 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:50:25.312 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:50:25.312 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:50:25.312 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:50:25.312 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:50:25.312 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:50:25.312 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:50:25.312 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:50:25.312 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:50:25.312 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:50:25.312 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:50:25.314 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:50:25.315 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:50:25.315 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:50:25.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:25.486+0000 7fc23e911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:25.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:25.504+0000 7fc23e911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:25.540 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:50:25.541 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:50:25.541 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:50:25.541 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:50:25.541 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:50:25.541 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:50:25.541 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:50:25.541 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:50:25.541 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:50:25.541 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:50:25.541 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:50:25.541 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:50:25.545 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:50:25.545 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:50:25.546 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:50:25.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:25.726+0000 7fcc9ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:25.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:25.743+0000 7fcc9ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:25.773 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:50:25.773 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:50:25.774 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:50:25.774 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:50:25.774 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:50:25.774 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:50:25.774 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:50:25.774 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:50:25.774 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:50:25.774 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:50:25.774 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:50:25.774 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:50:25.777 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:50:25.778 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:50:26.724 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:50:26.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:26.871+0000 7f10b9d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:26.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:26.878+0000 7f10b9d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:29.148 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:50:29.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:29.290+0000 7f2e49046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:29.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:29.296+0000 7f2e49046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:30.779 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:50:30.779 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T14:50:30.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:30.963+0000 7f7555b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:30.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:30.983+0000 7f75548af640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:31.440 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T14:50:31.466 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T14:50:31.557 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:50:31.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:31.648+0000 7fcc1a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:31.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:31.667+0000 7fcc1a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:31.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:31.746+0000 7f3345511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:31.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:31.756+0000 7f333ffff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:32.460 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T14:50:32.480 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T14:50:32.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:32.662+0000 7feb0ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:32.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:32.680+0000 7feb0ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:33.461 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T14:50:33.479 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T14:50:33.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:33.615+0000 7f69f5708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:33.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:33.628+0000 7f69f5708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:34.384 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:50:34.468 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T14:50:34.489 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T14:50:34.489 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:50:34.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:34.559+0000 7f950c351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:34.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:34.578+0000 7f950c351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:34.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:34.653+0000 7f82eba7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:34.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:34.664+0000 7f82eba7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:34.985 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:50:34.986 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:50:35.006 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":516,"stamp":"2024-09-11T14:50:34.470329+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":303366731,"num_objects":4625,"num_object_clones":0,"num_object_copies":13875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":8682,"num_write_kb":424149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8656,"ondisk_log_size":8656,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1823220,"kb_used_data":1823220,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207367692,"statfs":{"total":214211493888,"available":212344516608,"internally_reserved":0,"allocated":1866977280,"data_stored":1866977280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-29622272,"num_objects":-452,"num_object_clones":0,"num_object_copies":-1356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":452,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.063374"},"pg_stats":[{"pgid":"7.f","version":"84'541","reported_seq":565,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:29.460472+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:50:29.460472+0000","last_peered":"2024-09-11T14:50:29.460472+0000","last_clean":"2024-09-11T14:50:29.460472+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:50:29.460472+0000","last_undegraded":"2024-09-11T14:50:29.460472+0000","last_fullsized":"2024-09-11T14:50:29.460472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20512768,"num_objects":313,"num_object_clones":0,"num_object_copies":939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"86'576","reported_seq":606,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.180105+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:50:33.180105+0000","last_peered":"2024-09-11T14:50:33.180105+0000","last_clean":"2024-09-11T14:50:33.180105+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:50:33.180105+0000","last_undegraded":"2024-09-11T14:50:33.180105+0000","last_fullsized":"2024-09-11T14:50:33.180105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19005440,"num_objects":290,"num_object_clones":0,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":27712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"86'549","reported_seq":580,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.107060+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:50:33.107060+0000","last_peered":"2024-09-11T14:50:33.107060+0000","last_clean":"2024-09-11T14:50:33.107060+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:50:33.107060+0000","last_undegraded":"2024-09-11T14:50:33.107060+0000","last_fullsized":"2024-09-11T14:50:33.107060+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17170456,"num_objects":263,"num_object_clones":0,"num_object_copies":789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":549,"num_write_kb":25921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"86'525","reported_seq":555,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.363228+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:50:33.363228+0000","last_peered":"2024-09-11T14:50:33.363228+0000","last_clean":"2024-09-11T14:50:33.363228+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:50:33.363228+0000","last_undegraded":"2024-09-11T14:50:33.363228+0000","last_fullsized":"2024-09-11T14:50:33.363228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18153472,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"84'516","reported_seq":540,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:29.450697+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:50:29.450697+0000","last_peered":"2024-09-11T14:50:29.450697+0000","last_clean":"2024-09-11T14:50:29.450697+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:50:29.450697+0000","last_undegraded":"2024-09-11T14:50:29.450697+0000","last_fullsized":"2024-09-11T14:50:29.450697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19529728,"num_objects":298,"num_object_clones":0,"num_object_copies":894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":516,"num_write_kb":26048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"84'489","reported_seq":513,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:29.291663+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:50:29.291663+0000","last_peered":"2024-09-11T14:50:29.291663+0000","last_clean":"2024-09-11T14:50:29.291663+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:50:29.291663+0000","last_undegraded":"2024-09-11T14:50:29.291663+0000","last_fullsized":"2024-09-11T14:50:29.291663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"86'530","reported_seq":560,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.369822+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:50:33.369822+0000","last_peered":"2024-09-11T14:50:33.369822+0000","last_clean":"2024-09-11T14:50:33.369822+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:50:33.369822+0000","last_undegraded":"2024-09-11T14:50:33.369822+0000","last_fullsized":"2024-09-11T14:50:33.369822+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19791872,"num_objects":302,"num_object_clones":0,"num_object_copies":906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":530,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"86'572","reported_seq":602,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.599622+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:50:32.599622+0000","last_peered":"2024-09-11T14:50:32.599622+0000","last_clean":"2024-09-11T14:50:32.599622+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:50:32.599622+0000","last_undegraded":"2024-09-11T14:50:32.599622+0000","last_fullsized":"2024-09-11T14:50:32.599622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19398656,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":572,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"84'545","reported_seq":569,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:29.364978+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:50:29.364978+0000","last_peered":"2024-09-11T14:50:29.364978+0000","last_clean":"2024-09-11T14:50:29.364978+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:50:29.364978+0000","last_undegraded":"2024-09-11T14:50:29.364978+0000","last_fullsized":"2024-09-11T14:50:29.364978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333120,"num_objects":295,"num_object_clones":0,"num_object_copies":885,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.038142+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:49:00.038142+0000","last_peered":"2024-09-11T14:49:00.038142+0000","last_clean":"2024-09-11T14:49:00.038142+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:49:00.038142+0000","last_undegraded":"2024-09-11T14:49:00.038142+0000","last_fullsized":"2024-09-11T14:49:00.038142+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":227,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.598220+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:50:32.598220+0000","last_peered":"2024-09-11T14:50:32.598220+0000","last_clean":"2024-09-11T14:50:32.598220+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:50:32.598220+0000","last_undegraded":"2024-09-11T14:50:32.598220+0000","last_fullsized":"2024-09-11T14:50:32.598220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"86'541","reported_seq":571,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.118349+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:50:33.118349+0000","last_peered":"2024-09-11T14:50:33.118349+0000","last_clean":"2024-09-11T14:50:33.118349+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:50:33.118349+0000","last_undegraded":"2024-09-11T14:50:33.118349+0000","last_fullsized":"2024-09-11T14:50:33.118349+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333120,"num_objects":295,"num_object_clones":0,"num_object_copies":885,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":226,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.534405+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:50:32.534405+0000","last_peered":"2024-09-11T14:50:32.534405+0000","last_clean":"2024-09-11T14:50:32.534405+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:50:32.534405+0000","last_undegraded":"2024-09-11T14:50:32.534405+0000","last_fullsized":"2024-09-11T14:50:32.534405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"86'519","reported_seq":549,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.826330+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:50:32.826330+0000","last_peered":"2024-09-11T14:50:32.826330+0000","last_clean":"2024-09-11T14:50:32.826330+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:50:32.826330+0000","last_undegraded":"2024-09-11T14:50:32.826330+0000","last_fullsized":"2024-09-11T14:50:32.826330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":519,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":226,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.593531+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:50:32.593531+0000","last_peered":"2024-09-11T14:50:32.593531+0000","last_clean":"2024-09-11T14:50:32.593531+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:50:32.593531+0000","last_undegraded":"2024-09-11T14:50:32.593531+0000","last_fullsized":"2024-09-11T14:50:32.593531+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"86'520","reported_seq":550,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.082198+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:50:33.082198+0000","last_peered":"2024-09-11T14:50:33.082198+0000","last_clean":"2024-09-11T14:50:33.082198+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:50:33.082198+0000","last_undegraded":"2024-09-11T14:50:33.082198+0000","last_fullsized":"2024-09-11T14:50:33.082198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18481152,"num_objects":282,"num_object_clones":0,"num_object_copies":846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":228,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.526600+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:50:32.526600+0000","last_peered":"2024-09-11T14:50:32.526600+0000","last_clean":"2024-09-11T14:50:32.526600+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:50:32.526600+0000","last_undegraded":"2024-09-11T14:50:32.526600+0000","last_fullsized":"2024-09-11T14:50:32.526600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"86'510","reported_seq":540,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.291451+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:50:33.291451+0000","last_peered":"2024-09-11T14:50:33.291451+0000","last_clean":"2024-09-11T14:50:33.291451+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:50:33.291451+0000","last_undegraded":"2024-09-11T14:50:33.291451+0000","last_fullsized":"2024-09-11T14:50:33.291451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":510,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":226,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.676643+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:50:32.676643+0000","last_peered":"2024-09-11T14:50:32.676643+0000","last_clean":"2024-09-11T14:50:32.676643+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:50:32.676643+0000","last_undegraded":"2024-09-11T14:50:32.676643+0000","last_fullsized":"2024-09-11T14:50:32.676643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"86'587","reported_seq":617,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.047907+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:50:33.047907+0000","last_peered":"2024-09-11T14:50:33.047907+0000","last_clean":"2024-09-11T14:50:33.047907+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:50:33.047907+0000","last_undegraded":"2024-09-11T14:50:33.047907+0000","last_fullsized":"2024-09-11T14:50:33.047907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18939904,"num_objects":289,"num_object_clones":0,"num_object_copies":867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:49:00.049486+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:49:00.049486+0000","last_peered":"2024-09-11T14:49:00.049486+0000","last_clean":"2024-09-11T14:49:00.049486+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:49:00.049486+0000","last_undegraded":"2024-09-11T14:49:00.049486+0000","last_fullsized":"2024-09-11T14:49:00.049486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"84'567","reported_seq":591,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:29.421547+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:50:29.421547+0000","last_peered":"2024-09-11T14:50:29.421547+0000","last_clean":"2024-09-11T14:50:29.421547+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:50:29.421547+0000","last_undegraded":"2024-09-11T14:50:29.421547+0000","last_fullsized":"2024-09-11T14:50:29.421547+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":567,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":226,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.677083+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:50:32.677083+0000","last_peered":"2024-09-11T14:50:32.677083+0000","last_clean":"2024-09-11T14:50:32.677083+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:50:32.677083+0000","last_undegraded":"2024-09-11T14:50:32.677083+0000","last_fullsized":"2024-09-11T14:50:32.677083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"84'514","reported_seq":538,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-11T14:50:29.473271+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:50:29.473271+0000","last_peered":"2024-09-11T14:50:29.473271+0000","last_clean":"2024-09-11T14:50:29.473271+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:50:29.473271+0000","last_undegraded":"2024-09-11T14:50:29.473271+0000","last_fullsized":"2024-09-11T14:50:29.473271+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19791872,"num_objects":302,"num_object_clones":0,"num_object_copies":906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":514,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":226,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.596252+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:50:32.596252+0000","last_peered":"2024-09-11T14:50:32.596252+0000","last_clean":"2024-09-11T14:50:32.596252+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:50:32.596252+0000","last_undegraded":"2024-09-11T14:50:32.596252+0000","last_fullsized":"2024-09-11T14:50:32.596252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":302776344,"num_objects":4621,"num_object_clones":0,"num_object_copies":13863,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8601,"num_write_kb":423041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212363165696,"internally_reserved":0,"allocated":1848328192,"data_stored":1848328192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8601,"ondisk_log_size":8601,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212363165696,"internally_reserved":0,"allocated":1848328192,"data_stored":1848328192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52951363584,"internally_reserved":0,"allocated":601509888,"data_stored":601509888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673824,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":592660,"kb_used_data":592660,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51705068,"statfs":{"total":53552873472,"available":52945989632,"internally_reserved":0,"allocated":606883840,"data_stored":606883840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":338092,"kb_used_data":338092,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51959636,"statfs":{"total":53552873472,"available":53206667264,"internally_reserved":0,"allocated":346206208,"data_stored":346206208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":408556,"kb_used_data":408556,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51889172,"statfs":{"total":53552873472,"available":53134512128,"internally_reserved":0,"allocated":418361344,"data_stored":418361344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":483912,"kb_used_data":483912,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51813816,"statfs":{"total":53552873472,"available":53057347584,"internally_reserved":0,"allocated":495525888,"data_stored":495525888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52951363584,"internally_reserved":0,"allocated":601509888,"data_stored":601509888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53139914752,"internally_reserved":0,"allocated":412958720,"data_stored":412958720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53059579904,"internally_reserved":0,"allocated":493293568,"data_stored":493293568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53212307456,"internally_reserved":0,"allocated":340566016,"data_stored":340566016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52951363584,"internally_reserved":0,"allocated":601509888,"data_stored":601509888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53139914752,"internally_reserved":0,"allocated":412958720,"data_stored":412958720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53059579904,"internally_reserved":0,"allocated":493293568,"data_stored":493293568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53212307456,"internally_reserved":0,"allocated":340566016,"data_stored":340566016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52951363584,"internally_reserved":0,"allocated":601509888,"data_stored":601509888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:50:35.008 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:50:35.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:35.168+0000 7fc0c8f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:35.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:35.183+0000 7fc0c8f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:35.428 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:50:35.428 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:50:35.443 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":517,"stamp":"2024-09-11T14:50:35.408252+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":293995083,"num_objects":4482,"num_object_clones":0,"num_object_copies":13446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":8825,"num_write_kb":424149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8799,"ondisk_log_size":8799,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1775360,"kb_used_data":1775360,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207415552,"statfs":{"total":214211493888,"available":212393525248,"internally_reserved":0,"allocated":1817968640,"data_stored":1817968640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28114944,"num_objects":-429,"num_object_clones":0,"num_object_copies":-1287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000794"},"pg_stats":[{"pgid":"7.f","version":"88'569","reported_seq":605,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T14:50:34.561046+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:50:34.561046+0000","last_peered":"2024-09-11T14:50:34.561046+0000","last_clean":"2024-09-11T14:50:34.561046+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:50:34.561046+0000","last_undegraded":"2024-09-11T14:50:34.561046+0000","last_fullsized":"2024-09-11T14:50:34.561046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18677760,"num_objects":285,"num_object_clones":0,"num_object_copies":855,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":569,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"86'576","reported_seq":606,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.180105+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:50:33.180105+0000","last_peered":"2024-09-11T14:50:33.180105+0000","last_clean":"2024-09-11T14:50:33.180105+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:50:33.180105+0000","last_undegraded":"2024-09-11T14:50:33.180105+0000","last_fullsized":"2024-09-11T14:50:33.180105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19005440,"num_objects":290,"num_object_clones":0,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":27712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"86'549","reported_seq":580,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.107060+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:50:33.107060+0000","last_peered":"2024-09-11T14:50:33.107060+0000","last_clean":"2024-09-11T14:50:33.107060+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:50:33.107060+0000","last_undegraded":"2024-09-11T14:50:33.107060+0000","last_fullsized":"2024-09-11T14:50:33.107060+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17170456,"num_objects":263,"num_object_clones":0,"num_object_copies":789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":549,"num_write_kb":25921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"86'525","reported_seq":555,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.363228+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:50:33.363228+0000","last_peered":"2024-09-11T14:50:33.363228+0000","last_clean":"2024-09-11T14:50:33.363228+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:50:33.363228+0000","last_undegraded":"2024-09-11T14:50:33.363228+0000","last_fullsized":"2024-09-11T14:50:33.363228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18153472,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"88'540","reported_seq":576,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T14:50:34.653609+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:50:34.653609+0000","last_peered":"2024-09-11T14:50:34.653609+0000","last_clean":"2024-09-11T14:50:34.653609+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:50:34.653609+0000","last_undegraded":"2024-09-11T14:50:34.653609+0000","last_fullsized":"2024-09-11T14:50:34.653609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17956864,"num_objects":274,"num_object_clones":0,"num_object_copies":822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":26048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"87'511","reported_seq":547,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T14:50:34.521772+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:50:34.521772+0000","last_peered":"2024-09-11T14:50:34.521772+0000","last_clean":"2024-09-11T14:50:34.521772+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:50:34.521772+0000","last_undegraded":"2024-09-11T14:50:34.521772+0000","last_fullsized":"2024-09-11T14:50:34.521772+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16187392,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":511,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"86'530","reported_seq":560,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.369822+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:50:33.369822+0000","last_peered":"2024-09-11T14:50:33.369822+0000","last_clean":"2024-09-11T14:50:33.369822+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:50:33.369822+0000","last_undegraded":"2024-09-11T14:50:33.369822+0000","last_fullsized":"2024-09-11T14:50:33.369822+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19791872,"num_objects":302,"num_object_clones":0,"num_object_copies":906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":530,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"86'572","reported_seq":602,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.599622+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:50:32.599622+0000","last_peered":"2024-09-11T14:50:32.599622+0000","last_clean":"2024-09-11T14:50:32.599622+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:50:32.599622+0000","last_undegraded":"2024-09-11T14:50:32.599622+0000","last_fullsized":"2024-09-11T14:50:32.599622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19398656,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":572,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"87'563","reported_seq":599,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T14:50:34.522623+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:50:34.522623+0000","last_peered":"2024-09-11T14:50:34.522623+0000","last_clean":"2024-09-11T14:50:34.522623+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:50:34.522623+0000","last_undegraded":"2024-09-11T14:50:34.522623+0000","last_fullsized":"2024-09-11T14:50:34.522623+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18153472,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":563,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":304,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T14:50:34.513153+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:50:34.513153+0000","last_peered":"2024-09-11T14:50:34.513153+0000","last_clean":"2024-09-11T14:50:34.513153+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:50:34.513153+0000","last_undegraded":"2024-09-11T14:50:34.513153+0000","last_fullsized":"2024-09-11T14:50:34.513153+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":227,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.598220+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:50:32.598220+0000","last_peered":"2024-09-11T14:50:32.598220+0000","last_clean":"2024-09-11T14:50:32.598220+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:50:32.598220+0000","last_undegraded":"2024-09-11T14:50:32.598220+0000","last_fullsized":"2024-09-11T14:50:32.598220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"86'541","reported_seq":571,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.118349+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:50:33.118349+0000","last_peered":"2024-09-11T14:50:33.118349+0000","last_clean":"2024-09-11T14:50:33.118349+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:50:33.118349+0000","last_undegraded":"2024-09-11T14:50:33.118349+0000","last_fullsized":"2024-09-11T14:50:33.118349+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333120,"num_objects":295,"num_object_clones":0,"num_object_copies":885,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":226,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.534405+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:50:32.534405+0000","last_peered":"2024-09-11T14:50:32.534405+0000","last_clean":"2024-09-11T14:50:32.534405+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:50:32.534405+0000","last_undegraded":"2024-09-11T14:50:32.534405+0000","last_fullsized":"2024-09-11T14:50:32.534405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"86'519","reported_seq":549,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.826330+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:50:32.826330+0000","last_peered":"2024-09-11T14:50:32.826330+0000","last_clean":"2024-09-11T14:50:32.826330+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:50:32.826330+0000","last_undegraded":"2024-09-11T14:50:32.826330+0000","last_fullsized":"2024-09-11T14:50:32.826330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":519,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":226,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.593531+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:50:32.593531+0000","last_peered":"2024-09-11T14:50:32.593531+0000","last_clean":"2024-09-11T14:50:32.593531+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:50:32.593531+0000","last_undegraded":"2024-09-11T14:50:32.593531+0000","last_fullsized":"2024-09-11T14:50:32.593531+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"86'520","reported_seq":550,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.082198+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:50:33.082198+0000","last_peered":"2024-09-11T14:50:33.082198+0000","last_clean":"2024-09-11T14:50:33.082198+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:50:33.082198+0000","last_undegraded":"2024-09-11T14:50:33.082198+0000","last_fullsized":"2024-09-11T14:50:33.082198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18481152,"num_objects":282,"num_object_clones":0,"num_object_copies":846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":228,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.526600+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:50:32.526600+0000","last_peered":"2024-09-11T14:50:32.526600+0000","last_clean":"2024-09-11T14:50:32.526600+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:50:32.526600+0000","last_undegraded":"2024-09-11T14:50:32.526600+0000","last_fullsized":"2024-09-11T14:50:32.526600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"86'510","reported_seq":540,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.291451+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:50:33.291451+0000","last_peered":"2024-09-11T14:50:33.291451+0000","last_clean":"2024-09-11T14:50:33.291451+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:50:33.291451+0000","last_undegraded":"2024-09-11T14:50:33.291451+0000","last_fullsized":"2024-09-11T14:50:33.291451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":510,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":226,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.676643+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:50:32.676643+0000","last_peered":"2024-09-11T14:50:32.676643+0000","last_clean":"2024-09-11T14:50:32.676643+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:50:32.676643+0000","last_undegraded":"2024-09-11T14:50:32.676643+0000","last_fullsized":"2024-09-11T14:50:32.676643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"86'587","reported_seq":617,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.047907+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:50:33.047907+0000","last_peered":"2024-09-11T14:50:33.047907+0000","last_clean":"2024-09-11T14:50:33.047907+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:50:33.047907+0000","last_undegraded":"2024-09-11T14:50:33.047907+0000","last_fullsized":"2024-09-11T14:50:33.047907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18939904,"num_objects":289,"num_object_clones":0,"num_object_copies":867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T14:50:34.521932+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:50:34.521932+0000","last_peered":"2024-09-11T14:50:34.521932+0000","last_clean":"2024-09-11T14:50:34.521932+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:50:34.521932+0000","last_undegraded":"2024-09-11T14:50:34.521932+0000","last_fullsized":"2024-09-11T14:50:34.521932+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"88'594","reported_seq":630,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T14:50:34.516278+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:50:34.516278+0000","last_peered":"2024-09-11T14:50:34.516278+0000","last_clean":"2024-09-11T14:50:34.516278+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:50:34.516278+0000","last_undegraded":"2024-09-11T14:50:34.516278+0000","last_fullsized":"2024-09-11T14:50:34.516278+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18481152,"num_objects":282,"num_object_clones":0,"num_object_copies":846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":594,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":226,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.677083+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:50:32.677083+0000","last_peered":"2024-09-11T14:50:32.677083+0000","last_clean":"2024-09-11T14:50:32.677083+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:50:32.677083+0000","last_undegraded":"2024-09-11T14:50:32.677083+0000","last_fullsized":"2024-09-11T14:50:32.677083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"87'538","reported_seq":574,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T14:50:34.523365+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:50:34.523365+0000","last_peered":"2024-09-11T14:50:34.523365+0000","last_clean":"2024-09-11T14:50:34.523365+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:50:34.523365+0000","last_undegraded":"2024-09-11T14:50:34.523365+0000","last_fullsized":"2024-09-11T14:50:34.523365+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18219008,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":226,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.596252+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:50:32.596252+0000","last_peered":"2024-09-11T14:50:32.596252+0000","last_clean":"2024-09-11T14:50:32.596252+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:50:32.596252+0000","last_undegraded":"2024-09-11T14:50:32.596252+0000","last_fullsized":"2024-09-11T14:50:32.596252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":293404696,"num_objects":4478,"num_object_clones":0,"num_object_copies":13434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8744,"num_write_kb":423041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212411793408,"internally_reserved":0,"allocated":1799700480,"data_stored":1799700480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8744,"ondisk_log_size":8744,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212411793408,"internally_reserved":0,"allocated":1799700480,"data_stored":1799700480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52999860224,"internally_reserved":0,"allocated":553013248,"data_stored":553013248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":544800,"kb_used_data":544800,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51752928,"statfs":{"total":53552873472,"available":52994998272,"internally_reserved":0,"allocated":557875200,"data_stored":557875200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":338092,"kb_used_data":338092,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51959636,"statfs":{"total":53552873472,"available":53206667264,"internally_reserved":0,"allocated":346206208,"data_stored":346206208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":408556,"kb_used_data":408556,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51889172,"statfs":{"total":53552873472,"available":53134512128,"internally_reserved":0,"allocated":418361344,"data_stored":418361344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":483912,"kb_used_data":483912,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51813816,"statfs":{"total":53552873472,"available":53057347584,"internally_reserved":0,"allocated":495525888,"data_stored":495525888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52999860224,"internally_reserved":0,"allocated":553013248,"data_stored":553013248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53139914752,"internally_reserved":0,"allocated":412958720,"data_stored":412958720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53059579904,"internally_reserved":0,"allocated":493293568,"data_stored":493293568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53212307456,"internally_reserved":0,"allocated":340566016,"data_stored":340566016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52999991296,"internally_reserved":0,"allocated":552882176,"data_stored":552882176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53139914752,"internally_reserved":0,"allocated":412958720,"data_stored":412958720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53059579904,"internally_reserved":0,"allocated":493293568,"data_stored":493293568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53212307456,"internally_reserved":0,"allocated":340566016,"data_stored":340566016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52999991296,"internally_reserved":0,"allocated":552882176,"data_stored":552882176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:50:35.445 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T14:50:35.445 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:50:35.445 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:50:35.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:35.616+0000 7f4e84d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:35.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:35.630+0000 7f4e84d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:35.944 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:50:35.944 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:50:35.969 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":517,"stamp":"2024-09-11T14:50:35.408252+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":293995083,"num_objects":4482,"num_object_clones":0,"num_object_copies":13446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":8825,"num_write_kb":424149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8799,"ondisk_log_size":8799,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1775360,"kb_used_data":1775360,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207415552,"statfs":{"total":214211493888,"available":212393525248,"internally_reserved":0,"allocated":1817968640,"data_stored":1817968640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28114944,"num_objects":-429,"num_object_clones":0,"num_object_copies":-1287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000794"},"pg_stats":[{"pgid":"7.f","version":"88'569","reported_seq":605,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T14:50:34.561046+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:50:34.561046+0000","last_peered":"2024-09-11T14:50:34.561046+0000","last_clean":"2024-09-11T14:50:34.561046+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:50:34.561046+0000","last_undegraded":"2024-09-11T14:50:34.561046+0000","last_fullsized":"2024-09-11T14:50:34.561046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18677760,"num_objects":285,"num_object_clones":0,"num_object_copies":855,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":569,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"86'576","reported_seq":606,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.180105+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:50:33.180105+0000","last_peered":"2024-09-11T14:50:33.180105+0000","last_clean":"2024-09-11T14:50:33.180105+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:50:33.180105+0000","last_undegraded":"2024-09-11T14:50:33.180105+0000","last_fullsized":"2024-09-11T14:50:33.180105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19005440,"num_objects":290,"num_object_clones":0,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":27712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"86'549","reported_seq":580,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.107060+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:50:33.107060+0000","last_peered":"2024-09-11T14:50:33.107060+0000","last_clean":"2024-09-11T14:50:33.107060+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:50:33.107060+0000","last_undegraded":"2024-09-11T14:50:33.107060+0000","last_fullsized":"2024-09-11T14:50:33.107060+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17170456,"num_objects":263,"num_object_clones":0,"num_object_copies":789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":549,"num_write_kb":25921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"86'525","reported_seq":555,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.363228+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:50:33.363228+0000","last_peered":"2024-09-11T14:50:33.363228+0000","last_clean":"2024-09-11T14:50:33.363228+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:50:33.363228+0000","last_undegraded":"2024-09-11T14:50:33.363228+0000","last_fullsized":"2024-09-11T14:50:33.363228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18153472,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"88'540","reported_seq":576,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T14:50:34.653609+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:50:34.653609+0000","last_peered":"2024-09-11T14:50:34.653609+0000","last_clean":"2024-09-11T14:50:34.653609+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:50:34.653609+0000","last_undegraded":"2024-09-11T14:50:34.653609+0000","last_fullsized":"2024-09-11T14:50:34.653609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17956864,"num_objects":274,"num_object_clones":0,"num_object_copies":822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":26048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"87'511","reported_seq":547,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T14:50:34.521772+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:50:34.521772+0000","last_peered":"2024-09-11T14:50:34.521772+0000","last_clean":"2024-09-11T14:50:34.521772+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:50:34.521772+0000","last_undegraded":"2024-09-11T14:50:34.521772+0000","last_fullsized":"2024-09-11T14:50:34.521772+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16187392,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":511,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"86'530","reported_seq":560,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.369822+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:50:33.369822+0000","last_peered":"2024-09-11T14:50:33.369822+0000","last_clean":"2024-09-11T14:50:33.369822+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:50:33.369822+0000","last_undegraded":"2024-09-11T14:50:33.369822+0000","last_fullsized":"2024-09-11T14:50:33.369822+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19791872,"num_objects":302,"num_object_clones":0,"num_object_copies":906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":530,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"86'572","reported_seq":602,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.599622+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:50:32.599622+0000","last_peered":"2024-09-11T14:50:32.599622+0000","last_clean":"2024-09-11T14:50:32.599622+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:50:32.599622+0000","last_undegraded":"2024-09-11T14:50:32.599622+0000","last_fullsized":"2024-09-11T14:50:32.599622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19398656,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":572,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"87'563","reported_seq":599,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T14:50:34.522623+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:50:34.522623+0000","last_peered":"2024-09-11T14:50:34.522623+0000","last_clean":"2024-09-11T14:50:34.522623+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:50:34.522623+0000","last_undegraded":"2024-09-11T14:50:34.522623+0000","last_fullsized":"2024-09-11T14:50:34.522623+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18153472,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":563,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":304,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T14:50:34.513153+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:50:34.513153+0000","last_peered":"2024-09-11T14:50:34.513153+0000","last_clean":"2024-09-11T14:50:34.513153+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:50:34.513153+0000","last_undegraded":"2024-09-11T14:50:34.513153+0000","last_fullsized":"2024-09-11T14:50:34.513153+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":227,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.598220+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:50:32.598220+0000","last_peered":"2024-09-11T14:50:32.598220+0000","last_clean":"2024-09-11T14:50:32.598220+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:50:32.598220+0000","last_undegraded":"2024-09-11T14:50:32.598220+0000","last_fullsized":"2024-09-11T14:50:32.598220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"86'541","reported_seq":571,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.118349+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:50:33.118349+0000","last_peered":"2024-09-11T14:50:33.118349+0000","last_clean":"2024-09-11T14:50:33.118349+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:50:33.118349+0000","last_undegraded":"2024-09-11T14:50:33.118349+0000","last_fullsized":"2024-09-11T14:50:33.118349+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333120,"num_objects":295,"num_object_clones":0,"num_object_copies":885,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":226,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.534405+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:50:32.534405+0000","last_peered":"2024-09-11T14:50:32.534405+0000","last_clean":"2024-09-11T14:50:32.534405+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:50:32.534405+0000","last_undegraded":"2024-09-11T14:50:32.534405+0000","last_fullsized":"2024-09-11T14:50:32.534405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"86'519","reported_seq":549,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.826330+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:50:32.826330+0000","last_peered":"2024-09-11T14:50:32.826330+0000","last_clean":"2024-09-11T14:50:32.826330+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:50:32.826330+0000","last_undegraded":"2024-09-11T14:50:32.826330+0000","last_fullsized":"2024-09-11T14:50:32.826330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":519,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":226,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.593531+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:50:32.593531+0000","last_peered":"2024-09-11T14:50:32.593531+0000","last_clean":"2024-09-11T14:50:32.593531+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:50:32.593531+0000","last_undegraded":"2024-09-11T14:50:32.593531+0000","last_fullsized":"2024-09-11T14:50:32.593531+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"86'520","reported_seq":550,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.082198+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:50:33.082198+0000","last_peered":"2024-09-11T14:50:33.082198+0000","last_clean":"2024-09-11T14:50:33.082198+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:50:33.082198+0000","last_undegraded":"2024-09-11T14:50:33.082198+0000","last_fullsized":"2024-09-11T14:50:33.082198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18481152,"num_objects":282,"num_object_clones":0,"num_object_copies":846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":228,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.526600+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:50:32.526600+0000","last_peered":"2024-09-11T14:50:32.526600+0000","last_clean":"2024-09-11T14:50:32.526600+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:50:32.526600+0000","last_undegraded":"2024-09-11T14:50:32.526600+0000","last_fullsized":"2024-09-11T14:50:32.526600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"86'510","reported_seq":540,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.291451+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:50:33.291451+0000","last_peered":"2024-09-11T14:50:33.291451+0000","last_clean":"2024-09-11T14:50:33.291451+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:50:33.291451+0000","last_undegraded":"2024-09-11T14:50:33.291451+0000","last_fullsized":"2024-09-11T14:50:33.291451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":510,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":226,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.676643+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:50:32.676643+0000","last_peered":"2024-09-11T14:50:32.676643+0000","last_clean":"2024-09-11T14:50:32.676643+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:50:32.676643+0000","last_undegraded":"2024-09-11T14:50:32.676643+0000","last_fullsized":"2024-09-11T14:50:32.676643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"86'587","reported_seq":617,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:33.047907+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:50:33.047907+0000","last_peered":"2024-09-11T14:50:33.047907+0000","last_clean":"2024-09-11T14:50:33.047907+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:50:33.047907+0000","last_undegraded":"2024-09-11T14:50:33.047907+0000","last_fullsized":"2024-09-11T14:50:33.047907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18939904,"num_objects":289,"num_object_clones":0,"num_object_copies":867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T14:50:34.521932+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:50:34.521932+0000","last_peered":"2024-09-11T14:50:34.521932+0000","last_clean":"2024-09-11T14:50:34.521932+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:50:34.521932+0000","last_undegraded":"2024-09-11T14:50:34.521932+0000","last_fullsized":"2024-09-11T14:50:34.521932+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"88'594","reported_seq":630,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T14:50:34.516278+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:50:34.516278+0000","last_peered":"2024-09-11T14:50:34.516278+0000","last_clean":"2024-09-11T14:50:34.516278+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:50:34.516278+0000","last_undegraded":"2024-09-11T14:50:34.516278+0000","last_fullsized":"2024-09-11T14:50:34.516278+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18481152,"num_objects":282,"num_object_clones":0,"num_object_copies":846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":594,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":226,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.677083+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:50:32.677083+0000","last_peered":"2024-09-11T14:50:32.677083+0000","last_clean":"2024-09-11T14:50:32.677083+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:50:32.677083+0000","last_undegraded":"2024-09-11T14:50:32.677083+0000","last_fullsized":"2024-09-11T14:50:32.677083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"87'538","reported_seq":574,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T14:50:34.523365+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:50:34.523365+0000","last_peered":"2024-09-11T14:50:34.523365+0000","last_clean":"2024-09-11T14:50:34.523365+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:50:34.523365+0000","last_undegraded":"2024-09-11T14:50:34.523365+0000","last_fullsized":"2024-09-11T14:50:34.523365+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18219008,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":226,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T14:50:32.596252+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:50:32.596252+0000","last_peered":"2024-09-11T14:50:32.596252+0000","last_clean":"2024-09-11T14:50:32.596252+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:50:32.596252+0000","last_undegraded":"2024-09-11T14:50:32.596252+0000","last_fullsized":"2024-09-11T14:50:32.596252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":293404696,"num_objects":4478,"num_object_clones":0,"num_object_copies":13434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8744,"num_write_kb":423041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212411793408,"internally_reserved":0,"allocated":1799700480,"data_stored":1799700480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8744,"ondisk_log_size":8744,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212411793408,"internally_reserved":0,"allocated":1799700480,"data_stored":1799700480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52999860224,"internally_reserved":0,"allocated":553013248,"data_stored":553013248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":544800,"kb_used_data":544800,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51752928,"statfs":{"total":53552873472,"available":52994998272,"internally_reserved":0,"allocated":557875200,"data_stored":557875200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":338092,"kb_used_data":338092,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51959636,"statfs":{"total":53552873472,"available":53206667264,"internally_reserved":0,"allocated":346206208,"data_stored":346206208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":408556,"kb_used_data":408556,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51889172,"statfs":{"total":53552873472,"available":53134512128,"internally_reserved":0,"allocated":418361344,"data_stored":418361344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":483912,"kb_used_data":483912,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51813816,"statfs":{"total":53552873472,"available":53057347584,"internally_reserved":0,"allocated":495525888,"data_stored":495525888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52999860224,"internally_reserved":0,"allocated":553013248,"data_stored":553013248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53139914752,"internally_reserved":0,"allocated":412958720,"data_stored":412958720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53059579904,"internally_reserved":0,"allocated":493293568,"data_stored":493293568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53212307456,"internally_reserved":0,"allocated":340566016,"data_stored":340566016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52999991296,"internally_reserved":0,"allocated":552882176,"data_stored":552882176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53139914752,"internally_reserved":0,"allocated":412958720,"data_stored":412958720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53059579904,"internally_reserved":0,"allocated":493293568,"data_stored":493293568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53212307456,"internally_reserved":0,"allocated":340566016,"data_stored":340566016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52999991296,"internally_reserved":0,"allocated":552882176,"data_stored":552882176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:50:37.068 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:50:37.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:37.192+0000 7f7f1267d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:37.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:37.199+0000 7f7f1267d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:39.551 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:50:39.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:39.677+0000 7f4f77391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:39.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:39.684+0000 7f4f77391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:40.972 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:50:40.972 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:50:40.972 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:50:41.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:41.124+0000 7f9a1ccfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:41.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:41.138+0000 7f9a1ccfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:41.510 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:50:41.512 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:50:41.537 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":521,"stamp":"2024-09-11T14:50:41.409449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":270533195,"num_objects":4124,"num_object_clones":0,"num_object_copies":12372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":9183,"num_write_kb":424149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9157,"ondisk_log_size":9157,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1631900,"kb_used_data":1631900,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207559012,"statfs":{"total":214211493888,"available":212540428288,"internally_reserved":0,"allocated":1671065600,"data_stored":1671065600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-43778048,"num_objects":-668,"num_object_clones":0,"num_object_copies":-2004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":668,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.947787"},"pg_stats":[{"pgid":"7.f","version":"89'591","reported_seq":630,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:38.381128+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:50:38.381128+0000","last_peered":"2024-09-11T14:50:38.381128+0000","last_clean":"2024-09-11T14:50:38.381128+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:50:38.381128+0000","last_undegraded":"2024-09-11T14:50:38.381128+0000","last_fullsized":"2024-09-11T14:50:38.381128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17235968,"num_objects":263,"num_object_clones":0,"num_object_copies":789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":591,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"89'594","reported_seq":633,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:37.961069+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:50:37.961069+0000","last_peered":"2024-09-11T14:50:37.961069+0000","last_clean":"2024-09-11T14:50:37.961069+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:50:37.961069+0000","last_undegraded":"2024-09-11T14:50:37.961069+0000","last_fullsized":"2024-09-11T14:50:37.961069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17825792,"num_objects":272,"num_object_clones":0,"num_object_copies":816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":594,"num_write_kb":27712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"89'571","reported_seq":611,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:37.918859+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:50:37.918859+0000","last_peered":"2024-09-11T14:50:37.918859+0000","last_clean":"2024-09-11T14:50:37.918859+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:50:37.918859+0000","last_undegraded":"2024-09-11T14:50:37.918859+0000","last_fullsized":"2024-09-11T14:50:37.918859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728664,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":571,"num_write_kb":25921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"89'545","reported_seq":584,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:37.881347+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:50:37.881347+0000","last_peered":"2024-09-11T14:50:37.881347+0000","last_clean":"2024-09-11T14:50:37.881347+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:50:37.881347+0000","last_undegraded":"2024-09-11T14:50:37.881347+0000","last_fullsized":"2024-09-11T14:50:37.881347+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16842752,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"89'556","reported_seq":595,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:38.891304+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:50:38.891304+0000","last_peered":"2024-09-11T14:50:38.891304+0000","last_clean":"2024-09-11T14:50:38.891304+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:50:38.891304+0000","last_undegraded":"2024-09-11T14:50:38.891304+0000","last_fullsized":"2024-09-11T14:50:38.891304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":556,"num_write_kb":26048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"89'533","reported_seq":572,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:39.448260+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:50:39.448260+0000","last_peered":"2024-09-11T14:50:39.448260+0000","last_clean":"2024-09-11T14:50:39.448260+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:50:39.448260+0000","last_undegraded":"2024-09-11T14:50:39.448260+0000","last_fullsized":"2024-09-11T14:50:39.448260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"89'562","reported_seq":601,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:38.430933+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:50:38.430933+0000","last_peered":"2024-09-11T14:50:38.430933+0000","last_clean":"2024-09-11T14:50:38.430933+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:50:38.430933+0000","last_undegraded":"2024-09-11T14:50:38.430933+0000","last_fullsized":"2024-09-11T14:50:38.430933+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"89'591","reported_seq":630,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:38.321928+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:50:38.321928+0000","last_peered":"2024-09-11T14:50:38.321928+0000","last_clean":"2024-09-11T14:50:38.321928+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:50:38.321928+0000","last_undegraded":"2024-09-11T14:50:38.321928+0000","last_fullsized":"2024-09-11T14:50:38.321928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18153472,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":591,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"89'587","reported_seq":626,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:39.152272+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:50:39.152272+0000","last_peered":"2024-09-11T14:50:39.152272+0000","last_clean":"2024-09-11T14:50:39.152272+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:50:39.152272+0000","last_undegraded":"2024-09-11T14:50:39.152272+0000","last_fullsized":"2024-09-11T14:50:39.152272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16580608,"num_objects":253,"num_object_clones":0,"num_object_copies":759,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":307,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:36.978172+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:50:36.978172+0000","last_peered":"2024-09-11T14:50:36.978172+0000","last_clean":"2024-09-11T14:50:36.978172+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:50:36.978172+0000","last_undegraded":"2024-09-11T14:50:36.978172+0000","last_fullsized":"2024-09-11T14:50:36.978172+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":236,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:36.985643+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:50:36.985643+0000","last_peered":"2024-09-11T14:50:36.985643+0000","last_clean":"2024-09-11T14:50:36.985643+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:50:36.985643+0000","last_undegraded":"2024-09-11T14:50:36.985643+0000","last_fullsized":"2024-09-11T14:50:36.985643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"89'564","reported_seq":603,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:37.874278+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:50:37.874278+0000","last_peered":"2024-09-11T14:50:37.874278+0000","last_clean":"2024-09-11T14:50:37.874278+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:50:37.874278+0000","last_undegraded":"2024-09-11T14:50:37.874278+0000","last_fullsized":"2024-09-11T14:50:37.874278+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17825792,"num_objects":272,"num_object_clones":0,"num_object_copies":816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":235,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:37.212732+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:50:37.212732+0000","last_peered":"2024-09-11T14:50:37.212732+0000","last_clean":"2024-09-11T14:50:37.212732+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:50:37.212732+0000","last_undegraded":"2024-09-11T14:50:37.212732+0000","last_fullsized":"2024-09-11T14:50:37.212732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"89'546","reported_seq":585,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:38.266364+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:50:38.266364+0000","last_peered":"2024-09-11T14:50:38.266364+0000","last_clean":"2024-09-11T14:50:38.266364+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:50:38.266364+0000","last_undegraded":"2024-09-11T14:50:38.266364+0000","last_fullsized":"2024-09-11T14:50:38.266364+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":546,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":235,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:36.978061+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:50:36.978061+0000","last_peered":"2024-09-11T14:50:36.978061+0000","last_clean":"2024-09-11T14:50:36.978061+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:50:36.978061+0000","last_undegraded":"2024-09-11T14:50:36.978061+0000","last_fullsized":"2024-09-11T14:50:36.978061+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"89'536","reported_seq":575,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:38.115484+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:50:38.115484+0000","last_peered":"2024-09-11T14:50:38.115484+0000","last_clean":"2024-09-11T14:50:38.115484+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:50:38.115484+0000","last_undegraded":"2024-09-11T14:50:38.115484+0000","last_fullsized":"2024-09-11T14:50:38.115484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17432576,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":237,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:37.207545+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:50:37.207545+0000","last_peered":"2024-09-11T14:50:37.207545+0000","last_clean":"2024-09-11T14:50:37.207545+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:50:37.207545+0000","last_undegraded":"2024-09-11T14:50:37.207545+0000","last_fullsized":"2024-09-11T14:50:37.207545+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"89'540","reported_seq":579,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:38.235008+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:50:38.235008+0000","last_peered":"2024-09-11T14:50:38.235008+0000","last_clean":"2024-09-11T14:50:38.235008+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:50:38.235008+0000","last_undegraded":"2024-09-11T14:50:38.235008+0000","last_fullsized":"2024-09-11T14:50:38.235008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14942208,"num_objects":228,"num_object_clones":0,"num_object_copies":684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":235,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:37.290163+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:50:37.290163+0000","last_peered":"2024-09-11T14:50:37.290163+0000","last_clean":"2024-09-11T14:50:37.290163+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:50:37.290163+0000","last_undegraded":"2024-09-11T14:50:37.290163+0000","last_fullsized":"2024-09-11T14:50:37.290163+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"89'610","reported_seq":649,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:37.730353+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:50:37.730353+0000","last_peered":"2024-09-11T14:50:37.730353+0000","last_clean":"2024-09-11T14:50:37.730353+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:50:37.730353+0000","last_undegraded":"2024-09-11T14:50:37.730353+0000","last_fullsized":"2024-09-11T14:50:37.730353+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17432576,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":610,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":235,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:36.982787+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:50:36.982787+0000","last_peered":"2024-09-11T14:50:36.982787+0000","last_clean":"2024-09-11T14:50:36.982787+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:50:36.982787+0000","last_undegraded":"2024-09-11T14:50:36.982787+0000","last_fullsized":"2024-09-11T14:50:36.982787+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"89'615","reported_seq":654,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:38.964039+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:50:38.964039+0000","last_peered":"2024-09-11T14:50:38.964039+0000","last_clean":"2024-09-11T14:50:38.964039+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:50:38.964039+0000","last_undegraded":"2024-09-11T14:50:38.964039+0000","last_fullsized":"2024-09-11T14:50:38.964039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104896,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":615,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":235,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:37.288308+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:50:37.288308+0000","last_peered":"2024-09-11T14:50:37.288308+0000","last_clean":"2024-09-11T14:50:37.288308+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:50:37.288308+0000","last_undegraded":"2024-09-11T14:50:37.288308+0000","last_fullsized":"2024-09-11T14:50:37.288308+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"89'561","reported_seq":600,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:38.838804+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:50:38.838804+0000","last_peered":"2024-09-11T14:50:38.838804+0000","last_clean":"2024-09-11T14:50:38.838804+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:50:38.838804+0000","last_undegraded":"2024-09-11T14:50:38.838804+0000","last_fullsized":"2024-09-11T14:50:38.838804+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16711680,"num_objects":255,"num_object_clones":0,"num_object_copies":765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":561,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":235,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T14:50:36.983719+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:50:36.983719+0000","last_peered":"2024-09-11T14:50:36.983719+0000","last_clean":"2024-09-11T14:50:36.983719+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:50:36.983719+0000","last_undegraded":"2024-09-11T14:50:36.983719+0000","last_fullsized":"2024-09-11T14:50:36.983719+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":269942808,"num_objects":4120,"num_object_clones":0,"num_object_copies":12360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9102,"num_write_kb":423041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212557922304,"internally_reserved":0,"allocated":1653571584,"data_stored":1653571584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9102,"ondisk_log_size":9102,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212557791232,"internally_reserved":0,"allocated":1653702656,"data_stored":1653702656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53045727232,"internally_reserved":0,"allocated":507146240,"data_stored":507146240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673834,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":499384,"kb_used_data":499384,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51798344,"statfs":{"total":53552873472,"available":53041504256,"internally_reserved":0,"allocated":511369216,"data_stored":511369216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":310436,"kb_used_data":310436,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51987292,"statfs":{"total":53552873472,"available":53234987008,"internally_reserved":0,"allocated":317886464,"data_stored":317886464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":377104,"kb_used_data":377104,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51920624,"statfs":{"total":53552873472,"available":53166718976,"internally_reserved":0,"allocated":386154496,"data_stored":386154496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":444976,"kb_used_data":444976,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51852752,"statfs":{"total":53552873472,"available":53097218048,"internally_reserved":0,"allocated":455655424,"data_stored":455655424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53045727232,"internally_reserved":0,"allocated":507146240,"data_stored":507146240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53172883456,"internally_reserved":0,"allocated":379990016,"data_stored":379990016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53099323392,"internally_reserved":0,"allocated":453550080,"data_stored":453550080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53239857152,"internally_reserved":0,"allocated":313016320,"data_stored":313016320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53045727232,"internally_reserved":0,"allocated":507146240,"data_stored":507146240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53172883456,"internally_reserved":0,"allocated":379990016,"data_stored":379990016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53099323392,"internally_reserved":0,"allocated":453550080,"data_stored":453550080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53239988224,"internally_reserved":0,"allocated":312885248,"data_stored":312885248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53045727232,"internally_reserved":0,"allocated":507146240,"data_stored":507146240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:50:42.143 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:50:42.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:42.287+0000 7f4ebe0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:42.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:42.295+0000 7f4ebe0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:44.854 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:50:44.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:44.981+0000 7f6f42991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:44.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:44.991+0000 7f6f42991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:46.539 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:50:46.539 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:50:46.539 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:50:46.540 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:50:46.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:46.723+0000 7fa31cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:46.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:46.741+0000 7fa31cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:46.938 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:50:46.938 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:50:46.938 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:50:46.938 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:50:46.938 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:50:46.938 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:50:46.938 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:50:46.938 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:50:46.938 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:50:46.938 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:50:46.938 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:50:46.938 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:50:46.942 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:50:46.943 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:50:46.943 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:50:47.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:47.124+0000 7febeb351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:47.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:47.143+0000 7febeb351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:50:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:50:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:50:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:50:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:50:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:50:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:50:47.354 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:50:47.354 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:50:47.354 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:50:47.354 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:50:47.354 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:50:47.356 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:50:47.357 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:50:47.357 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:50:47.516 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:50:47.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:47.509+0000 7fc92cc6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:47.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:47.533+0000 7fc92cc6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:47.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:47.674+0000 7fe856874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:47.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:47.683+0000 7fe856874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:47.696 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:50:47.697 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:50:47.697 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:50:47.697 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:50:47.697 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:50:47.697 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:50:47.697 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:50:47.697 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:50:47.697 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:50:47.697 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:50:47.697 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:50:47.697 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:50:47.701 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:50:47.701 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:50:47.702 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:50:47.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:47.874+0000 7f191cafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:47.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:47.892+0000 7f191cafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:47.918 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:50:47.918 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:50:47.918 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:50:47.918 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:50:47.918 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:50:47.918 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:50:47.918 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:50:47.918 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:50:47.919 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:50:47.919 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:50:47.919 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:50:47.919 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:50:47.922 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:50:47.923 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:50:50.374 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:50:50.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:50.518+0000 7f824b47d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:50.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:50.528+0000 7f824b47d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:52.924 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:50:52.924 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:50:52.924 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:50:52.925 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:50:53.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:53.038+0000 7fc959391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:53.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:53.050+0000 7fc959391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:53.154 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:50:53.187 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:50:53.187 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:50:53.187 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:50:53.187 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:50:53.187 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:50:53.187 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:50:53.187 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:50:53.187 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:50:53.187 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:50:53.187 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:50:53.187 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:50:53.187 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:50:53.190 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:50:53.191 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:50:53.191 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:50:53.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:53.282+0000 7fa5f0f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:53.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:53.288+0000 7fa5f0f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:53.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:53.359+0000 7f3126d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:53.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:53.368+0000 7f3126d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:50:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:50:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:50:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:50:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:50:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:50:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:50:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:50:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:50:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:50:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:50:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:50:53.604 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:50:53.604 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:50:53.605 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:50:53.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:53.742+0000 7f2f8c8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:53.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:53.753+0000 7f2f8c8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:53.864 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:50:53.864 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:50:53.864 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:50:53.864 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:50:53.864 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:50:53.865 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:50:53.865 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:50:53.865 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:50:53.865 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:50:53.865 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:50:53.865 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:50:53.865 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:50:53.868 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:50:53.869 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:50:53.869 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:50:54.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:54.031+0000 7f4264791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:54.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:54.042+0000 7f4264791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:54.061 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:50:54.061 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:50:54.061 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:50:54.062 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:50:54.062 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:50:54.062 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:50:54.062 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:50:54.062 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:50:54.062 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:50:54.062 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:50:54.062 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:50:54.062 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:50:54.064 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:50:54.065 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:50:55.871 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:50:56.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:56.013+0000 7f641ba46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:56.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:56.020+0000 7f641ba46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:58.561 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:50:58.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:58.706+0000 7f72a3046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:58.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:58.716+0000 7f72a3046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:59.066 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:50:59.066 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:50:59.066 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:50:59.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:59.186+0000 7fa72c991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:59.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:50:59.197+0000 7fa72c991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:50:59.456 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:50:59.456 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:50:59.470 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":534,"stamp":"2024-09-11T14:50:59.413101+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":192021067,"num_objects":2926,"num_object_clones":0,"num_object_copies":8778,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":10381,"num_write_kb":424149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10355,"ondisk_log_size":10355,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1161112,"kb_used_data":1161112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208029800,"statfs":{"total":214211493888,"available":213022515200,"internally_reserved":0,"allocated":1188978688,"data_stored":1188978688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-31522816,"num_objects":-481,"num_object_clones":0,"num_object_copies":-1443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001673"},"pg_stats":[{"pgid":"7.f","version":"92'652","reported_seq":700,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-11T14:50:53.954053+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:50:53.954053+0000","last_peered":"2024-09-11T14:50:53.954053+0000","last_clean":"2024-09-11T14:50:53.954053+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:50:53.954053+0000","last_undegraded":"2024-09-11T14:50:53.954053+0000","last_fullsized":"2024-09-11T14:50:53.954053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13238272,"num_objects":202,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":652,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"93'680","reported_seq":731,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:58.101420+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:50:58.101420+0000","last_peered":"2024-09-11T14:50:58.101420+0000","last_clean":"2024-09-11T14:50:58.101420+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:50:58.101420+0000","last_undegraded":"2024-09-11T14:50:58.101420+0000","last_fullsized":"2024-09-11T14:50:58.101420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":27712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"93'643","reported_seq":695,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:58.102827+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:50:58.102827+0000","last_peered":"2024-09-11T14:50:58.102827+0000","last_clean":"2024-09-11T14:50:58.102827+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:50:58.102827+0000","last_undegraded":"2024-09-11T14:50:58.102827+0000","last_fullsized":"2024-09-11T14:50:58.102827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11010072,"num_objects":169,"num_object_clones":0,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":643,"num_write_kb":25921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"93'631","reported_seq":682,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:57.760742+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:50:57.760742+0000","last_peered":"2024-09-11T14:50:57.760742+0000","last_clean":"2024-09-11T14:50:57.760742+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:50:57.760742+0000","last_undegraded":"2024-09-11T14:50:57.760742+0000","last_fullsized":"2024-09-11T14:50:57.760742+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"92'624","reported_seq":672,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-11T14:50:54.223667+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:50:54.223667+0000","last_peered":"2024-09-11T14:50:54.223667+0000","last_clean":"2024-09-11T14:50:54.223667+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:50:54.223667+0000","last_undegraded":"2024-09-11T14:50:54.223667+0000","last_fullsized":"2024-09-11T14:50:54.223667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12451840,"num_objects":190,"num_object_clones":0,"num_object_copies":570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":26048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"92'587","reported_seq":635,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-11T14:50:54.058552+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:50:54.058552+0000","last_peered":"2024-09-11T14:50:54.058552+0000","last_clean":"2024-09-11T14:50:54.058552+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:50:54.058552+0000","last_undegraded":"2024-09-11T14:50:54.058552+0000","last_fullsized":"2024-09-11T14:50:54.058552+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"93'650","reported_seq":701,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:58.011866+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:50:58.011866+0000","last_peered":"2024-09-11T14:50:58.011866+0000","last_clean":"2024-09-11T14:50:58.011866+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:50:58.011866+0000","last_undegraded":"2024-09-11T14:50:58.011866+0000","last_fullsized":"2024-09-11T14:50:58.011866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927552,"num_objects":182,"num_object_clones":0,"num_object_copies":546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"93'680","reported_seq":731,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:58.009251+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:50:58.009251+0000","last_peered":"2024-09-11T14:50:58.009251+0000","last_clean":"2024-09-11T14:50:58.009251+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:50:58.009251+0000","last_undegraded":"2024-09-11T14:50:58.009251+0000","last_fullsized":"2024-09-11T14:50:58.009251+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12320768,"num_objects":188,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"92'649","reported_seq":697,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-11T14:50:54.399842+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:50:54.399842+0000","last_peered":"2024-09-11T14:50:54.399842+0000","last_clean":"2024-09-11T14:50:54.399842+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:50:54.399842+0000","last_undegraded":"2024-09-11T14:50:54.399842+0000","last_fullsized":"2024-09-11T14:50:54.399842+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12517376,"num_objects":191,"num_object_clones":0,"num_object_copies":573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":649,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":316,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-11T14:50:51.995533+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:50:51.995533+0000","last_peered":"2024-09-11T14:50:51.995533+0000","last_clean":"2024-09-11T14:50:51.995533+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:50:51.995533+0000","last_undegraded":"2024-09-11T14:50:51.995533+0000","last_fullsized":"2024-09-11T14:50:51.995533+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":248,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:56.973979+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:50:56.973979+0000","last_peered":"2024-09-11T14:50:56.973979+0000","last_clean":"2024-09-11T14:50:56.973979+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:50:56.973979+0000","last_undegraded":"2024-09-11T14:50:56.973979+0000","last_fullsized":"2024-09-11T14:50:56.973979+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"93'654","reported_seq":705,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:57.572005+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:50:57.572005+0000","last_peered":"2024-09-11T14:50:57.572005+0000","last_clean":"2024-09-11T14:50:57.572005+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:50:57.572005+0000","last_undegraded":"2024-09-11T14:50:57.572005+0000","last_fullsized":"2024-09-11T14:50:57.572005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927552,"num_objects":182,"num_object_clones":0,"num_object_copies":546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:57.088151+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:50:57.088151+0000","last_peered":"2024-09-11T14:50:57.088151+0000","last_clean":"2024-09-11T14:50:57.088151+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:50:57.088151+0000","last_undegraded":"2024-09-11T14:50:57.088151+0000","last_fullsized":"2024-09-11T14:50:57.088151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"93'621","reported_seq":672,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:58.360907+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:50:58.360907+0000","last_peered":"2024-09-11T14:50:58.360907+0000","last_clean":"2024-09-11T14:50:58.360907+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:50:58.360907+0000","last_undegraded":"2024-09-11T14:50:58.360907+0000","last_fullsized":"2024-09-11T14:50:58.360907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11862016,"num_objects":181,"num_object_clones":0,"num_object_copies":543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":621,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:56.965732+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:50:56.965732+0000","last_peered":"2024-09-11T14:50:56.965732+0000","last_clean":"2024-09-11T14:50:56.965732+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:50:56.965732+0000","last_undegraded":"2024-09-11T14:50:56.965732+0000","last_fullsized":"2024-09-11T14:50:56.965732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"93'619","reported_seq":670,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:57.085866+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:50:57.085866+0000","last_peered":"2024-09-11T14:50:57.085866+0000","last_clean":"2024-09-11T14:50:57.085866+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:50:57.085866+0000","last_undegraded":"2024-09-11T14:50:57.085866+0000","last_fullsized":"2024-09-11T14:50:57.085866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":249,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:57.085521+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:50:57.085521+0000","last_peered":"2024-09-11T14:50:57.085521+0000","last_clean":"2024-09-11T14:50:57.085521+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:50:57.085521+0000","last_undegraded":"2024-09-11T14:50:57.085521+0000","last_fullsized":"2024-09-11T14:50:57.085521+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"93'605","reported_seq":656,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:57.899756+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:50:57.899756+0000","last_peered":"2024-09-11T14:50:57.899756+0000","last_clean":"2024-09-11T14:50:57.899756+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:50:57.899756+0000","last_undegraded":"2024-09-11T14:50:57.899756+0000","last_fullsized":"2024-09-11T14:50:57.899756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":605,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:57.180701+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:50:57.180701+0000","last_peered":"2024-09-11T14:50:57.180701+0000","last_clean":"2024-09-11T14:50:57.180701+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:50:57.180701+0000","last_undegraded":"2024-09-11T14:50:57.180701+0000","last_fullsized":"2024-09-11T14:50:57.180701+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"93'704","reported_seq":755,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:58.043570+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:50:58.043570+0000","last_peered":"2024-09-11T14:50:58.043570+0000","last_clean":"2024-09-11T14:50:58.043570+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:50:58.043570+0000","last_undegraded":"2024-09-11T14:50:58.043570+0000","last_fullsized":"2024-09-11T14:50:58.043570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-11T14:50:51.998655+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:50:51.998655+0000","last_peered":"2024-09-11T14:50:51.998655+0000","last_clean":"2024-09-11T14:50:51.998655+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:50:51.998655+0000","last_undegraded":"2024-09-11T14:50:51.998655+0000","last_fullsized":"2024-09-11T14:50:51.998655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"92'683","reported_seq":731,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-11T14:50:54.236137+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:50:54.236137+0000","last_peered":"2024-09-11T14:50:54.236137+0000","last_clean":"2024-09-11T14:50:54.236137+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:50:54.236137+0000","last_undegraded":"2024-09-11T14:50:54.236137+0000","last_fullsized":"2024-09-11T14:50:54.236137+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12648448,"num_objects":193,"num_object_clones":0,"num_object_copies":579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:57.181246+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:50:57.181246+0000","last_peered":"2024-09-11T14:50:57.181246+0000","last_clean":"2024-09-11T14:50:57.181246+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:50:57.181246+0000","last_undegraded":"2024-09-11T14:50:57.181246+0000","last_fullsized":"2024-09-11T14:50:57.181246+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"92'618","reported_seq":666,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-11T14:50:54.333623+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:50:54.333623+0000","last_peered":"2024-09-11T14:50:54.333623+0000","last_clean":"2024-09-11T14:50:54.333623+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:50:54.333623+0000","last_undegraded":"2024-09-11T14:50:54.333623+0000","last_fullsized":"2024-09-11T14:50:54.333623+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12976128,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:56.971478+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:50:56.971478+0000","last_peered":"2024-09-11T14:50:56.971478+0000","last_clean":"2024-09-11T14:50:56.971478+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:50:56.971478+0000","last_undegraded":"2024-09-11T14:50:56.971478+0000","last_fullsized":"2024-09-11T14:50:56.971478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":191430680,"num_objects":2922,"num_object_clones":0,"num_object_copies":8766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10300,"num_write_kb":423041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213035474944,"internally_reserved":0,"allocated":1176018944,"data_stored":1176018944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10300,"ondisk_log_size":10300,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213035343872,"internally_reserved":0,"allocated":1176150016,"data_stored":1176150016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53166956544,"internally_reserved":0,"allocated":385916928,"data_stored":385916928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673849,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":380496,"kb_used_data":380496,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51917232,"statfs":{"total":53552873472,"available":53163245568,"internally_reserved":0,"allocated":389627904,"data_stored":389627904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":212132,"kb_used_data":212132,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52085596,"statfs":{"total":53552873472,"available":53335650304,"internally_reserved":0,"allocated":217223168,"data_stored":217223168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":262260,"kb_used_data":262260,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52035468,"statfs":{"total":53552873472,"available":53284319232,"internally_reserved":0,"allocated":268554240,"data_stored":268554240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":306224,"kb_used_data":306224,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51991504,"statfs":{"total":53552873472,"available":53239300096,"internally_reserved":0,"allocated":313573376,"data_stored":313573376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53166956544,"internally_reserved":0,"allocated":385916928,"data_stored":385916928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53288931328,"internally_reserved":0,"allocated":263942144,"data_stored":263942144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53240791040,"internally_reserved":0,"allocated":312082432,"data_stored":312082432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53338533888,"internally_reserved":0,"allocated":214339584,"data_stored":214339584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53167087616,"internally_reserved":0,"allocated":385785856,"data_stored":385785856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53288931328,"internally_reserved":0,"allocated":263942144,"data_stored":263942144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53240791040,"internally_reserved":0,"allocated":312082432,"data_stored":312082432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53338664960,"internally_reserved":0,"allocated":214208512,"data_stored":214208512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53167087616,"internally_reserved":0,"allocated":385785856,"data_stored":385785856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:51:01.225 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:51:01.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:01.345+0000 7f1e15488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:01.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:01.354+0000 7f1e15488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:03.945 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:51:04.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:04.091+0000 7f9c7a751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:04.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:04.097+0000 7f9c7a751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:04.472 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:51:04.473 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T14:51:04.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:04.618+0000 7fb420d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:04.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:04.632+0000 7fb420d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:05.943 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T14:51:05.968 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T14:51:06.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:06.091+0000 7f007ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:06.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:06.103+0000 7f007ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:06.575 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:51:06.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:06.697+0000 7f6b6bcc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:06.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:06.705+0000 7f6b6bcc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:06.927 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T14:51:06.947 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T14:51:07.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:07.069+0000 7f5177e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:07.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:07.085+0000 7f5177e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:07.948 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T14:51:07.975 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T14:51:08.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:08.144+0000 7f0639b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:08.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:08.158+0000 7f0639b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:08.949 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T14:51:08.970 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T14:51:08.970 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:51:08.988 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:51:09.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:09.100+0000 7f75d12d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:09.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:09.116+0000 7f75d12d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:09.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:09.142+0000 7f45e6f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:09.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:09.151+0000 7f45e6f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:09.465 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:51:09.466 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:51:09.490 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":543,"stamp":"2024-09-11T14:51:09.415184+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":148570699,"num_objects":2263,"num_object_clones":0,"num_object_copies":6789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":11044,"num_write_kb":424149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11018,"ondisk_log_size":11018,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":905624,"kb_used_data":905624,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208285288,"statfs":{"total":214211493888,"available":213284134912,"internally_reserved":0,"allocated":927358976,"data_stored":927358976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13107200,"num_objects":-200,"num_object_clones":0,"num_object_copies":-600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000812"},"pg_stats":[{"pgid":"7.f","version":"93'698","reported_seq":749,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:51:04.190334+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:51:04.190334+0000","last_peered":"2024-09-11T14:51:04.190334+0000","last_clean":"2024-09-11T14:51:04.190334+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:51:04.190334+0000","last_undegraded":"2024-09-11T14:51:04.190334+0000","last_fullsized":"2024-09-11T14:51:04.190334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":698,"log_dups_size":0,"ondisk_log_size":698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"95'722","reported_seq":782,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.064761+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:51:08.064761+0000","last_peered":"2024-09-11T14:51:08.064761+0000","last_clean":"2024-09-11T14:51:08.064761+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:51:08.064761+0000","last_undegraded":"2024-09-11T14:51:08.064761+0000","last_fullsized":"2024-09-11T14:51:08.064761+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":722,"num_write_kb":27712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"96'681","reported_seq":742,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.066605+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:51:08.066605+0000","last_peered":"2024-09-11T14:51:08.066605+0000","last_clean":"2024-09-11T14:51:08.066605+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:51:08.066605+0000","last_undegraded":"2024-09-11T14:51:08.066605+0000","last_fullsized":"2024-09-11T14:51:08.066605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519704,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":681,"num_write_kb":25921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"96'673","reported_seq":733,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.068673+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:51:08.068673+0000","last_peered":"2024-09-11T14:51:08.068673+0000","last_clean":"2024-09-11T14:51:08.068673+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:51:08.068673+0000","last_undegraded":"2024-09-11T14:51:08.068673+0000","last_fullsized":"2024-09-11T14:51:08.068673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":673,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"93'671","reported_seq":722,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:51:04.578594+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:51:04.578594+0000","last_peered":"2024-09-11T14:51:04.578594+0000","last_clean":"2024-09-11T14:51:04.578594+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:51:04.578594+0000","last_undegraded":"2024-09-11T14:51:04.578594+0000","last_fullsized":"2024-09-11T14:51:04.578594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9371648,"num_objects":143,"num_object_clones":0,"num_object_copies":429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":26048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"93'619","reported_seq":670,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:51:04.309228+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:51:04.309228+0000","last_peered":"2024-09-11T14:51:04.309228+0000","last_clean":"2024-09-11T14:51:04.309228+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:51:04.309228+0000","last_undegraded":"2024-09-11T14:51:04.309228+0000","last_fullsized":"2024-09-11T14:51:04.309228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"96'694","reported_seq":754,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.372668+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:51:08.372668+0000","last_peered":"2024-09-11T14:51:08.372668+0000","last_clean":"2024-09-11T14:51:08.372668+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:51:08.372668+0000","last_undegraded":"2024-09-11T14:51:08.372668+0000","last_fullsized":"2024-09-11T14:51:08.372668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":694,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'722","reported_seq":782,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.068227+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:51:08.068227+0000","last_peered":"2024-09-11T14:51:08.068227+0000","last_clean":"2024-09-11T14:51:08.068227+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:51:08.068227+0000","last_undegraded":"2024-09-11T14:51:08.068227+0000","last_fullsized":"2024-09-11T14:51:08.068227+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":722,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"93'695","reported_seq":746,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:51:04.452100+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:51:04.452100+0000","last_peered":"2024-09-11T14:51:04.452100+0000","last_clean":"2024-09-11T14:51:04.452100+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:51:04.452100+0000","last_undegraded":"2024-09-11T14:51:04.452100+0000","last_fullsized":"2024-09-11T14:51:04.452100+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502720,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":695,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":319,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:57.007206+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:50:57.007206+0000","last_peered":"2024-09-11T14:50:57.007206+0000","last_clean":"2024-09-11T14:50:57.007206+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:50:57.007206+0000","last_undegraded":"2024-09-11T14:50:57.007206+0000","last_fullsized":"2024-09-11T14:50:57.007206+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":257,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.066836+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:51:08.066836+0000","last_peered":"2024-09-11T14:51:08.066836+0000","last_clean":"2024-09-11T14:51:08.066836+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:51:08.066836+0000","last_undegraded":"2024-09-11T14:51:08.066836+0000","last_fullsized":"2024-09-11T14:51:08.066836+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'695","reported_seq":755,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.221291+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:51:08.221291+0000","last_peered":"2024-09-11T14:51:08.221291+0000","last_clean":"2024-09-11T14:51:08.221291+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:51:08.221291+0000","last_undegraded":"2024-09-11T14:51:08.221291+0000","last_fullsized":"2024-09-11T14:51:08.221291+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9240576,"num_objects":141,"num_object_clones":0,"num_object_copies":423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":695,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.133367+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:51:08.133367+0000","last_peered":"2024-09-11T14:51:08.133367+0000","last_clean":"2024-09-11T14:51:08.133367+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:51:08.133367+0000","last_undegraded":"2024-09-11T14:51:08.133367+0000","last_fullsized":"2024-09-11T14:51:08.133367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'657","reported_seq":717,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.075733+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:51:08.075733+0000","last_peered":"2024-09-11T14:51:08.075733+0000","last_clean":"2024-09-11T14:51:08.075733+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:51:08.075733+0000","last_undegraded":"2024-09-11T14:51:08.075733+0000","last_fullsized":"2024-09-11T14:51:08.075733+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502720,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":657,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.062662+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:51:08.062662+0000","last_peered":"2024-09-11T14:51:08.062662+0000","last_clean":"2024-09-11T14:51:08.062662+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:51:08.062662+0000","last_undegraded":"2024-09-11T14:51:08.062662+0000","last_fullsized":"2024-09-11T14:51:08.062662+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'664","reported_seq":724,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.203966+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:51:08.203966+0000","last_peered":"2024-09-11T14:51:08.203966+0000","last_clean":"2024-09-11T14:51:08.203966+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:51:08.203966+0000","last_undegraded":"2024-09-11T14:51:08.203966+0000","last_fullsized":"2024-09-11T14:51:08.203966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":258,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.127832+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:51:08.127832+0000","last_peered":"2024-09-11T14:51:08.127832+0000","last_clean":"2024-09-11T14:51:08.127832+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:51:08.127832+0000","last_undegraded":"2024-09-11T14:51:08.127832+0000","last_fullsized":"2024-09-11T14:51:08.127832+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'646","reported_seq":706,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.134720+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:51:08.134720+0000","last_peered":"2024-09-11T14:51:08.134720+0000","last_clean":"2024-09-11T14:51:08.134720+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:51:08.134720+0000","last_undegraded":"2024-09-11T14:51:08.134720+0000","last_fullsized":"2024-09-11T14:51:08.134720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.072910+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:51:08.072910+0000","last_peered":"2024-09-11T14:51:08.072910+0000","last_clean":"2024-09-11T14:51:08.072910+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:51:08.072910+0000","last_undegraded":"2024-09-11T14:51:08.072910+0000","last_fullsized":"2024-09-11T14:51:08.072910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"96'746","reported_seq":806,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.140065+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:51:08.140065+0000","last_peered":"2024-09-11T14:51:08.140065+0000","last_clean":"2024-09-11T14:51:08.140065+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:51:08.140065+0000","last_undegraded":"2024-09-11T14:51:08.140065+0000","last_fullsized":"2024-09-11T14:51:08.140065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":746,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:57.017985+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:50:57.017985+0000","last_peered":"2024-09-11T14:50:57.017985+0000","last_clean":"2024-09-11T14:50:57.017985+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:50:57.017985+0000","last_undegraded":"2024-09-11T14:50:57.017985+0000","last_fullsized":"2024-09-11T14:50:57.017985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"93'719","reported_seq":770,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:51:04.425382+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:51:04.425382+0000","last_peered":"2024-09-11T14:51:04.425382+0000","last_clean":"2024-09-11T14:51:04.425382+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:51:04.425382+0000","last_undegraded":"2024-09-11T14:51:04.425382+0000","last_fullsized":"2024-09-11T14:51:04.425382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":719,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.069333+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:51:08.069333+0000","last_peered":"2024-09-11T14:51:08.069333+0000","last_clean":"2024-09-11T14:51:08.069333+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:51:08.069333+0000","last_undegraded":"2024-09-11T14:51:08.069333+0000","last_fullsized":"2024-09-11T14:51:08.069333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"93'661","reported_seq":712,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:51:04.132491+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:51:04.132491+0000","last_peered":"2024-09-11T14:51:04.132491+0000","last_clean":"2024-09-11T14:51:04.132491+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:51:04.132491+0000","last_undegraded":"2024-09-11T14:51:04.132491+0000","last_fullsized":"2024-09-11T14:51:04.132491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.066429+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:51:08.066429+0000","last_peered":"2024-09-11T14:51:08.066429+0000","last_clean":"2024-09-11T14:51:08.066429+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:51:08.066429+0000","last_undegraded":"2024-09-11T14:51:08.066429+0000","last_fullsized":"2024-09-11T14:51:08.066429+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":147980312,"num_objects":2259,"num_object_clones":0,"num_object_copies":6777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10963,"num_write_kb":423041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213296668672,"internally_reserved":0,"allocated":914825216,"data_stored":914825216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10963,"ondisk_log_size":10963,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213296402432,"internally_reserved":0,"allocated":915091456,"data_stored":915091456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53247123456,"internally_reserved":0,"allocated":305750016,"data_stored":305750016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":301820,"kb_used_data":301820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51995908,"statfs":{"total":53552873472,"available":53243809792,"internally_reserved":0,"allocated":309063680,"data_stored":309063680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706567,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":165464,"kb_used_data":165464,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52132264,"statfs":{"total":53552873472,"available":53383438336,"internally_reserved":0,"allocated":169435136,"data_stored":169435136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706567,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":203076,"kb_used_data":203076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52094652,"statfs":{"total":53552873472,"available":53344923648,"internally_reserved":0,"allocated":207949824,"data_stored":207949824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706568,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":235264,"kb_used_data":235264,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52062464,"statfs":{"total":53552873472,"available":53311963136,"internally_reserved":0,"allocated":240910336,"data_stored":240910336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53247123456,"internally_reserved":0,"allocated":305750016,"data_stored":305750016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53349642240,"internally_reserved":0,"allocated":203231232,"data_stored":203231232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53313159168,"internally_reserved":0,"allocated":239714304,"data_stored":239714304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53386477568,"internally_reserved":0,"allocated":166395904,"data_stored":166395904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53247123456,"internally_reserved":0,"allocated":305750016,"data_stored":305750016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53349773312,"internally_reserved":0,"allocated":203100160,"data_stored":203100160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53313159168,"internally_reserved":0,"allocated":239714304,"data_stored":239714304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53386612736,"internally_reserved":0,"allocated":166260736,"data_stored":166260736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53247123456,"internally_reserved":0,"allocated":305750016,"data_stored":305750016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:51:09.491 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:51:09.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:09.613+0000 7f8053111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:09.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:09.622+0000 7f8053111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:09.853 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:51:09.854 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:51:09.873 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":543,"stamp":"2024-09-11T14:51:09.415184+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":148570699,"num_objects":2263,"num_object_clones":0,"num_object_copies":6789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":11044,"num_write_kb":424149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11018,"ondisk_log_size":11018,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":905624,"kb_used_data":905624,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208285288,"statfs":{"total":214211493888,"available":213284134912,"internally_reserved":0,"allocated":927358976,"data_stored":927358976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13107200,"num_objects":-200,"num_object_clones":0,"num_object_copies":-600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000812"},"pg_stats":[{"pgid":"7.f","version":"93'698","reported_seq":749,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:51:04.190334+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:51:04.190334+0000","last_peered":"2024-09-11T14:51:04.190334+0000","last_clean":"2024-09-11T14:51:04.190334+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:51:04.190334+0000","last_undegraded":"2024-09-11T14:51:04.190334+0000","last_fullsized":"2024-09-11T14:51:04.190334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":698,"log_dups_size":0,"ondisk_log_size":698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"95'722","reported_seq":782,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.064761+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:51:08.064761+0000","last_peered":"2024-09-11T14:51:08.064761+0000","last_clean":"2024-09-11T14:51:08.064761+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:51:08.064761+0000","last_undegraded":"2024-09-11T14:51:08.064761+0000","last_fullsized":"2024-09-11T14:51:08.064761+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":722,"num_write_kb":27712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"96'681","reported_seq":742,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.066605+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:51:08.066605+0000","last_peered":"2024-09-11T14:51:08.066605+0000","last_clean":"2024-09-11T14:51:08.066605+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:51:08.066605+0000","last_undegraded":"2024-09-11T14:51:08.066605+0000","last_fullsized":"2024-09-11T14:51:08.066605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519704,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":681,"num_write_kb":25921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"96'673","reported_seq":733,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.068673+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:51:08.068673+0000","last_peered":"2024-09-11T14:51:08.068673+0000","last_clean":"2024-09-11T14:51:08.068673+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:51:08.068673+0000","last_undegraded":"2024-09-11T14:51:08.068673+0000","last_fullsized":"2024-09-11T14:51:08.068673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":673,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"93'671","reported_seq":722,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:51:04.578594+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:51:04.578594+0000","last_peered":"2024-09-11T14:51:04.578594+0000","last_clean":"2024-09-11T14:51:04.578594+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:51:04.578594+0000","last_undegraded":"2024-09-11T14:51:04.578594+0000","last_fullsized":"2024-09-11T14:51:04.578594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9371648,"num_objects":143,"num_object_clones":0,"num_object_copies":429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":26048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"93'619","reported_seq":670,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:51:04.309228+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:51:04.309228+0000","last_peered":"2024-09-11T14:51:04.309228+0000","last_clean":"2024-09-11T14:51:04.309228+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:51:04.309228+0000","last_undegraded":"2024-09-11T14:51:04.309228+0000","last_fullsized":"2024-09-11T14:51:04.309228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"96'694","reported_seq":754,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.372668+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:51:08.372668+0000","last_peered":"2024-09-11T14:51:08.372668+0000","last_clean":"2024-09-11T14:51:08.372668+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:51:08.372668+0000","last_undegraded":"2024-09-11T14:51:08.372668+0000","last_fullsized":"2024-09-11T14:51:08.372668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":694,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'722","reported_seq":782,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.068227+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:51:08.068227+0000","last_peered":"2024-09-11T14:51:08.068227+0000","last_clean":"2024-09-11T14:51:08.068227+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:51:08.068227+0000","last_undegraded":"2024-09-11T14:51:08.068227+0000","last_fullsized":"2024-09-11T14:51:08.068227+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":722,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"93'695","reported_seq":746,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:51:04.452100+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:51:04.452100+0000","last_peered":"2024-09-11T14:51:04.452100+0000","last_clean":"2024-09-11T14:51:04.452100+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:51:04.452100+0000","last_undegraded":"2024-09-11T14:51:04.452100+0000","last_fullsized":"2024-09-11T14:51:04.452100+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502720,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":695,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":319,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:57.007206+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:50:57.007206+0000","last_peered":"2024-09-11T14:50:57.007206+0000","last_clean":"2024-09-11T14:50:57.007206+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:50:57.007206+0000","last_undegraded":"2024-09-11T14:50:57.007206+0000","last_fullsized":"2024-09-11T14:50:57.007206+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":257,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.066836+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:51:08.066836+0000","last_peered":"2024-09-11T14:51:08.066836+0000","last_clean":"2024-09-11T14:51:08.066836+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:51:08.066836+0000","last_undegraded":"2024-09-11T14:51:08.066836+0000","last_fullsized":"2024-09-11T14:51:08.066836+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'695","reported_seq":755,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.221291+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:51:08.221291+0000","last_peered":"2024-09-11T14:51:08.221291+0000","last_clean":"2024-09-11T14:51:08.221291+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:51:08.221291+0000","last_undegraded":"2024-09-11T14:51:08.221291+0000","last_fullsized":"2024-09-11T14:51:08.221291+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9240576,"num_objects":141,"num_object_clones":0,"num_object_copies":423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":695,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.133367+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:51:08.133367+0000","last_peered":"2024-09-11T14:51:08.133367+0000","last_clean":"2024-09-11T14:51:08.133367+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:51:08.133367+0000","last_undegraded":"2024-09-11T14:51:08.133367+0000","last_fullsized":"2024-09-11T14:51:08.133367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'657","reported_seq":717,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.075733+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:51:08.075733+0000","last_peered":"2024-09-11T14:51:08.075733+0000","last_clean":"2024-09-11T14:51:08.075733+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:51:08.075733+0000","last_undegraded":"2024-09-11T14:51:08.075733+0000","last_fullsized":"2024-09-11T14:51:08.075733+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502720,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":657,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.062662+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:51:08.062662+0000","last_peered":"2024-09-11T14:51:08.062662+0000","last_clean":"2024-09-11T14:51:08.062662+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:51:08.062662+0000","last_undegraded":"2024-09-11T14:51:08.062662+0000","last_fullsized":"2024-09-11T14:51:08.062662+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'664","reported_seq":724,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.203966+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:51:08.203966+0000","last_peered":"2024-09-11T14:51:08.203966+0000","last_clean":"2024-09-11T14:51:08.203966+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:51:08.203966+0000","last_undegraded":"2024-09-11T14:51:08.203966+0000","last_fullsized":"2024-09-11T14:51:08.203966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":258,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.127832+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:51:08.127832+0000","last_peered":"2024-09-11T14:51:08.127832+0000","last_clean":"2024-09-11T14:51:08.127832+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:51:08.127832+0000","last_undegraded":"2024-09-11T14:51:08.127832+0000","last_fullsized":"2024-09-11T14:51:08.127832+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'646","reported_seq":706,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.134720+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:51:08.134720+0000","last_peered":"2024-09-11T14:51:08.134720+0000","last_clean":"2024-09-11T14:51:08.134720+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:51:08.134720+0000","last_undegraded":"2024-09-11T14:51:08.134720+0000","last_fullsized":"2024-09-11T14:51:08.134720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.072910+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:51:08.072910+0000","last_peered":"2024-09-11T14:51:08.072910+0000","last_clean":"2024-09-11T14:51:08.072910+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:51:08.072910+0000","last_undegraded":"2024-09-11T14:51:08.072910+0000","last_fullsized":"2024-09-11T14:51:08.072910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"96'746","reported_seq":806,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.140065+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:51:08.140065+0000","last_peered":"2024-09-11T14:51:08.140065+0000","last_clean":"2024-09-11T14:51:08.140065+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:51:08.140065+0000","last_undegraded":"2024-09-11T14:51:08.140065+0000","last_fullsized":"2024-09-11T14:51:08.140065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":746,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:50:57.017985+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:50:57.017985+0000","last_peered":"2024-09-11T14:50:57.017985+0000","last_clean":"2024-09-11T14:50:57.017985+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:50:57.017985+0000","last_undegraded":"2024-09-11T14:50:57.017985+0000","last_fullsized":"2024-09-11T14:50:57.017985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"93'719","reported_seq":770,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:51:04.425382+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:51:04.425382+0000","last_peered":"2024-09-11T14:51:04.425382+0000","last_clean":"2024-09-11T14:51:04.425382+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:51:04.425382+0000","last_undegraded":"2024-09-11T14:51:04.425382+0000","last_fullsized":"2024-09-11T14:51:04.425382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":719,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.069333+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:51:08.069333+0000","last_peered":"2024-09-11T14:51:08.069333+0000","last_clean":"2024-09-11T14:51:08.069333+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:51:08.069333+0000","last_undegraded":"2024-09-11T14:51:08.069333+0000","last_fullsized":"2024-09-11T14:51:08.069333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"93'661","reported_seq":712,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T14:51:04.132491+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:51:04.132491+0000","last_peered":"2024-09-11T14:51:04.132491+0000","last_clean":"2024-09-11T14:51:04.132491+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:51:04.132491+0000","last_undegraded":"2024-09-11T14:51:04.132491+0000","last_fullsized":"2024-09-11T14:51:04.132491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.066429+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:51:08.066429+0000","last_peered":"2024-09-11T14:51:08.066429+0000","last_clean":"2024-09-11T14:51:08.066429+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:51:08.066429+0000","last_undegraded":"2024-09-11T14:51:08.066429+0000","last_fullsized":"2024-09-11T14:51:08.066429+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":147980312,"num_objects":2259,"num_object_clones":0,"num_object_copies":6777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10963,"num_write_kb":423041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213296668672,"internally_reserved":0,"allocated":914825216,"data_stored":914825216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10963,"ondisk_log_size":10963,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213296402432,"internally_reserved":0,"allocated":915091456,"data_stored":915091456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53247123456,"internally_reserved":0,"allocated":305750016,"data_stored":305750016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":301820,"kb_used_data":301820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51995908,"statfs":{"total":53552873472,"available":53243809792,"internally_reserved":0,"allocated":309063680,"data_stored":309063680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706567,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":165464,"kb_used_data":165464,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52132264,"statfs":{"total":53552873472,"available":53383438336,"internally_reserved":0,"allocated":169435136,"data_stored":169435136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706567,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":203076,"kb_used_data":203076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52094652,"statfs":{"total":53552873472,"available":53344923648,"internally_reserved":0,"allocated":207949824,"data_stored":207949824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706568,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":235264,"kb_used_data":235264,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52062464,"statfs":{"total":53552873472,"available":53311963136,"internally_reserved":0,"allocated":240910336,"data_stored":240910336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53247123456,"internally_reserved":0,"allocated":305750016,"data_stored":305750016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53349642240,"internally_reserved":0,"allocated":203231232,"data_stored":203231232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53313159168,"internally_reserved":0,"allocated":239714304,"data_stored":239714304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53386477568,"internally_reserved":0,"allocated":166395904,"data_stored":166395904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53247123456,"internally_reserved":0,"allocated":305750016,"data_stored":305750016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53349773312,"internally_reserved":0,"allocated":203100160,"data_stored":203100160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53313159168,"internally_reserved":0,"allocated":239714304,"data_stored":239714304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53386612736,"internally_reserved":0,"allocated":166260736,"data_stored":166260736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53247123456,"internally_reserved":0,"allocated":305750016,"data_stored":305750016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:51:09.875 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T14:51:09.875 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:51:09.875 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:51:09.875 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:51:10.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:10.043+0000 7ffa37663640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:10.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:10.056+0000 7ffa37663640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:10.141 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:51:10.142 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:51:10.142 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:51:10.142 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:51:10.142 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:51:10.142 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:51:10.142 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:51:10.142 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:51:10.142 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:51:10.142 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:51:10.142 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:51:10.142 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:51:10.145 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:51:10.146 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:51:10.146 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:51:10.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:10.278+0000 7f348b6c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:10.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:10.291+0000 7f348b6c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:10.425 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:51:10.425 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:51:10.426 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:51:10.426 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:51:10.426 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:51:10.426 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:51:10.426 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:51:10.426 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:51:10.426 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:51:10.426 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:51:10.426 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:51:10.426 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:51:10.430 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:51:10.430 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:51:10.430 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:51:10.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:10.553+0000 7f8080991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:10.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:10.565+0000 7f8080991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:10.608 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:51:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:51:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:51:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:51:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:51:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:51:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:51:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:51:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:51:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:51:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:51:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:51:10.612 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:51:10.612 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:51:10.612 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:51:10.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:10.763+0000 7fd397151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:10.777+0000 7fd397151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:10.813 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:51:10.813 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:51:10.813 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:51:10.813 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:51:10.813 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:51:10.814 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:51:10.814 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:51:10.814 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:51:10.814 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:51:10.814 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:51:10.814 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:51:10.814 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:51:10.816 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:51:10.817 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:51:11.496 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:51:11.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:11.623+0000 7f2f2eb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:11.630+0000 7f2f2eb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:13.778 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:51:13.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:13.927+0000 7f43c0d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:13.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:13.937+0000 7f43c0d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:15.817 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:51:15.817 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:51:15.818 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:51:15.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:15.961+0000 7f1d6d0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:15.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:15.970+0000 7f1d6d0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:16.213 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:51:16.215 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:51:16.215 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:51:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":546,"stamp":"2024-09-11T14:51:15.416285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114885195,"num_objects":1749,"num_object_clones":0,"num_object_copies":5247,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":11558,"num_write_kb":424149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11532,"ondisk_log_size":11532,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":719292,"kb_used_data":719292,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208471620,"statfs":{"total":214211493888,"available":213474938880,"internally_reserved":0,"allocated":736555008,"data_stored":736555008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-46792704,"num_objects":-714,"num_object_clones":0,"num_object_copies":-2142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":714,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001443"},"pg_stats":[{"pgid":"7.f","version":"97'742","reported_seq":805,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:14.615666+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:51:14.615666+0000","last_peered":"2024-09-11T14:51:14.615666+0000","last_clean":"2024-09-11T14:51:14.615666+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:51:14.615666+0000","last_undegraded":"2024-09-11T14:51:14.615666+0000","last_fullsized":"2024-09-11T14:51:14.615666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"97'758","reported_seq":821,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:13.028621+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:51:13.028621+0000","last_peered":"2024-09-11T14:51:13.028621+0000","last_clean":"2024-09-11T14:51:13.028621+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:51:13.028621+0000","last_undegraded":"2024-09-11T14:51:13.028621+0000","last_fullsized":"2024-09-11T14:51:13.028621+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":758,"num_write_kb":27712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"97'699","reported_seq":763,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:12.612951+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:51:12.612951+0000","last_peered":"2024-09-11T14:51:12.612951+0000","last_clean":"2024-09-11T14:51:12.612951+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:51:12.612951+0000","last_undegraded":"2024-09-11T14:51:12.612951+0000","last_fullsized":"2024-09-11T14:51:12.612951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340056,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":699,"num_write_kb":25921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"97'694","reported_seq":757,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:13.458116+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:51:13.458116+0000","last_peered":"2024-09-11T14:51:13.458116+0000","last_clean":"2024-09-11T14:51:13.458116+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:51:13.458116+0000","last_undegraded":"2024-09-11T14:51:13.458116+0000","last_fullsized":"2024-09-11T14:51:13.458116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":694,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"97'706","reported_seq":769,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:14.304845+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:51:14.304845+0000","last_peered":"2024-09-11T14:51:14.304845+0000","last_clean":"2024-09-11T14:51:14.304845+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:51:14.304845+0000","last_undegraded":"2024-09-11T14:51:14.304845+0000","last_fullsized":"2024-09-11T14:51:14.304845+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":706,"num_write_kb":26048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"97'664","reported_seq":727,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:14.346169+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:51:14.346169+0000","last_peered":"2024-09-11T14:51:14.346169+0000","last_clean":"2024-09-11T14:51:14.346169+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:51:14.346169+0000","last_undegraded":"2024-09-11T14:51:14.346169+0000","last_fullsized":"2024-09-11T14:51:14.346169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"97'720","reported_seq":783,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:13.359825+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:51:13.359825+0000","last_peered":"2024-09-11T14:51:13.359825+0000","last_clean":"2024-09-11T14:51:13.359825+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:51:13.359825+0000","last_undegraded":"2024-09-11T14:51:13.359825+0000","last_fullsized":"2024-09-11T14:51:13.359825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"97'752","reported_seq":815,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:13.197927+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:51:13.197927+0000","last_peered":"2024-09-11T14:51:13.197927+0000","last_clean":"2024-09-11T14:51:13.197927+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:51:13.197927+0000","last_undegraded":"2024-09-11T14:51:13.197927+0000","last_fullsized":"2024-09-11T14:51:13.197927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602176,"num_objects":116,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"97'732","reported_seq":795,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:14.452389+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:51:14.452389+0000","last_peered":"2024-09-11T14:51:14.452389+0000","last_clean":"2024-09-11T14:51:14.452389+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:51:14.452389+0000","last_undegraded":"2024-09-11T14:51:14.452389+0000","last_fullsized":"2024-09-11T14:51:14.452389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":331,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.988293+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:51:08.988293+0000","last_peered":"2024-09-11T14:51:08.988293+0000","last_clean":"2024-09-11T14:51:08.988293+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:51:08.988293+0000","last_undegraded":"2024-09-11T14:51:08.988293+0000","last_fullsized":"2024-09-11T14:51:08.988293+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":260,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.989931+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:51:08.989931+0000","last_peered":"2024-09-11T14:51:08.989931+0000","last_clean":"2024-09-11T14:51:08.989931+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:51:08.989931+0000","last_undegraded":"2024-09-11T14:51:08.989931+0000","last_fullsized":"2024-09-11T14:51:08.989931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"97'710","reported_seq":773,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:13.063166+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:51:13.063166+0000","last_peered":"2024-09-11T14:51:13.063166+0000","last_clean":"2024-09-11T14:51:13.063166+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:51:13.063166+0000","last_undegraded":"2024-09-11T14:51:13.063166+0000","last_fullsized":"2024-09-11T14:51:13.063166+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.992733+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:51:08.992733+0000","last_peered":"2024-09-11T14:51:08.992733+0000","last_clean":"2024-09-11T14:51:08.992733+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:51:08.992733+0000","last_undegraded":"2024-09-11T14:51:08.992733+0000","last_fullsized":"2024-09-11T14:51:08.992733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"97'694","reported_seq":757,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:13.092169+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:51:13.092169+0000","last_peered":"2024-09-11T14:51:13.092169+0000","last_clean":"2024-09-11T14:51:13.092169+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:51:13.092169+0000","last_undegraded":"2024-09-11T14:51:13.092169+0000","last_fullsized":"2024-09-11T14:51:13.092169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":694,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.984594+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:51:08.984594+0000","last_peered":"2024-09-11T14:51:08.984594+0000","last_clean":"2024-09-11T14:51:08.984594+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:51:08.984594+0000","last_undegraded":"2024-09-11T14:51:08.984594+0000","last_fullsized":"2024-09-11T14:51:08.984594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"97'687","reported_seq":750,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:13.160156+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:51:13.160156+0000","last_peered":"2024-09-11T14:51:13.160156+0000","last_clean":"2024-09-11T14:51:13.160156+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:51:13.160156+0000","last_undegraded":"2024-09-11T14:51:13.160156+0000","last_fullsized":"2024-09-11T14:51:13.160156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":687,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":261,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.987262+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:51:08.987262+0000","last_peered":"2024-09-11T14:51:08.987262+0000","last_clean":"2024-09-11T14:51:08.987262+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:51:08.987262+0000","last_undegraded":"2024-09-11T14:51:08.987262+0000","last_fullsized":"2024-09-11T14:51:08.987262+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"97'667","reported_seq":730,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:13.295431+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:51:13.295431+0000","last_peered":"2024-09-11T14:51:13.295431+0000","last_clean":"2024-09-11T14:51:13.295431+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:51:13.295431+0000","last_undegraded":"2024-09-11T14:51:13.295431+0000","last_fullsized":"2024-09-11T14:51:13.295431+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":667,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:09.008682+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:51:09.008682+0000","last_peered":"2024-09-11T14:51:09.008682+0000","last_clean":"2024-09-11T14:51:09.008682+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:51:09.008682+0000","last_undegraded":"2024-09-11T14:51:09.008682+0000","last_fullsized":"2024-09-11T14:51:09.008682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"97'771","reported_seq":834,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:13.149316+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:51:13.149316+0000","last_peered":"2024-09-11T14:51:13.149316+0000","last_clean":"2024-09-11T14:51:13.149316+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:51:13.149316+0000","last_undegraded":"2024-09-11T14:51:13.149316+0000","last_fullsized":"2024-09-11T14:51:13.149316+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":771,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:09.006414+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:51:09.006414+0000","last_peered":"2024-09-11T14:51:09.006414+0000","last_clean":"2024-09-11T14:51:09.006414+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:51:09.006414+0000","last_undegraded":"2024-09-11T14:51:09.006414+0000","last_fullsized":"2024-09-11T14:51:09.006414+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"97'765","reported_seq":828,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:13.548019+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:51:13.548019+0000","last_peered":"2024-09-11T14:51:13.548019+0000","last_clean":"2024-09-11T14:51:13.548019+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:51:13.548019+0000","last_undegraded":"2024-09-11T14:51:13.548019+0000","last_fullsized":"2024-09-11T14:51:13.548019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:09.009595+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:51:09.009595+0000","last_peered":"2024-09-11T14:51:09.009595+0000","last_clean":"2024-09-11T14:51:09.009595+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:51:09.009595+0000","last_undegraded":"2024-09-11T14:51:09.009595+0000","last_fullsized":"2024-09-11T14:51:09.009595+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"97'716","reported_seq":779,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:14.529527+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:51:14.529527+0000","last_peered":"2024-09-11T14:51:14.529527+0000","last_clean":"2024-09-11T14:51:14.529527+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:51:14.529527+0000","last_undegraded":"2024-09-11T14:51:14.529527+0000","last_fullsized":"2024-09-11T14:51:14.529527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":716,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.994517+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:51:08.994517+0000","last_peered":"2024-09-11T14:51:08.994517+0000","last_clean":"2024-09-11T14:51:08.994517+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:51:08.994517+0000","last_undegraded":"2024-09-11T14:51:08.994517+0000","last_fullsized":"2024-09-11T14:51:08.994517+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":114294808,"num_objects":1745,"num_object_clones":0,"num_object_copies":5235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11477,"num_write_kb":423041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213490458624,"internally_reserved":0,"allocated":721035264,"data_stored":721035264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11477,"ondisk_log_size":11477,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213490458624,"internally_reserved":0,"allocated":721035264,"data_stored":721035264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53335326720,"internally_reserved":0,"allocated":217546752,"data_stored":217546752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":216312,"kb_used_data":216312,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52081416,"statfs":{"total":53552873472,"available":53331369984,"internally_reserved":0,"allocated":221503488,"data_stored":221503488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706572,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":137368,"kb_used_data":137368,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52160360,"statfs":{"total":53552873472,"available":53412208640,"internally_reserved":0,"allocated":140664832,"data_stored":140664832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706572,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":168924,"kb_used_data":168924,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52128804,"statfs":{"total":53552873472,"available":53379895296,"internally_reserved":0,"allocated":172978176,"data_stored":172978176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706573,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":196688,"kb_used_data":196688,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52101040,"statfs":{"total":53552873472,"available":53351464960,"internally_reserved":0,"allocated":201408512,"data_stored":201408512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53335326720,"internally_reserved":0,"allocated":217546752,"data_stored":217546752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53386158080,"internally_reserved":0,"allocated":166715392,"data_stored":166715392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53353070592,"internally_reserved":0,"allocated":199802880,"data_stored":199802880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53415903232,"internally_reserved":0,"allocated":136970240,"data_stored":136970240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53335326720,"internally_reserved":0,"allocated":217546752,"data_stored":217546752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53386158080,"internally_reserved":0,"allocated":166715392,"data_stored":166715392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53353070592,"internally_reserved":0,"allocated":199802880,"data_stored":199802880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53415903232,"internally_reserved":0,"allocated":136970240,"data_stored":136970240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53335326720,"internally_reserved":0,"allocated":217546752,"data_stored":217546752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:51:16.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:16.362+0000 7f6fc5711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:16.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:16.370+0000 7f6fc5711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:18.780 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:51:18.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:18.922+0000 7fc3fb488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:18.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:18.928+0000 7fc3fb488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:21.097 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:51:21.238 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:51:21.238 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:51:21.238 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:51:21.238 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:51:21.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:21.246+0000 7f8683e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:21.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:21.253+0000 7f8683e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:21.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:21.381+0000 7f4459911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:21.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:21.392+0000 7f4459911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:21.429 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:51:21.430 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:51:21.430 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:51:21.430 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:51:21.430 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:51:21.430 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:51:21.430 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:51:21.430 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:51:21.430 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:51:21.430 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:51:21.430 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:51:21.430 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:51:21.433 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:51:21.433 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:51:21.433 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:51:21.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:21.621+0000 7f1b2cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:21.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:21.638+0000 7f1b2cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:21.782 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:51:21.782 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:51:21.782 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:51:21.782 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:51:21.782 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:51:21.783 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:51:21.783 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:51:21.783 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:51:21.783 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:51:21.783 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:51:21.783 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:51:21.784 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:51:21.786 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:51:21.786 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:51:21.787 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:51:21.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:21.949+0000 7f6e4e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:21.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:21.966+0000 7f6e4e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:22.004 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:51:22.004 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:51:22.004 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:51:22.004 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:51:22.004 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:51:22.004 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:51:22.004 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:51:22.004 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:51:22.004 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:51:22.004 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:51:22.005 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:51:22.005 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:51:22.008 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:51:22.009 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:51:22.009 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:51:22.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:22.151+0000 7f6adf591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:22.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:22.161+0000 7f6adf591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:22.179 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:51:22.179 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:51:22.179 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:51:22.179 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:51:22.179 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:51:22.179 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:51:22.179 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:51:22.179 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:51:22.180 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:51:22.180 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:51:22.180 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:51:22.180 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:51:22.184 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:51:22.184 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:51:23.717 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:51:23.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:23.883+0000 7fe6aa111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:23.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:23.891+0000 7fe6aa111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:26.215 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:51:26.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:26.356+0000 7f05b1e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:26.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:26.363+0000 7f05b1e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:27.185 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:51:27.185 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:51:27.185 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:51:27.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:27.316+0000 7f5ecf688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:27.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:27.326+0000 7f5ecf688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:27.616 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:51:27.617 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:51:27.635 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":552,"stamp":"2024-09-11T14:51:27.418983+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":57147979,"num_objects":868,"num_object_clones":0,"num_object_copies":2604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12439,"num_write_kb":424149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12413,"ondisk_log_size":12413,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":383416,"kb_used_data":383416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208807496,"statfs":{"total":214211493888,"available":213818875904,"internally_reserved":0,"allocated":392617984,"data_stored":392617984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-57737216,"num_objects":-881,"num_object_clones":0,"num_object_copies":-2643,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":881,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002697"},"pg_stats":[{"pgid":"7.f","version":"97'797","reported_seq":860,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:24.528768+0000","last_change":"2024-09-11T14:48:40.233166+0000","last_active":"2024-09-11T14:51:24.528768+0000","last_peered":"2024-09-11T14:51:24.528768+0000","last_clean":"2024-09-11T14:51:24.528768+0000","last_became_active":"2024-09-11T14:48:40.215193+0000","last_became_peered":"2024-09-11T14:48:40.215193+0000","last_unstale":"2024-09-11T14:51:24.528768+0000","last_undegraded":"2024-09-11T14:51:24.528768+0000","last_fullsized":"2024-09-11T14:51:24.528768+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"97'812","reported_seq":875,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:23.185734+0000","last_change":"2024-09-11T14:48:40.125994+0000","last_active":"2024-09-11T14:51:23.185734+0000","last_peered":"2024-09-11T14:51:23.185734+0000","last_clean":"2024-09-11T14:51:23.185734+0000","last_became_active":"2024-09-11T14:48:40.111630+0000","last_became_peered":"2024-09-11T14:48:40.111630+0000","last_unstale":"2024-09-11T14:51:23.185734+0000","last_undegraded":"2024-09-11T14:51:23.185734+0000","last_fullsized":"2024-09-11T14:51:23.185734+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":812,"num_write_kb":27712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"97'754","reported_seq":818,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:23.140026+0000","last_change":"2024-09-11T14:48:40.309074+0000","last_active":"2024-09-11T14:51:23.140026+0000","last_peered":"2024-09-11T14:51:23.140026+0000","last_clean":"2024-09-11T14:51:23.140026+0000","last_became_active":"2024-09-11T14:48:40.299030+0000","last_became_peered":"2024-09-11T14:48:40.299030+0000","last_unstale":"2024-09-11T14:51:23.140026+0000","last_undegraded":"2024-09-11T14:51:23.140026+0000","last_fullsized":"2024-09-11T14:51:23.140026+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735576,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":754,"num_write_kb":25921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"97'741","reported_seq":804,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:23.208330+0000","last_change":"2024-09-11T14:48:40.186581+0000","last_active":"2024-09-11T14:51:23.208330+0000","last_peered":"2024-09-11T14:51:23.208330+0000","last_clean":"2024-09-11T14:51:23.208330+0000","last_became_active":"2024-09-11T14:48:40.179168+0000","last_became_peered":"2024-09-11T14:48:40.179168+0000","last_unstale":"2024-09-11T14:51:23.208330+0000","last_undegraded":"2024-09-11T14:51:23.208330+0000","last_fullsized":"2024-09-11T14:51:23.208330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":741,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"97'766","reported_seq":829,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:24.330260+0000","last_change":"2024-09-11T14:48:40.155800+0000","last_active":"2024-09-11T14:51:24.330260+0000","last_peered":"2024-09-11T14:51:24.330260+0000","last_clean":"2024-09-11T14:51:24.330260+0000","last_became_active":"2024-09-11T14:48:40.129723+0000","last_became_peered":"2024-09-11T14:48:40.129723+0000","last_unstale":"2024-09-11T14:51:24.330260+0000","last_undegraded":"2024-09-11T14:51:24.330260+0000","last_fullsized":"2024-09-11T14:51:24.330260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":26048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"97'709","reported_seq":772,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:24.626314+0000","last_change":"2024-09-11T14:48:40.256129+0000","last_active":"2024-09-11T14:51:24.626314+0000","last_peered":"2024-09-11T14:51:24.626314+0000","last_clean":"2024-09-11T14:51:24.626314+0000","last_became_active":"2024-09-11T14:48:40.247372+0000","last_became_peered":"2024-09-11T14:48:40.247372+0000","last_unstale":"2024-09-11T14:51:24.626314+0000","last_undegraded":"2024-09-11T14:51:24.626314+0000","last_fullsized":"2024-09-11T14:51:24.626314+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":709,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"97'782","reported_seq":845,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:23.330655+0000","last_change":"2024-09-11T14:48:40.154689+0000","last_active":"2024-09-11T14:51:23.330655+0000","last_peered":"2024-09-11T14:51:23.330655+0000","last_clean":"2024-09-11T14:51:23.330655+0000","last_became_active":"2024-09-11T14:48:40.129705+0000","last_became_peered":"2024-09-11T14:48:40.129705+0000","last_unstale":"2024-09-11T14:51:23.330655+0000","last_undegraded":"2024-09-11T14:51:23.330655+0000","last_fullsized":"2024-09-11T14:51:23.330655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":782,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"97'807","reported_seq":870,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:23.308204+0000","last_change":"2024-09-11T14:48:40.198065+0000","last_active":"2024-09-11T14:51:23.308204+0000","last_peered":"2024-09-11T14:51:23.308204+0000","last_clean":"2024-09-11T14:51:23.308204+0000","last_became_active":"2024-09-11T14:48:40.186602+0000","last_became_peered":"2024-09-11T14:48:40.186602+0000","last_unstale":"2024-09-11T14:51:23.308204+0000","last_undegraded":"2024-09-11T14:51:23.308204+0000","last_fullsized":"2024-09-11T14:51:23.308204+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"97'794","reported_seq":857,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:24.415405+0000","last_change":"2024-09-11T14:48:40.187599+0000","last_active":"2024-09-11T14:51:24.415405+0000","last_peered":"2024-09-11T14:51:24.415405+0000","last_clean":"2024-09-11T14:51:24.415405+0000","last_became_active":"2024-09-11T14:48:40.178734+0000","last_became_peered":"2024-09-11T14:48:40.178734+0000","last_unstale":"2024-09-11T14:51:24.415405+0000","last_undegraded":"2024-09-11T14:51:24.415405+0000","last_fullsized":"2024-09-11T14:51:24.415405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":794,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":331,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.988293+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:51:08.988293+0000","last_peered":"2024-09-11T14:51:08.988293+0000","last_clean":"2024-09-11T14:51:08.988293+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:51:08.988293+0000","last_undegraded":"2024-09-11T14:51:08.988293+0000","last_fullsized":"2024-09-11T14:51:08.988293+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":260,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.989931+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:51:08.989931+0000","last_peered":"2024-09-11T14:51:08.989931+0000","last_clean":"2024-09-11T14:51:08.989931+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:51:08.989931+0000","last_undegraded":"2024-09-11T14:51:08.989931+0000","last_fullsized":"2024-09-11T14:51:08.989931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"97'764","reported_seq":827,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:23.145970+0000","last_change":"2024-09-11T14:48:40.146642+0000","last_active":"2024-09-11T14:51:23.145970+0000","last_peered":"2024-09-11T14:51:23.145970+0000","last_clean":"2024-09-11T14:51:23.145970+0000","last_became_active":"2024-09-11T14:48:40.128516+0000","last_became_peered":"2024-09-11T14:48:40.128516+0000","last_unstale":"2024-09-11T14:51:23.145970+0000","last_undegraded":"2024-09-11T14:51:23.145970+0000","last_fullsized":"2024-09-11T14:51:23.145970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":764,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.992733+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:51:08.992733+0000","last_peered":"2024-09-11T14:51:08.992733+0000","last_clean":"2024-09-11T14:51:08.992733+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:51:08.992733+0000","last_undegraded":"2024-09-11T14:51:08.992733+0000","last_fullsized":"2024-09-11T14:51:08.992733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"97'749","reported_seq":812,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:23.057225+0000","last_change":"2024-09-11T14:48:40.144190+0000","last_active":"2024-09-11T14:51:23.057225+0000","last_peered":"2024-09-11T14:51:23.057225+0000","last_clean":"2024-09-11T14:51:23.057225+0000","last_became_active":"2024-09-11T14:48:40.128157+0000","last_became_peered":"2024-09-11T14:48:40.128157+0000","last_unstale":"2024-09-11T14:51:23.057225+0000","last_undegraded":"2024-09-11T14:51:23.057225+0000","last_fullsized":"2024-09-11T14:51:23.057225+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.984594+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:51:08.984594+0000","last_peered":"2024-09-11T14:51:08.984594+0000","last_clean":"2024-09-11T14:51:08.984594+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:51:08.984594+0000","last_undegraded":"2024-09-11T14:51:08.984594+0000","last_fullsized":"2024-09-11T14:51:08.984594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"97'744","reported_seq":807,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:23.037852+0000","last_change":"2024-09-11T14:48:40.262083+0000","last_active":"2024-09-11T14:51:23.037852+0000","last_peered":"2024-09-11T14:51:23.037852+0000","last_clean":"2024-09-11T14:51:23.037852+0000","last_became_active":"2024-09-11T14:48:40.254745+0000","last_became_peered":"2024-09-11T14:48:40.254745+0000","last_unstale":"2024-09-11T14:51:23.037852+0000","last_undegraded":"2024-09-11T14:51:23.037852+0000","last_fullsized":"2024-09-11T14:51:23.037852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":261,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.987262+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:51:08.987262+0000","last_peered":"2024-09-11T14:51:08.987262+0000","last_clean":"2024-09-11T14:51:08.987262+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:51:08.987262+0000","last_undegraded":"2024-09-11T14:51:08.987262+0000","last_fullsized":"2024-09-11T14:51:08.987262+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"97'716","reported_seq":779,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:22.833280+0000","last_change":"2024-09-11T14:48:40.200442+0000","last_active":"2024-09-11T14:51:22.833280+0000","last_peered":"2024-09-11T14:51:22.833280+0000","last_clean":"2024-09-11T14:51:22.833280+0000","last_became_active":"2024-09-11T14:48:40.189895+0000","last_became_peered":"2024-09-11T14:48:40.189895+0000","last_unstale":"2024-09-11T14:51:22.833280+0000","last_undegraded":"2024-09-11T14:51:22.833280+0000","last_fullsized":"2024-09-11T14:51:22.833280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":716,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:09.008682+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:51:09.008682+0000","last_peered":"2024-09-11T14:51:09.008682+0000","last_clean":"2024-09-11T14:51:09.008682+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:51:09.008682+0000","last_undegraded":"2024-09-11T14:51:09.008682+0000","last_fullsized":"2024-09-11T14:51:09.008682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"97'826","reported_seq":889,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:23.190588+0000","last_change":"2024-09-11T14:48:40.086641+0000","last_active":"2024-09-11T14:51:23.190588+0000","last_peered":"2024-09-11T14:51:23.190588+0000","last_clean":"2024-09-11T14:51:23.190588+0000","last_became_active":"2024-09-11T14:48:40.071554+0000","last_became_peered":"2024-09-11T14:48:40.071554+0000","last_unstale":"2024-09-11T14:51:23.190588+0000","last_undegraded":"2024-09-11T14:51:23.190588+0000","last_fullsized":"2024-09-11T14:51:23.190588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":826,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:09.006414+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:51:09.006414+0000","last_peered":"2024-09-11T14:51:09.006414+0000","last_clean":"2024-09-11T14:51:09.006414+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:51:09.006414+0000","last_undegraded":"2024-09-11T14:51:09.006414+0000","last_fullsized":"2024-09-11T14:51:09.006414+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"97'829","reported_seq":892,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:24.073376+0000","last_change":"2024-09-11T14:48:40.150189+0000","last_active":"2024-09-11T14:51:24.073376+0000","last_peered":"2024-09-11T14:51:24.073376+0000","last_clean":"2024-09-11T14:51:24.073376+0000","last_became_active":"2024-09-11T14:48:40.111244+0000","last_became_peered":"2024-09-11T14:48:40.111244+0000","last_unstale":"2024-09-11T14:51:24.073376+0000","last_undegraded":"2024-09-11T14:51:24.073376+0000","last_fullsized":"2024-09-11T14:51:24.073376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":829,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:09.009595+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:51:09.009595+0000","last_peered":"2024-09-11T14:51:09.009595+0000","last_clean":"2024-09-11T14:51:09.009595+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:51:09.009595+0000","last_undegraded":"2024-09-11T14:51:09.009595+0000","last_fullsized":"2024-09-11T14:51:09.009595+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"97'768","reported_seq":831,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:24.495254+0000","last_change":"2024-09-11T14:48:40.287594+0000","last_active":"2024-09-11T14:51:24.495254+0000","last_peered":"2024-09-11T14:51:24.495254+0000","last_clean":"2024-09-11T14:51:24.495254+0000","last_became_active":"2024-09-11T14:48:40.279307+0000","last_became_peered":"2024-09-11T14:48:40.279307+0000","last_unstale":"2024-09-11T14:51:24.495254+0000","last_undegraded":"2024-09-11T14:51:24.495254+0000","last_fullsized":"2024-09-11T14:51:24.495254+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:48:38.937830+0000","last_clean_scrub_stamp":"2024-09-11T14:48:38.937830+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-11T14:51:08.994517+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:51:08.994517+0000","last_peered":"2024-09-11T14:51:08.994517+0000","last_clean":"2024-09-11T14:51:08.994517+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:51:08.994517+0000","last_undegraded":"2024-09-11T14:51:08.994517+0000","last_fullsized":"2024-09-11T14:51:08.994517+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":56557592,"num_objects":864,"num_object_clones":0,"num_object_copies":2592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12358,"num_write_kb":423041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213838802944,"internally_reserved":0,"allocated":372690944,"data_stored":372690944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12358,"ondisk_log_size":12358,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213838540800,"internally_reserved":0,"allocated":372953088,"data_stored":372953088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53445939200,"internally_reserved":0,"allocated":106934272,"data_stored":106934272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":109864,"kb_used_data":109864,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52187864,"statfs":{"total":53552873472,"available":53440372736,"internally_reserved":0,"allocated":112500736,"data_stored":112500736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706582,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":76336,"kb_used_data":76336,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52221392,"statfs":{"total":53552873472,"available":53474705408,"internally_reserved":0,"allocated":78168064,"data_stored":78168064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706582,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":92716,"kb_used_data":92716,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52205012,"statfs":{"total":53552873472,"available":53457932288,"internally_reserved":0,"allocated":94941184,"data_stored":94941184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706583,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":104500,"kb_used_data":104500,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52193228,"statfs":{"total":53552873472,"available":53445865472,"internally_reserved":0,"allocated":107008000,"data_stored":107008000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53445939200,"internally_reserved":0,"allocated":106934272,"data_stored":106934272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53465161728,"internally_reserved":0,"allocated":87711744,"data_stored":87711744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53447454720,"internally_reserved":0,"allocated":105418752,"data_stored":105418752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53479985152,"internally_reserved":0,"allocated":72888320,"data_stored":72888320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53445939200,"internally_reserved":0,"allocated":106934272,"data_stored":106934272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53465292800,"internally_reserved":0,"allocated":87580672,"data_stored":87580672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53447454720,"internally_reserved":0,"allocated":105418752,"data_stored":105418752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53479985152,"internally_reserved":0,"allocated":72888320,"data_stored":72888320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53446070272,"internally_reserved":0,"allocated":106803200,"data_stored":106803200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:51:28.633 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:51:28.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:28.778+0000 7f30bc6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:28.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:28.785+0000 7f30bc6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:30.944 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:51:31.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:31.080+0000 7f28aa288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:31.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:31.088+0000 7f28aa288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:32.637 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:51:32.637 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:51:32.638 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:51:32.638 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:51:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:32.756+0000 7f8fa3f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:32.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:32.767+0000 7f8fa3f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:32.836 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:51:32.836 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:51:32.836 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:51:32.837 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:51:32.837 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:51:32.837 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:51:32.837 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:51:32.837 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:51:32.837 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:51:32.837 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:51:32.837 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:51:32.837 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:51:32.840 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:51:32.841 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:51:32.841 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:51:32.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:32.983+0000 7f8731311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:32.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:32.995+0000 7f8731311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:33.047 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:51:33.047 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:51:33.047 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:51:33.047 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:51:33.047 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:51:33.047 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:51:33.048 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:51:33.048 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:51:33.048 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:51:33.048 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:51:33.048 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:51:33.048 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:51:33.050 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:51:33.051 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:51:33.051 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:51:33.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:33.196+0000 7f2cbda88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:33.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:33.207+0000 7f2cbda88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:33.324 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:51:33.324 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:51:33.324 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:51:33.324 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:51:33.324 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:51:33.324 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:51:33.324 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:51:33.324 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:51:33.324 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:51:33.325 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:51:33.325 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:51:33.325 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:51:33.328 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:51:33.328 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:51:33.328 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:51:33.386 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:51:33.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:33.456+0000 7f50d56b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:33.464 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Removed 6610 objects 2024-09-11T14:51:33.464 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Clean up completed and total clean up time :81.3716 2024-09-11T14:51:33.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:33.467+0000 7f50d56b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:33.497 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:51:33.498 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:51:33.498 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:51:33.498 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:51:33.498 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:51:33.498 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:51:33.498 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:51:33.498 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:51:33.498 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:51:33.498 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:51:33.498 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:51:33.498 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:51:33.501 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:51:33.501 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:51:33.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:33.511+0000 7ff0fa591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:33.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:33.516+0000 7ff0fa591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:35.618 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T14:51:35.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:35.731+0000 7f9000911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:35.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:35.736+0000 7f9000911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:37.841 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T14:51:37.912 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_4 2024-09-11T14:51:37.912 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2024-09-11T14:51:37.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:37.961+0000 7f543086c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:37.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:37.967+0000 7f543086c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:38.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:38.029+0000 7ff84d351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:38.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:38.042+0000 7ff84d351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:38.502 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-11T14:51:38.502 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-11T14:51:38.503 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T14:51:38.503 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-11T14:51:38.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:38.607+0000 7f9b20d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:38.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:38.616+0000 7f9b20d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:38.633 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:51:38.633 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:51:38.633 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:51:38.633 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:51:38.634 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:51:38.634 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:51:38.634 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:51:38.634 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:51:38.634 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:51:38.634 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:51:38.634 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:51:38.634 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:51:38.636 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:51:38.637 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:51:38.637 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T14:51:38.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:38.741+0000 7f5d2f05c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:38.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:38.750+0000 7f5d2f05c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:38.767 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:51:38.767 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:51:38.767 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:51:38.768 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:51:38.768 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:51:38.768 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:51:38.768 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:51:38.769 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:51:38.769 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:51:38.769 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:51:38.769 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:51:38.769 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:51:38.770 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:51:38.771 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:51:38.771 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T14:51:38.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:38.875+0000 7fc9c3cac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:38.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:38.884+0000 7fc9c3cac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:38.902 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:51:38.902 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:51:38.902 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:51:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:51:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:51:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:51:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:51:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:51:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:51:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:51:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:51:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:51:38.905 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:51:38.905 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:51:38.906 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T14:51:38.957 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_4' removed 2024-09-11T14:51:38.974 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-11T14:51:38.984 INFO:tasks.thrashosds:joining thrashosds 2024-09-11T14:51:39.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:39.041+0000 7f4121191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:39.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:39.052+0000 7f4121191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:39.076 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-11T14:51:39.076 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-11T14:51:39.077 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-11T14:51:39.077 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-11T14:51:39.077 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-11T14:51:39.077 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-11T14:51:39.077 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-11T14:51:39.077 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-11T14:51:39.077 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-11T14:51:39.077 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-11T14:51:39.077 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-11T14:51:39.077 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-11T14:51:39.080 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T14:51:39.080 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T14:51:44.081 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-11T14:51:44.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:44.199+0000 7fe4af2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:44.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:44.205+0000 7fe4af2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:44.220 INFO:teuthology.orchestra.run.smithi103.stdout:{} 2024-09-11T14:51:44.220 INFO:teuthology.orchestra.run.smithi103.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T14:51:44.231 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T14:51:44.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:44.335+0000 7fe732191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:44.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:44.345+0000 7fe732191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:44.970 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T14:51:44.987 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-11T14:51:45.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:45.101+0000 7f8884191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:45.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:45.111+0000 7f8884191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:45.982 INFO:teuthology.orchestra.run.smithi103.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-11T14:51:46.000 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T14:51:46.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:46.106+0000 7fe7de44f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:46.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:46.116+0000 7fe7de44f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:46.983 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T14:51:47.002 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-11T14:51:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:47.106+0000 7f19a0391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:47.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:47.116+0000 7f19a0391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:47.991 INFO:teuthology.orchestra.run.smithi103.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-11T14:51:48.008 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T14:51:48.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:48.115+0000 7f59dd991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:48.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:48.125+0000 7f59dd991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:48.992 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T14:51:49.016 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-11T14:51:49.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:49.121+0000 7fd2baf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:49.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:49.132+0000 7fd2baf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:49.999 INFO:teuthology.orchestra.run.smithi103.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-11T14:51:50.017 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T14:51:50.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:50.124+0000 7f840acfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:50.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:50.134+0000 7f840acfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:51.000 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T14:51:51.019 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-11T14:51:51.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:51.127+0000 7f04a3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:51.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:51.137+0000 7f04a3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:52.004 INFO:teuthology.orchestra.run.smithi103.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-11T14:51:52.022 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-11T14:51:52.022 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T14:51:52.023 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:51:52.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.128+0000 7fd74d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:52.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.136+0000 7fd74d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:52.323 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:51:52.324 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":106,"fsid":"dc3d4a5d-c4e2-4e8c-9b89-77a2b35b981a","created":"2024-09-11T14:35:56.808520+0000","modified":"2024-09-11T14:51:52.003144+0000","last_up_change":"2024-09-11T14:36:04.272759+0000","last_in_change":"2024-09-11T14:35:58.926553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:36:05.238841+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T14:36:07.115201+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63bc9ac5-48b1-4a61-8362-266abf9e0d26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6801","nonce":2844832911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2844832911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6807","nonce":2844832911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2844832911}]},"public_addr":"172.21.15.103:6801/2844832911","cluster_addr":"172.21.15.103:6800/2844832911","heartbeat_back_addr":"172.21.15.103:6807/2844832911","heartbeat_front_addr":"172.21.15.103:6810/2844832911","state":["exists","up"]},{"osd":1,"uuid":"7cc4e987-5784-4376-aadb-d80950d62fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6803","nonce":2605657741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2605657741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6809","nonce":2605657741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2605657741}]},"public_addr":"172.21.15.103:6803/2605657741","cluster_addr":"172.21.15.103:6802/2605657741","heartbeat_back_addr":"172.21.15.103:6809/2605657741","heartbeat_front_addr":"172.21.15.103:6808/2605657741","state":["exists","up"]},{"osd":2,"uuid":"ba65111c-1360-4d9c-9d4d-171dd71c6fbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":594934649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6803","nonce":594934649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":594934649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6807","nonce":594934649}]},"public_addr":"172.21.15.176:6802/594934649","cluster_addr":"172.21.15.176:6803/594934649","heartbeat_back_addr":"172.21.15.176:6806/594934649","heartbeat_front_addr":"172.21.15.176:6807/594934649","state":["exists","up"]},{"osd":3,"uuid":"99584cad-6ea4-4cee-89a2-ae07c08ba388","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1173823068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6811","nonce":1173823068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":1173823068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1173823068}]},"public_addr":"172.21.15.176:6810/1173823068","cluster_addr":"172.21.15.176:6811/1173823068","heartbeat_back_addr":"172.21.15.176:6815/1173823068","heartbeat_front_addr":"172.21.15.176:6814/1173823068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:51:52.338 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T14:51:52.338 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:51:52.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.440+0000 7fd584711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:52.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.447+0000 7fd584711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:52.648 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:51:52.648 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":106,"fsid":"dc3d4a5d-c4e2-4e8c-9b89-77a2b35b981a","created":"2024-09-11T14:35:56.808520+0000","modified":"2024-09-11T14:51:52.003144+0000","last_up_change":"2024-09-11T14:36:04.272759+0000","last_in_change":"2024-09-11T14:35:58.926553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:36:05.238841+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T14:36:07.115201+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63bc9ac5-48b1-4a61-8362-266abf9e0d26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6801","nonce":2844832911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2844832911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6807","nonce":2844832911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2844832911}]},"public_addr":"172.21.15.103:6801/2844832911","cluster_addr":"172.21.15.103:6800/2844832911","heartbeat_back_addr":"172.21.15.103:6807/2844832911","heartbeat_front_addr":"172.21.15.103:6810/2844832911","state":["exists","up"]},{"osd":1,"uuid":"7cc4e987-5784-4376-aadb-d80950d62fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6803","nonce":2605657741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2605657741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6809","nonce":2605657741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2605657741}]},"public_addr":"172.21.15.103:6803/2605657741","cluster_addr":"172.21.15.103:6802/2605657741","heartbeat_back_addr":"172.21.15.103:6809/2605657741","heartbeat_front_addr":"172.21.15.103:6808/2605657741","state":["exists","up"]},{"osd":2,"uuid":"ba65111c-1360-4d9c-9d4d-171dd71c6fbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":594934649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6803","nonce":594934649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":594934649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6807","nonce":594934649}]},"public_addr":"172.21.15.176:6802/594934649","cluster_addr":"172.21.15.176:6803/594934649","heartbeat_back_addr":"172.21.15.176:6806/594934649","heartbeat_front_addr":"172.21.15.176:6807/594934649","state":["exists","up"]},{"osd":3,"uuid":"99584cad-6ea4-4cee-89a2-ae07c08ba388","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1173823068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6811","nonce":1173823068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":1173823068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1173823068}]},"public_addr":"172.21.15.176:6810/1173823068","cluster_addr":"172.21.15.176:6811/1173823068","heartbeat_back_addr":"172.21.15.176:6815/1173823068","heartbeat_front_addr":"172.21.15.176:6814/1173823068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:51:52.663 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T14:51:52.663 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T14:51:52.663 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T14:51:52.664 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T14:51:52.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.777+0000 7f048086c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:52.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.777+0000 7f2473111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:52.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.781+0000 7f14df47f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:52.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.787+0000 7f2473111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:52.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.787+0000 7f048086c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:52.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.783+0000 7fefa7b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:52.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.792+0000 7f14df47f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:52.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.795+0000 7fefa7b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:52.826 INFO:teuthology.orchestra.run.smithi103.stdout:38654706612 2024-09-11T14:51:52.826 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T14:51:52.827 INFO:teuthology.orchestra.run.smithi103.stdout:38654706612 2024-09-11T14:51:52.828 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T14:51:52.829 INFO:teuthology.orchestra.run.smithi103.stdout:42949673907 2024-09-11T14:51:52.830 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T14:51:52.833 INFO:teuthology.orchestra.run.smithi103.stdout:38654706611 2024-09-11T14:51:52.833 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T14:51:52.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.938+0000 7f1cbd65c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:52.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.950+0000 7f1cbd65c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:52.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.983+0000 7feb50674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:52.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.983+0000 7efd7a311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:52.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.993+0000 7feb50674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:52.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.987+0000 7f741b151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:52.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.994+0000 7efd7a311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:53.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:52.998+0000 7f741b151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:53.160 INFO:teuthology.orchestra.run.smithi103.stdout:38654706607 2024-09-11T14:51:53.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706612 got 38654706607 for osd.0 2024-09-11T14:51:53.196 INFO:teuthology.orchestra.run.smithi103.stdout:38654706608 2024-09-11T14:51:53.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706612 got 38654706608 for osd.1 2024-09-11T14:51:53.225 INFO:teuthology.orchestra.run.smithi103.stdout:42949673904 2024-09-11T14:51:53.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673907 got 42949673904 for osd.3 2024-09-11T14:51:53.238 INFO:teuthology.orchestra.run.smithi103.stdout:38654706607 2024-09-11T14:51:53.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706611 got 38654706607 for osd.2 2024-09-11T14:51:54.174 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T14:51:54.211 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T14:51:54.239 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T14:51:54.253 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T14:51:54.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:54.296+0000 7f13e7688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:54.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:54.308+0000 7f13e7688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:54.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:54.334+0000 7f535aec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:54.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:54.345+0000 7f535aec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:54.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:54.378+0000 7efc6e49c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:54.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:54.387+0000 7efc6e49c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:54.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:54.397+0000 7f0c32551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:54.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:54.407+0000 7f0c32551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:54.549 INFO:teuthology.orchestra.run.smithi103.stdout:38654706613 2024-09-11T14:51:54.551 INFO:teuthology.orchestra.run.smithi103.stdout:38654706612 2024-09-11T14:51:54.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706612 got 38654706613 for osd.1 2024-09-11T14:51:54.568 DEBUG:teuthology.parallel:result is None 2024-09-11T14:51:54.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706612 got 38654706612 for osd.0 2024-09-11T14:51:54.569 DEBUG:teuthology.parallel:result is None 2024-09-11T14:51:54.597 INFO:teuthology.orchestra.run.smithi103.stdout:42949673907 2024-09-11T14:51:54.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673907 got 42949673907 for osd.3 2024-09-11T14:51:54.611 DEBUG:teuthology.parallel:result is None 2024-09-11T14:51:54.619 INFO:teuthology.orchestra.run.smithi103.stdout:38654706611 2024-09-11T14:51:54.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706611 got 38654706611 for osd.2 2024-09-11T14:51:54.633 DEBUG:teuthology.parallel:result is None 2024-09-11T14:51:54.633 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T14:51:54.633 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:51:54.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:54.775+0000 7fe168791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:54.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:54.783+0000 7fe168791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:54.966 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:51:54.967 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:51:54.979 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":574,"stamp":"2024-09-11T14:51:53.424924+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":7868,"kb_used_data":7868,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209183044,"statfs":{"total":214211493888,"available":214203437056,"internally_reserved":0,"allocated":8056832,"data_stored":8056832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.432480"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":358,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.030177+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:51:52.030177+0000","last_peered":"2024-09-11T14:51:52.030177+0000","last_clean":"2024-09-11T14:51:52.030177+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:51:52.030177+0000","last_undegraded":"2024-09-11T14:51:52.030177+0000","last_fullsized":"2024-09-11T14:51:52.030177+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":287,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.034341+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:51:52.034341+0000","last_peered":"2024-09-11T14:51:52.034341+0000","last_clean":"2024-09-11T14:51:52.034341+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:51:52.034341+0000","last_undegraded":"2024-09-11T14:51:52.034341+0000","last_fullsized":"2024-09-11T14:51:52.034341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.039000+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:51:52.039000+0000","last_peered":"2024-09-11T14:51:52.039000+0000","last_clean":"2024-09-11T14:51:52.039000+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:51:52.039000+0000","last_undegraded":"2024-09-11T14:51:52.039000+0000","last_fullsized":"2024-09-11T14:51:52.039000+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.031748+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:51:52.031748+0000","last_peered":"2024-09-11T14:51:52.031748+0000","last_clean":"2024-09-11T14:51:52.031748+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:51:52.031748+0000","last_undegraded":"2024-09-11T14:51:52.031748+0000","last_fullsized":"2024-09-11T14:51:52.031748+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":288,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.035577+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:51:52.035577+0000","last_peered":"2024-09-11T14:51:52.035577+0000","last_clean":"2024-09-11T14:51:52.035577+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:51:52.035577+0000","last_undegraded":"2024-09-11T14:51:52.035577+0000","last_fullsized":"2024-09-11T14:51:52.035577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.033975+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:51:52.033975+0000","last_peered":"2024-09-11T14:51:52.033975+0000","last_clean":"2024-09-11T14:51:52.033975+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:51:52.033975+0000","last_undegraded":"2024-09-11T14:51:52.033975+0000","last_fullsized":"2024-09-11T14:51:52.033975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.032906+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:51:52.032906+0000","last_peered":"2024-09-11T14:51:52.032906+0000","last_clean":"2024-09-11T14:51:52.032906+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:51:52.032906+0000","last_undegraded":"2024-09-11T14:51:52.032906+0000","last_fullsized":"2024-09-11T14:51:52.032906+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.033173+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:51:52.033173+0000","last_peered":"2024-09-11T14:51:52.033173+0000","last_clean":"2024-09-11T14:51:52.033173+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:51:52.033173+0000","last_undegraded":"2024-09-11T14:51:52.033173+0000","last_fullsized":"2024-09-11T14:51:52.033173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.034176+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:51:52.034176+0000","last_peered":"2024-09-11T14:51:52.034176+0000","last_clean":"2024-09-11T14:51:52.034176+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:51:52.034176+0000","last_undegraded":"2024-09-11T14:51:52.034176+0000","last_fullsized":"2024-09-11T14:51:52.034176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203428864,"internally_reserved":0,"allocated":8065024,"data_stored":8065024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1892,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295836,"statfs":{"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706611,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2528,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295200,"statfs":{"total":53552873472,"available":53550284800,"internally_reserved":0,"allocated":2588672,"data_stored":2588672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706612,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2224,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295504,"statfs":{"total":53552873472,"available":53550596096,"internally_reserved":0,"allocated":2277376,"data_stored":2277376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706613,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1224,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296504,"statfs":{"total":53552873472,"available":53551620096,"internally_reserved":0,"allocated":1253376,"data_stored":1253376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550596096,"internally_reserved":0,"allocated":2277376,"data_stored":2277376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551620096,"internally_reserved":0,"allocated":1253376,"data_stored":1253376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550276608,"internally_reserved":0,"allocated":2596864,"data_stored":2596864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:51:54.980 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:51:55.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:55.083+0000 7fc01c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:55.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:55.091+0000 7fc01c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:51:55.275 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:51:55.287 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":574,"stamp":"2024-09-11T14:51:53.424924+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":7868,"kb_used_data":7868,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209183044,"statfs":{"total":214211493888,"available":214203437056,"internally_reserved":0,"allocated":8056832,"data_stored":8056832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.432480"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":358,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.030177+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:51:52.030177+0000","last_peered":"2024-09-11T14:51:52.030177+0000","last_clean":"2024-09-11T14:51:52.030177+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:51:52.030177+0000","last_undegraded":"2024-09-11T14:51:52.030177+0000","last_fullsized":"2024-09-11T14:51:52.030177+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":287,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.034341+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:51:52.034341+0000","last_peered":"2024-09-11T14:51:52.034341+0000","last_clean":"2024-09-11T14:51:52.034341+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:51:52.034341+0000","last_undegraded":"2024-09-11T14:51:52.034341+0000","last_fullsized":"2024-09-11T14:51:52.034341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.039000+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:51:52.039000+0000","last_peered":"2024-09-11T14:51:52.039000+0000","last_clean":"2024-09-11T14:51:52.039000+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:51:52.039000+0000","last_undegraded":"2024-09-11T14:51:52.039000+0000","last_fullsized":"2024-09-11T14:51:52.039000+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.031748+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:51:52.031748+0000","last_peered":"2024-09-11T14:51:52.031748+0000","last_clean":"2024-09-11T14:51:52.031748+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:51:52.031748+0000","last_undegraded":"2024-09-11T14:51:52.031748+0000","last_fullsized":"2024-09-11T14:51:52.031748+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":288,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.035577+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:51:52.035577+0000","last_peered":"2024-09-11T14:51:52.035577+0000","last_clean":"2024-09-11T14:51:52.035577+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:51:52.035577+0000","last_undegraded":"2024-09-11T14:51:52.035577+0000","last_fullsized":"2024-09-11T14:51:52.035577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.033975+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:51:52.033975+0000","last_peered":"2024-09-11T14:51:52.033975+0000","last_clean":"2024-09-11T14:51:52.033975+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:51:52.033975+0000","last_undegraded":"2024-09-11T14:51:52.033975+0000","last_fullsized":"2024-09-11T14:51:52.033975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.032906+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:51:52.032906+0000","last_peered":"2024-09-11T14:51:52.032906+0000","last_clean":"2024-09-11T14:51:52.032906+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:51:52.032906+0000","last_undegraded":"2024-09-11T14:51:52.032906+0000","last_fullsized":"2024-09-11T14:51:52.032906+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.033173+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:51:52.033173+0000","last_peered":"2024-09-11T14:51:52.033173+0000","last_clean":"2024-09-11T14:51:52.033173+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:51:52.033173+0000","last_undegraded":"2024-09-11T14:51:52.033173+0000","last_fullsized":"2024-09-11T14:51:52.033173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.034176+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:51:52.034176+0000","last_peered":"2024-09-11T14:51:52.034176+0000","last_clean":"2024-09-11T14:51:52.034176+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:51:52.034176+0000","last_undegraded":"2024-09-11T14:51:52.034176+0000","last_fullsized":"2024-09-11T14:51:52.034176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203428864,"internally_reserved":0,"allocated":8065024,"data_stored":8065024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1892,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295836,"statfs":{"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706611,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2528,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295200,"statfs":{"total":53552873472,"available":53550284800,"internally_reserved":0,"allocated":2588672,"data_stored":2588672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706612,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2224,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295504,"statfs":{"total":53552873472,"available":53550596096,"internally_reserved":0,"allocated":2277376,"data_stored":2277376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706613,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1224,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296504,"statfs":{"total":53552873472,"available":53551620096,"internally_reserved":0,"allocated":1253376,"data_stored":1253376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550596096,"internally_reserved":0,"allocated":2277376,"data_stored":2277376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551620096,"internally_reserved":0,"allocated":1253376,"data_stored":1253376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550276608,"internally_reserved":0,"allocated":2596864,"data_stored":2596864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:51:55.288 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T14:51:55.288 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-11T14:51:55.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:55.390+0000 7fdbeb25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:55.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:55.401+0000 7fdbeb25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:55.605 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-11T14:51:55.614 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T14:51:55.615 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:51:55.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:55.718+0000 7fb8426ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:55.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:55.725+0000 7fb8426ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:55.909 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:51:55.909 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:51:55.921 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":575,"stamp":"2024-09-11T14:51:55.425464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":7876,"kb_used_data":7876,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209183036,"statfs":{"total":214211493888,"available":214203428864,"internally_reserved":0,"allocated":8065024,"data_stored":8065024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001394"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":358,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.030177+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:51:52.030177+0000","last_peered":"2024-09-11T14:51:52.030177+0000","last_clean":"2024-09-11T14:51:52.030177+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:51:52.030177+0000","last_undegraded":"2024-09-11T14:51:52.030177+0000","last_fullsized":"2024-09-11T14:51:52.030177+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":287,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.034341+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:51:52.034341+0000","last_peered":"2024-09-11T14:51:52.034341+0000","last_clean":"2024-09-11T14:51:52.034341+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:51:52.034341+0000","last_undegraded":"2024-09-11T14:51:52.034341+0000","last_fullsized":"2024-09-11T14:51:52.034341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.039000+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:51:52.039000+0000","last_peered":"2024-09-11T14:51:52.039000+0000","last_clean":"2024-09-11T14:51:52.039000+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:51:52.039000+0000","last_undegraded":"2024-09-11T14:51:52.039000+0000","last_fullsized":"2024-09-11T14:51:52.039000+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.031748+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:51:52.031748+0000","last_peered":"2024-09-11T14:51:52.031748+0000","last_clean":"2024-09-11T14:51:52.031748+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:51:52.031748+0000","last_undegraded":"2024-09-11T14:51:52.031748+0000","last_fullsized":"2024-09-11T14:51:52.031748+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":288,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.035577+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:51:52.035577+0000","last_peered":"2024-09-11T14:51:52.035577+0000","last_clean":"2024-09-11T14:51:52.035577+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:51:52.035577+0000","last_undegraded":"2024-09-11T14:51:52.035577+0000","last_fullsized":"2024-09-11T14:51:52.035577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.033975+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:51:52.033975+0000","last_peered":"2024-09-11T14:51:52.033975+0000","last_clean":"2024-09-11T14:51:52.033975+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:51:52.033975+0000","last_undegraded":"2024-09-11T14:51:52.033975+0000","last_fullsized":"2024-09-11T14:51:52.033975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.032906+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:51:52.032906+0000","last_peered":"2024-09-11T14:51:52.032906+0000","last_clean":"2024-09-11T14:51:52.032906+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:51:52.032906+0000","last_undegraded":"2024-09-11T14:51:52.032906+0000","last_fullsized":"2024-09-11T14:51:52.032906+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.033173+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:51:52.033173+0000","last_peered":"2024-09-11T14:51:52.033173+0000","last_clean":"2024-09-11T14:51:52.033173+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:51:52.033173+0000","last_undegraded":"2024-09-11T14:51:52.033173+0000","last_fullsized":"2024-09-11T14:51:52.033173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.034176+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:51:52.034176+0000","last_peered":"2024-09-11T14:51:52.034176+0000","last_clean":"2024-09-11T14:51:52.034176+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:51:52.034176+0000","last_undegraded":"2024-09-11T14:51:52.034176+0000","last_fullsized":"2024-09-11T14:51:52.034176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203428864,"internally_reserved":0,"allocated":8065024,"data_stored":8065024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1892,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295836,"statfs":{"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706612,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2536,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295192,"statfs":{"total":53552873472,"available":53550276608,"internally_reserved":0,"allocated":2596864,"data_stored":2596864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706612,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2224,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295504,"statfs":{"total":53552873472,"available":53550596096,"internally_reserved":0,"allocated":2277376,"data_stored":2277376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706613,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1224,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296504,"statfs":{"total":53552873472,"available":53551620096,"internally_reserved":0,"allocated":1253376,"data_stored":1253376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550596096,"internally_reserved":0,"allocated":2277376,"data_stored":2277376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551620096,"internally_reserved":0,"allocated":1253376,"data_stored":1253376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550276608,"internally_reserved":0,"allocated":2596864,"data_stored":2596864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:51:55.922 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:51:56.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:56.025+0000 7f7046911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:56.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:56.033+0000 7f7046911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:56.221 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:51:56.221 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:51:56.234 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":575,"stamp":"2024-09-11T14:51:55.425464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":7876,"kb_used_data":7876,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209183036,"statfs":{"total":214211493888,"available":214203428864,"internally_reserved":0,"allocated":8065024,"data_stored":8065024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001394"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":358,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.030177+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:51:52.030177+0000","last_peered":"2024-09-11T14:51:52.030177+0000","last_clean":"2024-09-11T14:51:52.030177+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:51:52.030177+0000","last_undegraded":"2024-09-11T14:51:52.030177+0000","last_fullsized":"2024-09-11T14:51:52.030177+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":287,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.034341+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:51:52.034341+0000","last_peered":"2024-09-11T14:51:52.034341+0000","last_clean":"2024-09-11T14:51:52.034341+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:51:52.034341+0000","last_undegraded":"2024-09-11T14:51:52.034341+0000","last_fullsized":"2024-09-11T14:51:52.034341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.039000+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:51:52.039000+0000","last_peered":"2024-09-11T14:51:52.039000+0000","last_clean":"2024-09-11T14:51:52.039000+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:51:52.039000+0000","last_undegraded":"2024-09-11T14:51:52.039000+0000","last_fullsized":"2024-09-11T14:51:52.039000+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.031748+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:51:52.031748+0000","last_peered":"2024-09-11T14:51:52.031748+0000","last_clean":"2024-09-11T14:51:52.031748+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:51:52.031748+0000","last_undegraded":"2024-09-11T14:51:52.031748+0000","last_fullsized":"2024-09-11T14:51:52.031748+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":288,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.035577+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:51:52.035577+0000","last_peered":"2024-09-11T14:51:52.035577+0000","last_clean":"2024-09-11T14:51:52.035577+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:51:52.035577+0000","last_undegraded":"2024-09-11T14:51:52.035577+0000","last_fullsized":"2024-09-11T14:51:52.035577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.033975+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:51:52.033975+0000","last_peered":"2024-09-11T14:51:52.033975+0000","last_clean":"2024-09-11T14:51:52.033975+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:51:52.033975+0000","last_undegraded":"2024-09-11T14:51:52.033975+0000","last_fullsized":"2024-09-11T14:51:52.033975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.032906+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:51:52.032906+0000","last_peered":"2024-09-11T14:51:52.032906+0000","last_clean":"2024-09-11T14:51:52.032906+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:51:52.032906+0000","last_undegraded":"2024-09-11T14:51:52.032906+0000","last_fullsized":"2024-09-11T14:51:52.032906+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.033173+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:51:52.033173+0000","last_peered":"2024-09-11T14:51:52.033173+0000","last_clean":"2024-09-11T14:51:52.033173+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:51:52.033173+0000","last_undegraded":"2024-09-11T14:51:52.033173+0000","last_fullsized":"2024-09-11T14:51:52.033173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.034176+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:51:52.034176+0000","last_peered":"2024-09-11T14:51:52.034176+0000","last_clean":"2024-09-11T14:51:52.034176+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:51:52.034176+0000","last_undegraded":"2024-09-11T14:51:52.034176+0000","last_fullsized":"2024-09-11T14:51:52.034176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203428864,"internally_reserved":0,"allocated":8065024,"data_stored":8065024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1892,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295836,"statfs":{"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706612,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2536,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295192,"statfs":{"total":53552873472,"available":53550276608,"internally_reserved":0,"allocated":2596864,"data_stored":2596864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706612,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2224,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295504,"statfs":{"total":53552873472,"available":53550596096,"internally_reserved":0,"allocated":2277376,"data_stored":2277376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706613,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1224,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296504,"statfs":{"total":53552873472,"available":53551620096,"internally_reserved":0,"allocated":1253376,"data_stored":1253376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550596096,"internally_reserved":0,"allocated":2277376,"data_stored":2277376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551620096,"internally_reserved":0,"allocated":1253376,"data_stored":1253376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550276608,"internally_reserved":0,"allocated":2596864,"data_stored":2596864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:51:56.235 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T14:51:56.235 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:51:56.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:56.337+0000 7fc147f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:56.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:56.345+0000 7fc147f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:56.529 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:51:56.530 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:51:56.543 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":575,"stamp":"2024-09-11T14:51:55.425464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":7876,"kb_used_data":7876,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209183036,"statfs":{"total":214211493888,"available":214203428864,"internally_reserved":0,"allocated":8065024,"data_stored":8065024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001394"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":358,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.030177+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:51:52.030177+0000","last_peered":"2024-09-11T14:51:52.030177+0000","last_clean":"2024-09-11T14:51:52.030177+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:51:52.030177+0000","last_undegraded":"2024-09-11T14:51:52.030177+0000","last_fullsized":"2024-09-11T14:51:52.030177+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":287,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.034341+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:51:52.034341+0000","last_peered":"2024-09-11T14:51:52.034341+0000","last_clean":"2024-09-11T14:51:52.034341+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:51:52.034341+0000","last_undegraded":"2024-09-11T14:51:52.034341+0000","last_fullsized":"2024-09-11T14:51:52.034341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.039000+0000","last_change":"2024-09-11T14:36:10.379344+0000","last_active":"2024-09-11T14:51:52.039000+0000","last_peered":"2024-09-11T14:51:52.039000+0000","last_clean":"2024-09-11T14:51:52.039000+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:51:52.039000+0000","last_undegraded":"2024-09-11T14:51:52.039000+0000","last_fullsized":"2024-09-11T14:51:52.039000+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.031748+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:51:52.031748+0000","last_peered":"2024-09-11T14:51:52.031748+0000","last_clean":"2024-09-11T14:51:52.031748+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:51:52.031748+0000","last_undegraded":"2024-09-11T14:51:52.031748+0000","last_fullsized":"2024-09-11T14:51:52.031748+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":288,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.035577+0000","last_change":"2024-09-11T14:36:10.372994+0000","last_active":"2024-09-11T14:51:52.035577+0000","last_peered":"2024-09-11T14:51:52.035577+0000","last_clean":"2024-09-11T14:51:52.035577+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:51:52.035577+0000","last_undegraded":"2024-09-11T14:51:52.035577+0000","last_fullsized":"2024-09-11T14:51:52.035577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.033975+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:51:52.033975+0000","last_peered":"2024-09-11T14:51:52.033975+0000","last_clean":"2024-09-11T14:51:52.033975+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:51:52.033975+0000","last_undegraded":"2024-09-11T14:51:52.033975+0000","last_fullsized":"2024-09-11T14:51:52.033975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.032906+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:51:52.032906+0000","last_peered":"2024-09-11T14:51:52.032906+0000","last_clean":"2024-09-11T14:51:52.032906+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:51:52.032906+0000","last_undegraded":"2024-09-11T14:51:52.032906+0000","last_fullsized":"2024-09-11T14:51:52.032906+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.033173+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:51:52.033173+0000","last_peered":"2024-09-11T14:51:52.033173+0000","last_clean":"2024-09-11T14:51:52.033173+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:51:52.033173+0000","last_undegraded":"2024-09-11T14:51:52.033173+0000","last_fullsized":"2024-09-11T14:51:52.033173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.034176+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:51:52.034176+0000","last_peered":"2024-09-11T14:51:52.034176+0000","last_clean":"2024-09-11T14:51:52.034176+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:51:52.034176+0000","last_undegraded":"2024-09-11T14:51:52.034176+0000","last_fullsized":"2024-09-11T14:51:52.034176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203428864,"internally_reserved":0,"allocated":8065024,"data_stored":8065024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1892,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295836,"statfs":{"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706612,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2536,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295192,"statfs":{"total":53552873472,"available":53550276608,"internally_reserved":0,"allocated":2596864,"data_stored":2596864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706612,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2224,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295504,"statfs":{"total":53552873472,"available":53550596096,"internally_reserved":0,"allocated":2277376,"data_stored":2277376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706613,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1224,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296504,"statfs":{"total":53552873472,"available":53551620096,"internally_reserved":0,"allocated":1253376,"data_stored":1253376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550596096,"internally_reserved":0,"allocated":2277376,"data_stored":2277376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551620096,"internally_reserved":0,"allocated":1253376,"data_stored":1253376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550276608,"internally_reserved":0,"allocated":2596864,"data_stored":2596864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:51:56.544 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:51:56.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:56.646+0000 7f026a2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:56.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:56.653+0000 7f026a2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:56.841 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:51:56.841 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":106,"fsid":"dc3d4a5d-c4e2-4e8c-9b89-77a2b35b981a","created":"2024-09-11T14:35:56.808520+0000","modified":"2024-09-11T14:51:52.003144+0000","last_up_change":"2024-09-11T14:36:04.272759+0000","last_in_change":"2024-09-11T14:35:58.926553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:36:05.238841+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T14:36:07.115201+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63bc9ac5-48b1-4a61-8362-266abf9e0d26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6801","nonce":2844832911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2844832911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6807","nonce":2844832911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2844832911}]},"public_addr":"172.21.15.103:6801/2844832911","cluster_addr":"172.21.15.103:6800/2844832911","heartbeat_back_addr":"172.21.15.103:6807/2844832911","heartbeat_front_addr":"172.21.15.103:6810/2844832911","state":["exists","up"]},{"osd":1,"uuid":"7cc4e987-5784-4376-aadb-d80950d62fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6803","nonce":2605657741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2605657741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6809","nonce":2605657741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2605657741}]},"public_addr":"172.21.15.103:6803/2605657741","cluster_addr":"172.21.15.103:6802/2605657741","heartbeat_back_addr":"172.21.15.103:6809/2605657741","heartbeat_front_addr":"172.21.15.103:6808/2605657741","state":["exists","up"]},{"osd":2,"uuid":"ba65111c-1360-4d9c-9d4d-171dd71c6fbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":594934649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6803","nonce":594934649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":594934649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6807","nonce":594934649}]},"public_addr":"172.21.15.176:6802/594934649","cluster_addr":"172.21.15.176:6803/594934649","heartbeat_back_addr":"172.21.15.176:6806/594934649","heartbeat_front_addr":"172.21.15.176:6807/594934649","state":["exists","up"]},{"osd":3,"uuid":"99584cad-6ea4-4cee-89a2-ae07c08ba388","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1173823068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6811","nonce":1173823068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":1173823068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1173823068}]},"public_addr":"172.21.15.176:6810/1173823068","cluster_addr":"172.21.15.176:6811/1173823068","heartbeat_back_addr":"172.21.15.176:6815/1173823068","heartbeat_front_addr":"172.21.15.176:6814/1173823068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:51:57.856 INFO:tasks.ceph:Scrubbing osd.0 2024-09-11T14:51:57.856 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-11T14:51:57.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:57.967+0000 7f9ef6151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:57.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:57.979+0000 7f9ef6151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:57.997 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T14:51:57.997 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "" 2024-09-11T14:51:57.997 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T14:51:58.008 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-11T14:51:58.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:58.111+0000 7f8a12f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:58.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:58.120+0000 7f8a12f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:58.306 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 0 to deep-scrub 2024-09-11T14:51:58.327 INFO:tasks.ceph:Scrubbing osd.1 2024-09-11T14:51:58.327 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-11T14:51:58.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:58.430+0000 7f6e48591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:58.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:58.443+0000 7f6e48591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:58.460 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T14:51:58.460 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "" 2024-09-11T14:51:58.460 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T14:51:58.471 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-11T14:51:58.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:58.574+0000 7f71622d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:58.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:58.583+0000 7f71622d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:58.770 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 1 to deep-scrub 2024-09-11T14:51:58.788 INFO:tasks.ceph:Scrubbing osd.2 2024-09-11T14:51:58.788 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-11T14:51:58.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:58.891+0000 7f9f28e4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:58.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:58.903+0000 7f9f28e4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:58.923 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T14:51:58.923 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "" 2024-09-11T14:51:58.923 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T14:51:58.934 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-11T14:51:59.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:59.037+0000 7f2ca1abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:59.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:59.045+0000 7f2ca1abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:59.234 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 2 to deep-scrub 2024-09-11T14:51:59.251 INFO:tasks.ceph:Scrubbing osd.3 2024-09-11T14:51:59.251 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-11T14:51:59.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:59.353+0000 7f862df11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:59.366+0000 7f862df11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:59.383 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T14:51:59.383 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "" 2024-09-11T14:51:59.383 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T14:51:59.395 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-11T14:51:59.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:59.497+0000 7f8e0e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:59.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:59.506+0000 7f8e0e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:59.696 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 3 to deep-scrub 2024-09-11T14:51:59.710 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:51:59.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:59.814+0000 7fcbe1097640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:51:59.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:51:59.821+0000 7fcbe1097640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:52:00.003 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:52:00.004 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:52:00.016 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":577,"stamp":"2024-09-11T14:51:59.426335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":7876,"kb_used_data":7876,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209183036,"statfs":{"total":214211493888,"available":214203428864,"internally_reserved":0,"allocated":8065024,"data_stored":8065024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.425951"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":358,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.030177+0000","last_change":"2024-09-11T14:36:06.369608+0000","last_active":"2024-09-11T14:51:52.030177+0000","last_peered":"2024-09-11T14:51:52.030177+0000","last_clean":"2024-09-11T14:51:52.030177+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:51:52.030177+0000","last_undegraded":"2024-09-11T14:51:52.030177+0000","last_fullsized":"2024-09-11T14:51:52.030177+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:05.281299+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":287,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.034341+0000","last_change":"2024-09-11T14:36:10.376173+0000","last_active":"2024-09-11T14:51:52.034341+0000","last_peered":"2024-09-11T14:51:52.034341+0000","last_clean":"2024-09-11T14:51:52.034341+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:51:52.034341+0000","last_undegraded":"2024-09-11T14:51:52.034341+0000","last_fullsized":"2024-09-11T14:51:52.034341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":288,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:58.307676+0000","last_change":"2024-09-11T14:51:58.324403+0000","last_active":"2024-09-11T14:51:58.307676+0000","last_peered":"2024-09-11T14:51:58.307676+0000","last_clean":"2024-09-11T14:51:58.307676+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:51:58.307676+0000","last_undegraded":"2024-09-11T14:51:58.307676+0000","last_fullsized":"2024-09-11T14:51:58.307676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:51:58.324214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:51:58.324214+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.031748+0000","last_change":"2024-09-11T14:36:10.370571+0000","last_active":"2024-09-11T14:51:52.031748+0000","last_peered":"2024-09-11T14:51:52.031748+0000","last_clean":"2024-09-11T14:51:52.031748+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:51:52.031748+0000","last_undegraded":"2024-09-11T14:51:52.031748+0000","last_fullsized":"2024-09-11T14:51:52.031748+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":290,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:58.307479+0000","last_change":"2024-09-11T14:51:58.333232+0000","last_active":"2024-09-11T14:51:58.307479+0000","last_peered":"2024-09-11T14:51:58.307479+0000","last_clean":"2024-09-11T14:51:58.307479+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:51:58.307479+0000","last_undegraded":"2024-09-11T14:51:58.307479+0000","last_fullsized":"2024-09-11T14:51:58.307479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'2","last_scrub_stamp":"2024-09-11T14:51:58.333020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:51:58.333020+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.033975+0000","last_change":"2024-09-11T14:36:10.376804+0000","last_active":"2024-09-11T14:51:52.033975+0000","last_peered":"2024-09-11T14:51:52.033975+0000","last_clean":"2024-09-11T14:51:52.033975+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:51:52.033975+0000","last_undegraded":"2024-09-11T14:51:52.033975+0000","last_fullsized":"2024-09-11T14:51:52.033975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.032906+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:51:52.032906+0000","last_peered":"2024-09-11T14:51:52.032906+0000","last_clean":"2024-09-11T14:51:52.032906+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:51:52.032906+0000","last_undegraded":"2024-09-11T14:51:52.032906+0000","last_fullsized":"2024-09-11T14:51:52.032906+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.033173+0000","last_change":"2024-09-11T14:36:10.376733+0000","last_active":"2024-09-11T14:51:52.033173+0000","last_peered":"2024-09-11T14:51:52.033173+0000","last_clean":"2024-09-11T14:51:52.033173+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:51:52.033173+0000","last_undegraded":"2024-09-11T14:51:52.033173+0000","last_fullsized":"2024-09-11T14:51:52.033173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":286,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:52.034176+0000","last_change":"2024-09-11T14:36:10.375611+0000","last_active":"2024-09-11T14:51:52.034176+0000","last_peered":"2024-09-11T14:51:52.034176+0000","last_clean":"2024-09-11T14:51:52.034176+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:51:52.034176+0000","last_undegraded":"2024-09-11T14:51:52.034176+0000","last_fullsized":"2024-09-11T14:51:52.034176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:36:07.290143+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203428864,"internally_reserved":0,"allocated":8065024,"data_stored":8065024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1892,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295836,"statfs":{"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706617,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2536,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295192,"statfs":{"total":53552873472,"available":53550276608,"internally_reserved":0,"allocated":2596864,"data_stored":2596864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706617,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2224,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295504,"statfs":{"total":53552873472,"available":53550596096,"internally_reserved":0,"allocated":2277376,"data_stored":2277376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706618,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1224,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296504,"statfs":{"total":53552873472,"available":53551620096,"internally_reserved":0,"allocated":1253376,"data_stored":1253376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550596096,"internally_reserved":0,"allocated":2277376,"data_stored":2277376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551620096,"internally_reserved":0,"allocated":1253376,"data_stored":1253376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550276608,"internally_reserved":0,"allocated":2596864,"data_stored":2596864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:52:00.020 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T14:36:05.281299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=36, tm_sec=5, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=51, tm_sec=56, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:52:00.020 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-11T14:36:07.290143+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=51, tm_sec=56, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:52:00.021 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-11T14:36:07.290143+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=51, tm_sec=56, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:52:00.021 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-11T14:36:07.290143+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=51, tm_sec=56, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:52:00.021 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-11T14:36:07.290143+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=51, tm_sec=56, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:52:00.021 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-11T14:36:07.290143+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=51, tm_sec=56, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:52:00.021 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-11T14:36:07.290143+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=51, tm_sec=56, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:52:00.021 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T14:52:20.022 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:52:20.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:52:20.141+0000 7f7bb18bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:52:20.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:52:20.149+0000 7f7bb18bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:52:20.338 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T14:52:20.338 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T14:52:20.351 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":587,"stamp":"2024-09-11T14:52:19.431276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":7876,"kb_used_data":7876,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209183036,"statfs":{"total":214211493888,"available":214203428864,"internally_reserved":0,"allocated":8065024,"data_stored":8065024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003048"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":360,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:59.698092+0000","last_change":"2024-09-11T14:51:59.753687+0000","last_active":"2024-09-11T14:51:59.698092+0000","last_peered":"2024-09-11T14:51:59.698092+0000","last_clean":"2024-09-11T14:51:59.698092+0000","last_became_active":"2024-09-11T14:36:06.348877+0000","last_became_peered":"2024-09-11T14:36:06.348877+0000","last_unstale":"2024-09-11T14:51:59.698092+0000","last_undegraded":"2024-09-11T14:51:59.698092+0000","last_fullsized":"2024-09-11T14:51:59.698092+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'52","last_scrub_stamp":"2024-09-11T14:51:59.753454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:51:59.753454+0000","last_clean_scrub_stamp":"2024-09-11T14:36:05.281299+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":289,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:58.773340+0000","last_change":"2024-09-11T14:51:58.796969+0000","last_active":"2024-09-11T14:51:58.773340+0000","last_peered":"2024-09-11T14:51:58.773340+0000","last_clean":"2024-09-11T14:51:58.773340+0000","last_became_active":"2024-09-11T14:36:08.442055+0000","last_became_peered":"2024-09-11T14:36:08.442055+0000","last_unstale":"2024-09-11T14:51:58.773340+0000","last_undegraded":"2024-09-11T14:51:58.773340+0000","last_fullsized":"2024-09-11T14:51:58.773340+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-09-11T14:51:58.796746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:51:58.796746+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":288,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:58.307676+0000","last_change":"2024-09-11T14:51:58.324403+0000","last_active":"2024-09-11T14:51:58.307676+0000","last_peered":"2024-09-11T14:51:58.307676+0000","last_clean":"2024-09-11T14:51:58.307676+0000","last_became_active":"2024-09-11T14:36:08.487162+0000","last_became_peered":"2024-09-11T14:36:08.487162+0000","last_unstale":"2024-09-11T14:51:58.307676+0000","last_undegraded":"2024-09-11T14:51:58.307676+0000","last_fullsized":"2024-09-11T14:51:58.307676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:51:58.324214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:51:58.324214+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":288,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:58.771409+0000","last_change":"2024-09-11T14:51:58.789437+0000","last_active":"2024-09-11T14:51:58.771409+0000","last_peered":"2024-09-11T14:51:58.771409+0000","last_clean":"2024-09-11T14:51:58.771409+0000","last_became_active":"2024-09-11T14:36:08.463446+0000","last_became_peered":"2024-09-11T14:36:08.463446+0000","last_unstale":"2024-09-11T14:51:58.771409+0000","last_undegraded":"2024-09-11T14:51:58.771409+0000","last_fullsized":"2024-09-11T14:51:58.771409+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:51:58.789261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:51:58.789261+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":290,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:58.307479+0000","last_change":"2024-09-11T14:51:58.333232+0000","last_active":"2024-09-11T14:51:58.307479+0000","last_peered":"2024-09-11T14:51:58.307479+0000","last_clean":"2024-09-11T14:51:58.307479+0000","last_became_active":"2024-09-11T14:36:08.458633+0000","last_became_peered":"2024-09-11T14:36:08.458633+0000","last_unstale":"2024-09-11T14:51:58.307479+0000","last_undegraded":"2024-09-11T14:51:58.307479+0000","last_fullsized":"2024-09-11T14:51:58.307479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'2","last_scrub_stamp":"2024-09-11T14:51:58.333020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:51:58.333020+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":288,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:59.236584+0000","last_change":"2024-09-11T14:51:59.254325+0000","last_active":"2024-09-11T14:51:59.236584+0000","last_peered":"2024-09-11T14:51:59.236584+0000","last_clean":"2024-09-11T14:51:59.236584+0000","last_became_active":"2024-09-11T14:36:08.446927+0000","last_became_peered":"2024-09-11T14:36:08.446927+0000","last_unstale":"2024-09-11T14:51:59.236584+0000","last_undegraded":"2024-09-11T14:51:59.236584+0000","last_fullsized":"2024-09-11T14:51:59.236584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:51:59.254118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:51:59.254118+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":288,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:59.700971+0000","last_change":"2024-09-11T14:51:59.722093+0000","last_active":"2024-09-11T14:51:59.700971+0000","last_peered":"2024-09-11T14:51:59.700971+0000","last_clean":"2024-09-11T14:51:59.700971+0000","last_became_active":"2024-09-11T14:36:08.434690+0000","last_became_peered":"2024-09-11T14:36:08.434690+0000","last_unstale":"2024-09-11T14:51:59.700971+0000","last_undegraded":"2024-09-11T14:51:59.700971+0000","last_fullsized":"2024-09-11T14:51:59.700971+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:51:59.721728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:51:59.721728+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":288,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:59.236579+0000","last_change":"2024-09-11T14:51:59.253253+0000","last_active":"2024-09-11T14:51:59.236579+0000","last_peered":"2024-09-11T14:51:59.236579+0000","last_clean":"2024-09-11T14:51:59.236579+0000","last_became_active":"2024-09-11T14:36:08.439123+0000","last_became_peered":"2024-09-11T14:36:08.439123+0000","last_unstale":"2024-09-11T14:51:59.236579+0000","last_undegraded":"2024-09-11T14:51:59.236579+0000","last_fullsized":"2024-09-11T14:51:59.236579+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:51:59.253030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:51:59.253030+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":288,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T14:51:58.773337+0000","last_change":"2024-09-11T14:51:58.794704+0000","last_active":"2024-09-11T14:51:58.773337+0000","last_peered":"2024-09-11T14:51:58.773337+0000","last_clean":"2024-09-11T14:51:58.773337+0000","last_became_active":"2024-09-11T14:36:08.490778+0000","last_became_peered":"2024-09-11T14:36:08.490778+0000","last_unstale":"2024-09-11T14:51:58.773337+0000","last_undegraded":"2024-09-11T14:51:58.773337+0000","last_fullsized":"2024-09-11T14:51:58.773337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:51:58.794527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:51:58.794527+0000","last_clean_scrub_stamp":"2024-09-11T14:36:07.290143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203428864,"internally_reserved":0,"allocated":8065024,"data_stored":8065024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1892,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295836,"statfs":{"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706637,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2536,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295192,"statfs":{"total":53552873472,"available":53550276608,"internally_reserved":0,"allocated":2596864,"data_stored":2596864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706637,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2224,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295504,"statfs":{"total":53552873472,"available":53550596096,"internally_reserved":0,"allocated":2277376,"data_stored":2277376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706638,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1224,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296504,"statfs":{"total":53552873472,"available":53551620096,"internally_reserved":0,"allocated":1253376,"data_stored":1253376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550596096,"internally_reserved":0,"allocated":2277376,"data_stored":2277376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551620096,"internally_reserved":0,"allocated":1253376,"data_stored":1253376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550276608,"internally_reserved":0,"allocated":2596864,"data_stored":2596864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550936064,"internally_reserved":0,"allocated":1937408,"data_stored":1937408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:52:20.353 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-11T14:52:20.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:52:20.453+0000 7f04d1991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:52:20.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T14:52:20.464+0000 7f04d1991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:52:20.673 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-11T14:52:20.674 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-11T14:52:20.674 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-11T14:52:20.674 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:52:20.750 INFO:tasks.ceph.osd.0:Stopped 2024-09-11T14:52:20.750 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-11T14:52:20.750 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:52:20.825 INFO:tasks.ceph.osd.1:Stopped 2024-09-11T14:52:20.826 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T14:52:20.826 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:52:20.908 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T14:52:20.908 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-11T14:52:20.909 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:52:20.985 INFO:tasks.ceph.osd.3:Stopped 2024-09-11T14:52:20.986 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-11T14:52:20.986 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-11T14:52:20.986 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:52:21.015 INFO:tasks.ceph.mgr.x:Stopped 2024-09-11T14:52:21.015 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-11T14:52:21.015 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T14:52:21.016 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:52:21.028 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T14:52:21.028 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-11T14:52:21.028 DEBUG:teuthology.orchestra.run.smithi103:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-11T14:52:21.100 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-11T14:52:21.100 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-11T14:52:21.316 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-11T14:52:21.316 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-11T14:52:21.420 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-11T14:52:21.421 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-11T14:52:21.524 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-11T14:52:21.525 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-11T14:52:21.620 INFO:tasks.ceph:Archiving mon data... 2024-09-11T14:52:21.621 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901362/data/mon.a.tgz 2024-09-11T14:52:21.622 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-09-11T14:52:21.638 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.rErkEy51LB 2024-09-11T14:52:21.639 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.rErkEy51LB 2024-09-11T14:52:21.757 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.rErkEy51LB 2024-09-11T14:52:21.841 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.rErkEy51LB is 243KB 2024-09-11T14:52:21.936 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.rErkEy51LB 2024-09-11T14:52:21.951 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-11T14:52:21.952 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T14:52:21.993 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T14:52:22.071 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T14:52:22.087 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T14:52:22.088 INFO:tasks.ceph:Archiving crash dumps... 2024-09-11T14:52:22.089 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901362/remote/smithi103/crash 2024-09-11T14:52:22.090 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T14:52:22.136 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901362/remote/smithi176/crash 2024-09-11T14:52:22.137 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T14:52:22.179 INFO:tasks.ceph:Compressing logs... 2024-09-11T14:52:22.179 DEBUG:teuthology.orchestra.run.smithi103:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T14:52:22.182 DEBUG:teuthology.orchestra.run.smithi176:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T14:52:22.203 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-11T14:52:22.203 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37621.log 2024-09-11T14:52:22.254 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27896.log 2024-09-11T14:52:22.255 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27856.log 2024-09-11T14:52:22.255 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.27896.log: -- /var/log/ceph/ceph-client.admin.27765.log 2024-09-11T14:52:22.255 INFO:teuthology.orchestra.run.smithi176.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.27896.log.gz 2024-09-11T14:52:22.255 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.27856.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-11T14:52:22.255 INFO:teuthology.orchestra.run.smithi176.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.27856.log.gz 2024-09-11T14:52:22.255 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.27765.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-11T14:52:22.255 INFO:teuthology.orchestra.run.smithi176.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.27765.log.gz 2024-09-11T14:52:22.255 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-11T14:52:22.255 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27816.log 2024-09-11T14:52:22.255 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.27816.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.27816.log.gz 2024-09-11T14:52:22.375 INFO:teuthology.orchestra.run.smithi176.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-11T14:52:22.577 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66507.log 2024-09-11T14:52:22.577 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62360.log 2024-09-11T14:52:22.577 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37621.log.gz 2024-09-11T14:52:22.577 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45357.log 2024-09-11T14:52:22.578 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66507.log.gz 2024-09-11T14:52:22.578 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61631.log 2024-09-11T14:52:22.578 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62360.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62360.log.gz 2024-09-11T14:52:22.578 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42677.log 2024-09-11T14:52:22.578 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45357.log.gz 2024-09-11T14:52:22.578 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60904.log 2024-09-11T14:52:22.578 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61631.log.gz 2024-09-11T14:52:22.578 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61133.log 2024-09-11T14:52:22.578 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42677.log.gz 2024-09-11T14:52:22.578 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41444.log 2024-09-11T14:52:22.578 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60904.log.gz 2024-09-11T14:52:22.578 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34029.log 2024-09-11T14:52:22.578 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61133.log.gz 2024-09-11T14:52:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39850.log 2024-09-11T14:52:22.579 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41444.log.gz 2024-09-11T14:52:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33502.log 2024-09-11T14:52:22.579 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34029.log.gz 2024-09-11T14:52:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33807.log 2024-09-11T14:52:22.579 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39850.log.gz 2024-09-11T14:52:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66843.log 2024-09-11T14:52:22.579 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33502.log.gz 2024-09-11T14:52:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57032.log 2024-09-11T14:52:22.579 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33807.log.gz 2024-09-11T14:52:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60007.log 2024-09-11T14:52:22.579 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66843.log.gz 2024-09-11T14:52:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57568.log 2024-09-11T14:52:22.580 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.57032.log.gz 2024-09-11T14:52:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32167.log 2024-09-11T14:52:22.580 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60007.log.gz 2024-09-11T14:52:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44574.log 2024-09-11T14:52:22.580 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57568.log.gz 2024-09-11T14:52:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30453.log 2024-09-11T14:52:22.580 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32167.log.gz 2024-09-11T14:52:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32517.log 2024-09-11T14:52:22.580 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44574.log.gz 2024-09-11T14:52:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61952.log 2024-09-11T14:52:22.580 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.30453.log.gz 2024-09-11T14:52:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47175.log 2024-09-11T14:52:22.581 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32517.log.gz 2024-09-11T14:52:22.581 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39810.log 2024-09-11T14:52:22.581 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61952.log.gz 2024-09-11T14:52:22.581 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58889.log 2024-09-11T14:52:22.581 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47175.log.gz 2024-09-11T14:52:22.581 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34793.log 2024-09-11T14:52:22.581 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39810.log.gz 2024-09-11T14:52:22.581 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53492.log 2024-09-11T14:52:22.581 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58889.log.gz 2024-09-11T14:52:22.581 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63645.log 2024-09-11T14:52:22.581 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34793.log.gz 2024-09-11T14:52:22.581 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60237.log 2024-09-11T14:52:22.581 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53492.log.gz 2024-09-11T14:52:22.582 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45615.log 2024-09-11T14:52:22.582 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63645.log.gz 2024-09-11T14:52:22.582 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59547.log 2024-09-11T14:52:22.582 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60237.log.gz 2024-09-11T14:52:22.582 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32300.log 2024-09-11T14:52:22.582 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45615.log.gz 2024-09-11T14:52:22.582 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29689.log 2024-09-11T14:52:22.582 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59547.log.gz 2024-09-11T14:52:22.582 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63596.log 2024-09-11T14:52:22.582 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32300.log.gz 2024-09-11T14:52:22.582 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61531.log 2024-09-11T14:52:22.582 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29689.log.gz 2024-09-11T14:52:22.582 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29687.log 2024-09-11T14:52:22.583 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63596.log.gz 2024-09-11T14:52:22.583 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59369.log 2024-09-11T14:52:22.583 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61531.log.gz 2024-09-11T14:52:22.583 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52101.log 2024-09-11T14:52:22.583 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29687.log.gz 2024-09-11T14:52:22.583 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57072.log 2024-09-11T14:52:22.583 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59369.log.gz 2024-09-11T14:52:22.583 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39180.log 2024-09-11T14:52:22.583 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52101.log.gz 2024-09-11T14:52:22.583 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42597.log 2024-09-11T14:52:22.583 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57072.log.gz 2024-09-11T14:52:22.583 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41950.log 2024-09-11T14:52:22.583 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39180.log.gz 2024-09-11T14:52:22.583 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28143.log 2024-09-11T14:52:22.584 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42597.log.gz 2024-09-11T14:52:22.584 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45010.log 2024-09-11T14:52:22.584 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41950.log.gz 2024-09-11T14:52:22.584 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49586.log 2024-09-11T14:52:22.584 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28143.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28143.log.gz 2024-09-11T14:52:22.584 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51096.log 2024-09-11T14:52:22.584 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45010.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45010.log.gz 2024-09-11T14:52:22.584 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48810.log 2024-09-11T14:52:22.584 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49586.log.gz 2024-09-11T14:52:22.584 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64185.log 2024-09-11T14:52:22.584 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51096.log.gz 2024-09-11T14:52:22.584 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65919.log 2024-09-11T14:52:22.585 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48810.log.gz 2024-09-11T14:52:22.585 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47826.log 2024-09-11T14:52:22.585 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64185.log.gz 2024-09-11T14:52:22.585 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66229.log 2024-09-11T14:52:22.585 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65919.log.gz 2024-09-11T14:52:22.585 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37463.log 2024-09-11T14:52:22.585 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47826.log.gz 2024-09-11T14:52:22.585 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36036.log 2024-09-11T14:52:22.585 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66229.log.gz 2024-09-11T14:52:22.585 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31440.log 2024-09-11T14:52:22.585 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37463.log.gz 2024-09-11T14:52:22.585 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66400.log 2024-09-11T14:52:22.586 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36036.log.gz 2024-09-11T14:52:22.586 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34689.log 2024-09-11T14:52:22.586 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31440.log.gz 2024-09-11T14:52:22.586 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29486.log 2024-09-11T14:52:22.586 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66400.log.gz 2024-09-11T14:52:22.586 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35642.log 2024-09-11T14:52:22.586 INFO:teuthology.orchestra.run.smithi103.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.34689.log.gz 2024-09-11T14:52:22.586 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55059.log 2024-09-11T14:52:22.586 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29486.log.gz 2024-09-11T14:52:22.586 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55576.log 2024-09-11T14:52:22.586 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35642.log.gz 2024-09-11T14:52:22.586 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57917.log 2024-09-11T14:52:22.586 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55059.log.gz 2024-09-11T14:52:22.587 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33711.log 2024-09-11T14:52:22.587 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55576.log.gz 2024-09-11T14:52:22.587 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38431.log 2024-09-11T14:52:22.587 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57917.log.gz 2024-09-11T14:52:22.587 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40258.log 2024-09-11T14:52:22.587 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33711.log.gz 2024-09-11T14:52:22.587 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38431.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38431.log.gz 2024-09-11T14:52:22.587 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41384.log 2024-09-11T14:52:22.587 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34207.log 2024-09-11T14:52:22.587 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40258.log.gz 2024-09-11T14:52:22.587 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37763.log 2024-09-11T14:52:22.587 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41384.log.gz 2024-09-11T14:52:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60735.log 2024-09-11T14:52:22.588 INFO:teuthology.orchestra.run.smithi103.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.34207.log.gz 2024-09-11T14:52:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48629.log 2024-09-11T14:52:22.588 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37763.log.gz 2024-09-11T14:52:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36574.log 2024-09-11T14:52:22.588 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60735.log.gz 2024-09-11T14:52:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40706.log 2024-09-11T14:52:22.588 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48629.log.gz 2024-09-11T14:52:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32249.log 2024-09-11T14:52:22.588 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36574.log.gz 2024-09-11T14:52:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59594.log 2024-09-11T14:52:22.588 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40706.log.gz 2024-09-11T14:52:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37880.log 2024-09-11T14:52:22.588 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32249.log.gz 2024-09-11T14:52:22.589 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58275.log 2024-09-11T14:52:22.589 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.59594.log.gz 2024-09-11T14:52:22.589 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33900.log 2024-09-11T14:52:22.589 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.37880.log: /var/log/ceph/ceph-client.admin.58275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36525.log 2024-09-11T14:52:22.589 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58275.log.gz 2024-09-11T14:52:22.589 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43024.log 2024-09-11T14:52:22.589 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33900.log.gz 2024-09-11T14:52:22.589 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39556.log 2024-09-11T14:52:22.589 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36525.log.gz 2024-09-11T14:52:22.589 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62714.log 2024-09-11T14:52:22.589 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43024.log.gz 2024-09-11T14:52:22.589 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32118.log 2024-09-11T14:52:22.589 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39556.log.gz 2024-09-11T14:52:22.590 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62714.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.62714.log.gz 2024-09-11T14:52:22.590 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43987.log 2024-09-11T14:52:22.590 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40996.log 2024-09-11T14:52:22.590 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32118.log.gz 2024-09-11T14:52:22.590 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39536.log 2024-09-11T14:52:22.590 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43987.log.gz 2024-09-11T14:52:22.590 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52061.log 2024-09-11T14:52:22.590 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40996.log.gz 2024-09-11T14:52:22.590 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40209.log 2024-09-11T14:52:22.590 INFO:teuthology.orchestra.run.smithi103.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.39536.log.gz 2024-09-11T14:52:22.590 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41244.log 2024-09-11T14:52:22.590 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52061.log.gz 2024-09-11T14:52:22.590 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39943.log 2024-09-11T14:52:22.590 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40209.log.gz 2024-09-11T14:52:22.590 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29147.log 2024-09-11T14:52:22.591 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41244.log.gz 2024-09-11T14:52:22.591 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39943.log: gzip -5 --verbose -- 49.6% /var/log/ceph/ceph-client.admin.53773.log 2024-09-11T14:52:22.591 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39943.log.gz 2024-09-11T14:52:22.591 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30685.log 2024-09-11T14:52:22.591 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29147.log.gz 2024-09-11T14:52:22.591 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56136.log 2024-09-11T14:52:22.591 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53773.log.gz 2024-09-11T14:52:22.591 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30685.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.30685.log.gz 2024-09-11T14:52:22.591 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32342.log 2024-09-11T14:52:22.591 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58542.log 2024-09-11T14:52:22.591 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56136.log.gz 2024-09-11T14:52:22.591 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32342.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.32342.log.gz 2024-09-11T14:52:22.591 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59419.log 2024-09-11T14:52:22.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29148.log 2024-09-11T14:52:22.592 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58542.log.gz 2024-09-11T14:52:22.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34771.log 2024-09-11T14:52:22.592 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59419.log.gz 2024-09-11T14:52:22.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36365.log 2024-09-11T14:52:22.592 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29148.log.gz 2024-09-11T14:52:22.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34771.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34771.log.gz 2024-09-11T14:52:22.592 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48271.log 2024-09-11T14:52:22.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53632.log 2024-09-11T14:52:22.592 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36365.log.gz 2024-09-11T14:52:22.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47077.log 2024-09-11T14:52:22.592 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48271.log.gz 2024-09-11T14:52:22.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61229.log 2024-09-11T14:52:22.592 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53632.log.gz 2024-09-11T14:52:22.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38200.log 2024-09-11T14:52:22.593 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47077.log.gz 2024-09-11T14:52:22.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30138.log 2024-09-11T14:52:22.593 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61229.log.gz 2024-09-11T14:52:22.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51722.log 2024-09-11T14:52:22.593 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38200.log.gz 2024-09-11T14:52:22.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61322.log 2024-09-11T14:52:22.593 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30138.log.gz 2024-09-11T14:52:22.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51722.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-11T14:52:22.593 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51722.log.gz 2024-09-11T14:52:22.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62498.log 2024-09-11T14:52:22.593 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61322.log.gz 2024-09-11T14:52:22.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47706.log 2024-09-11T14:52:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31703.log 2024-09-11T14:52:22.594 INFO:teuthology.orchestra.run.smithi103.stderr: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.62498.log.gz 2024-09-11T14:52:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55856.log 2024-09-11T14:52:22.594 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47706.log.gz 2024-09-11T14:52:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38711.log 2024-09-11T14:52:22.594 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31703.log.gz 2024-09-11T14:52:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31044.log 2024-09-11T14:52:22.594 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55856.log.gz 2024-09-11T14:52:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36316.log 2024-09-11T14:52:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38711.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38711.log.gz 2024-09-11T14:52:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31044.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31044.log.gz 2024-09-11T14:52:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53724.log 2024-09-11T14:52:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30875.log 2024-09-11T14:52:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36316.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36316.log.gz 2024-09-11T14:52:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53724.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53724.log.gz 2024-09-11T14:52:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51940.log 2024-09-11T14:52:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49775.log 2024-09-11T14:52:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30875.log: /var/log/ceph/ceph-client.admin.51940.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.30875.log.gz 2024-09-11T14:52:22.595 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51940.log.gz 2024-09-11T14:52:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32677.log 2024-09-11T14:52:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63427.log 2024-09-11T14:52:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49775.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.49775.log.gz 2024-09-11T14:52:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59916.log 2024-09-11T14:52:22.595 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32677.log.gz 2024-09-11T14:52:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32915.log 2024-09-11T14:52:22.596 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63427.log.gz 2024-09-11T14:52:22.596 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64265.log 2024-09-11T14:52:22.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59916.log: 50.0%/var/log/ceph/ceph-client.admin.32915.log: -- replaced with /var/log/ceph/ceph-client.admin.59916.log.gz 2024-09-11T14:52:22.596 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32915.log.gz 2024-09-11T14:52:22.596 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46677.log 2024-09-11T14:52:22.596 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44196.log 2024-09-11T14:52:22.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64265.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64265.log.gz 2024-09-11T14:52:22.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47875.log 2024-09-11T14:52:22.596 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46677.log.gz 2024-09-11T14:52:22.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65625.log 2024-09-11T14:52:22.596 INFO:teuthology.orchestra.run.smithi103.stderr: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.44196.log.gz 2024-09-11T14:52:22.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40797.log 2024-09-11T14:52:22.596 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47875.log.gz 2024-09-11T14:52:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32866.log 2024-09-11T14:52:22.597 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.65625.log.gz 2024-09-11T14:52:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51584.log 2024-09-11T14:52:22.597 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40797.log.gz 2024-09-11T14:52:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61673.log 2024-09-11T14:52:22.597 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32866.log.gz 2024-09-11T14:52:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60546.log 2024-09-11T14:52:22.597 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51584.log.gz 2024-09-11T14:52:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55318.log 2024-09-11T14:52:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61673.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61673.log.gz 2024-09-11T14:52:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60546.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.60546.log.gz 2024-09-11T14:52:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45313.log 2024-09-11T14:52:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55268.log 2024-09-11T14:52:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55318.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55318.log.gz 2024-09-11T14:52:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42508.log 2024-09-11T14:52:22.598 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45313.log.gz 2024-09-11T14:52:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55268.log: gzip -5 --verbose -- 49.6% /var/log/ceph/ceph-client.admin.62540.log -- replaced with /var/log/ceph/ceph-client.admin.55268.log.gz 2024-09-11T14:52:22.598 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45252.log 2024-09-11T14:52:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42508.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42508.log.gz 2024-09-11T14:52:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61182.log 2024-09-11T14:52:22.598 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62540.log.gz 2024-09-11T14:52:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44294.log 2024-09-11T14:52:22.598 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45252.log.gz 2024-09-11T14:52:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43938.log 2024-09-11T14:52:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61182.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61182.log.gz 2024-09-11T14:52:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42291.log 2024-09-11T14:52:22.599 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44294.log.gz 2024-09-11T14:52:22.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48182.log 2024-09-11T14:52:22.599 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43938.log.gz 2024-09-11T14:52:22.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29108.log 2024-09-11T14:52:22.599 INFO:teuthology.orchestra.run.smithi103.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.42291.log.gz 2024-09-11T14:52:22.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42419.log 2024-09-11T14:52:22.599 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48182.log.gz 2024-09-11T14:52:22.599 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28999.log 2024-09-11T14:52:22.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29108.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29108.log.gz 2024-09-11T14:52:22.599 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40966.log 2024-09-11T14:52:22.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42419.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42419.log.gz 2024-09-11T14:52:22.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43113.log 2024-09-11T14:52:22.599 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28999.log.gz 2024-09-11T14:52:22.600 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37079.log 2024-09-11T14:52:22.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40966.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40966.log.gz 2024-09-11T14:52:22.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33620.log 2024-09-11T14:52:22.600 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43113.log.gz 2024-09-11T14:52:22.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37079.log: gzip 49.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.37079.log.gz --verbose 2024-09-11T14:52:22.600 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.31642.log 2024-09-11T14:52:22.600 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31887.log 2024-09-11T14:52:22.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33620.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33620.log.gz 2024-09-11T14:52:22.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43638.log 2024-09-11T14:52:22.600 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31642.log.gz 2024-09-11T14:52:22.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58720.log 2024-09-11T14:52:22.600 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31887.log.gz 2024-09-11T14:52:22.600 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66633.log 2024-09-11T14:52:22.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43638.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43638.log.gz 2024-09-11T14:52:22.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58720.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.58720.log.gz 2024-09-11T14:52:22.601 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65583.log 2024-09-11T14:52:22.601 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57170.log 2024-09-11T14:52:22.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66633.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66633.log.gz 2024-09-11T14:52:22.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65583.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.65583.log.gz 2024-09-11T14:52:22.601 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50391.log 2024-09-11T14:52:22.601 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51980.log 2024-09-11T14:52:22.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57170.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57170.log.gz 2024-09-11T14:52:22.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50391.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50391.log.gz 2024-09-11T14:52:22.601 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39487.log 2024-09-11T14:52:22.601 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65031.log 2024-09-11T14:52:22.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51980.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51980.log.gz 2024-09-11T14:52:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39487.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39487.log.gz 2024-09-11T14:52:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56492.log 2024-09-11T14:52:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50754.log 2024-09-11T14:52:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65031.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65031.log.gz 2024-09-11T14:52:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65151.log 2024-09-11T14:52:22.602 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56492.log.gz 2024-09-11T14:52:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54959.log 2024-09-11T14:52:22.602 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50754.log.gz 2024-09-11T14:52:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38340.log 2024-09-11T14:52:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65151.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65151.log.gz 2024-09-11T14:52:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46056.log 2024-09-11T14:52:22.602 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54959.log.gz 2024-09-11T14:52:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49202.log 2024-09-11T14:52:22.603 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38340.log.gz 2024-09-11T14:52:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41104.log 2024-09-11T14:52:22.603 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46056.log.gz 2024-09-11T14:52:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53583.log 2024-09-11T14:52:22.603 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49202.log.gz 2024-09-11T14:52:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31531.log 2024-09-11T14:52:22.603 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41104.log.gz 2024-09-11T14:52:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59327.log 2024-09-11T14:52:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53583.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53583.log.gz 2024-09-11T14:52:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31531.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31531.log.gz 2024-09-11T14:52:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31482.log 2024-09-11T14:52:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53675.log 2024-09-11T14:52:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59327.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59327.log.gz 2024-09-11T14:52:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30404.log 2024-09-11T14:52:22.604 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31482.log.gz 2024-09-11T14:52:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66062.log 2024-09-11T14:52:22.604 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53675.log.gz 2024-09-11T14:52:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62191.log 2024-09-11T14:52:22.604 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30404.log.gz 2024-09-11T14:52:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51802.log 2024-09-11T14:52:22.604 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66062.log.gz 2024-09-11T14:52:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64584.log 2024-09-11T14:52:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62191.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62191.log.gz 2024-09-11T14:52:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60824.log 2024-09-11T14:52:22.604 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51802.log.gz 2024-09-11T14:52:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62631.log 2024-09-11T14:52:22.605 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64584.log.gz 2024-09-11T14:52:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63918.log 2024-09-11T14:52:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60824.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60824.log.gz 2024-09-11T14:52:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53094.log 2024-09-11T14:52:22.605 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62631.log.gz 2024-09-11T14:52:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66675.log 2024-09-11T14:52:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63918.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.63918.log.gz 2024-09-11T14:52:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49328.log 2024-09-11T14:52:22.605 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53094.log.gz 2024-09-11T14:52:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66675.log: gzip -5 49.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.66675.log.gz 2024-09-11T14:52:22.605 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.55905.log 2024-09-11T14:52:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35242.log 2024-09-11T14:52:22.605 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49328.log.gz 2024-09-11T14:52:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58404.log 2024-09-11T14:52:22.606 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55905.log.gz 2024-09-11T14:52:22.606 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38755.log 2024-09-11T14:52:22.606 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35242.log.gz 2024-09-11T14:52:22.606 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34514.log 2024-09-11T14:52:22.606 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58404.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58404.log.gz 2024-09-11T14:52:22.606 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38755.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38755.log.gz 2024-09-11T14:52:22.606 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38071.log 2024-09-11T14:52:22.606 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53394.log 2024-09-11T14:52:22.606 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34514.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34514.log.gz 2024-09-11T14:52:22.606 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35560.log 2024-09-11T14:52:22.606 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38071.log.gz 2024-09-11T14:52:22.606 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47035.log 2024-09-11T14:52:22.607 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53394.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53394.log.gz 2024-09-11T14:52:22.607 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49684.log 2024-09-11T14:52:22.607 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35560.log.gz 2024-09-11T14:52:22.607 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52954.log 2024-09-11T14:52:22.607 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47035.log.gz 2024-09-11T14:52:22.607 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64443.log 2024-09-11T14:52:22.607 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49684.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49684.log.gz 2024-09-11T14:52:22.607 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52954.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52954.log.gz 2024-09-11T14:52:22.607 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53853.log 2024-09-11T14:52:22.607 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37721.log 2024-09-11T14:52:22.607 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64443.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64443.log.gz 2024-09-11T14:52:22.607 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61811.log 2024-09-11T14:52:22.607 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53853.log.gz 2024-09-11T14:52:22.608 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43236.log 2024-09-11T14:52:22.608 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37721.log.gz 2024-09-11T14:52:22.608 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52185.log 2024-09-11T14:52:22.608 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61811.log.gz 2024-09-11T14:52:22.608 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64793.log 2024-09-11T14:52:22.608 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43236.log.gz 2024-09-11T14:52:22.608 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50311.log 2024-09-11T14:52:22.608 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52185.log.gz 2024-09-11T14:52:22.608 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54870.log 2024-09-11T14:52:22.608 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64793.log.gz 2024-09-11T14:52:22.608 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47266.log 2024-09-11T14:52:22.609 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.50311.log.gz 2024-09-11T14:52:22.609 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50620.log 2024-09-11T14:52:22.609 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54870.log.gz 2024-09-11T14:52:22.609 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47266.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47266.log.gz 2024-09-11T14:52:22.609 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54240.log 2024-09-11T14:52:22.609 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46539.log 2024-09-11T14:52:22.609 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50620.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50620.log.gz 2024-09-11T14:52:22.609 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66061.log 2024-09-11T14:52:22.609 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.54240.log.gz 2024-09-11T14:52:22.609 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43589.log 2024-09-11T14:52:22.609 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46539.log.gz 2024-09-11T14:52:22.609 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36714.log 2024-09-11T14:52:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66061.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66061.log.gz 2024-09-11T14:52:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35380.log 2024-09-11T14:52:22.610 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43589.log.gz 2024-09-11T14:52:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28688.log 2024-09-11T14:52:22.610 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36714.log.gz 2024-09-11T14:52:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40067.log 2024-09-11T14:52:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35380.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35380.log.gz 2024-09-11T14:52:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30067.log 2024-09-11T14:52:22.610 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.28688.log.gz 2024-09-11T14:52:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29360.log 2024-09-11T14:52:22.610 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40067.log.gz 2024-09-11T14:52:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39696.log 2024-09-11T14:52:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30067.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30067.log.gz 2024-09-11T14:52:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29360.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29360.log.gz 2024-09-11T14:52:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65309.log 2024-09-11T14:52:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54639.log 2024-09-11T14:52:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39696.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.39696.log.gz 2024-09-11T14:52:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64982.log 2024-09-11T14:52:22.611 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65309.log.gz 2024-09-11T14:52:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47217.log 2024-09-11T14:52:22.611 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54639.log.gz 2024-09-11T14:52:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55010.log 2024-09-11T14:52:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64982.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.64982.log.gz 2024-09-11T14:52:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47217.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47217.log.gz 2024-09-11T14:52:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45050.log 2024-09-11T14:52:22.612 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49035.log 2024-09-11T14:52:22.612 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55010.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55010.log.gz 2024-09-11T14:52:22.612 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34416.log 2024-09-11T14:52:22.612 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45050.log.gz 2024-09-11T14:52:22.612 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32209.log 2024-09-11T14:52:22.612 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49035.log.gz 2024-09-11T14:52:22.612 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62238.log 2024-09-11T14:52:22.612 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34416.log.gz 2024-09-11T14:52:22.612 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46895.log 2024-09-11T14:52:22.612 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32209.log.gz 2024-09-11T14:52:22.612 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45495.log 2024-09-11T14:52:22.612 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62238.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62238.log.gz 2024-09-11T14:52:22.612 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46895.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46895.log.gz 2024-09-11T14:52:22.613 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.38249.log 2024-09-11T14:52:22.613 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45495.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45495.log.gz 2024-09-11T14:52:22.613 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30180.log 2024-09-11T14:52:22.613 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38249.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38249.log.gz 2024-09-11T14:52:22.613 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59678.log 2024-09-11T14:52:22.613 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.30180.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34731.log 2024-09-11T14:52:22.613 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30180.log.gz 2024-09-11T14:52:22.613 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59678.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59678.log.gz 2024-09-11T14:52:22.613 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57986.log 2024-09-11T14:52:22.613 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54151.log 2024-09-11T14:52:22.613 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34731.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.34731.log.gz 2024-09-11T14:52:22.613 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30915.log 2024-09-11T14:52:22.613 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57986.log.gz 2024-09-11T14:52:22.614 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43460.log 2024-09-11T14:52:22.614 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54151.log.gz 2024-09-11T14:52:22.614 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38803.log 2024-09-11T14:52:22.614 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30915.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30915.log.gz 2024-09-11T14:52:22.614 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39278.log 2024-09-11T14:52:22.614 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43460.log.gz 2024-09-11T14:52:22.614 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51497.log 2024-09-11T14:52:22.614 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38803.log.gz 2024-09-11T14:52:22.614 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59502.log 2024-09-11T14:52:22.614 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39278.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39278.log.gz 2024-09-11T14:52:22.614 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35471.log 2024-09-11T14:52:22.614 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51497.log.gz 2024-09-11T14:52:22.614 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49915.log 2024-09-11T14:52:22.615 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59502.log.gz 2024-09-11T14:52:22.615 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51891.log 2024-09-11T14:52:22.615 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35471.log.gz 2024-09-11T14:52:22.615 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49915.log: 50.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.49915.log.gz 2024-09-11T14:52:22.615 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44116.log 2024-09-11T14:52:22.615 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57261.log 2024-09-11T14:52:22.615 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51891.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51891.log.gz 2024-09-11T14:52:22.615 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42459.log 2024-09-11T14:52:22.615 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44116.log.gz 2024-09-11T14:52:22.615 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57261.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57261.log.gz 2024-09-11T14:52:22.615 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55184.log 2024-09-11T14:52:22.615 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42557.log 2024-09-11T14:52:22.615 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42459.log.gz 2024-09-11T14:52:22.615 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66549.log 2024-09-11T14:52:22.616 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55184.log.gz 2024-09-11T14:52:22.616 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38291.log 2024-09-11T14:52:22.616 INFO:teuthology.orchestra.run.smithi103.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.42557.log.gz 2024-09-11T14:52:22.616 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63290.log 2024-09-11T14:52:22.616 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66549.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66549.log.gz 2024-09-11T14:52:22.616 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65459.log 2024-09-11T14:52:22.616 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38291.log.gz 2024-09-11T14:52:22.616 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49866.log 2024-09-11T14:52:22.616 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63290.log.gz 2024-09-11T14:52:22.616 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47624.log 2024-09-11T14:52:22.616 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65459.log.gz 2024-09-11T14:52:22.616 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49866.log: gzip 50.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.49866.log.gz --verbose 2024-09-11T14:52:22.616 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.37620.log 2024-09-11T14:52:22.617 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46757.log 2024-09-11T14:52:22.617 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47624.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.47624.log.gz 2024-09-11T14:52:22.617 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30996.log 2024-09-11T14:52:22.617 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37620.log.gz 2024-09-11T14:52:22.617 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62735.log 2024-09-11T14:52:22.617 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46757.log.gz 2024-09-11T14:52:22.617 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67095.log 2024-09-11T14:52:22.617 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30996.log.gz 2024-09-11T14:52:22.617 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35122.log 2024-09-11T14:52:22.617 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62735.log.gz 2024-09-11T14:52:22.617 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28830.log 2024-09-11T14:52:22.617 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67095.log.gz 2024-09-11T14:52:22.617 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31620.log 2024-09-11T14:52:22.617 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35122.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35122.log.gz 2024-09-11T14:52:22.618 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33184.log 2024-09-11T14:52:22.618 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28830.log.gz 2024-09-11T14:52:22.618 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61911.log 2024-09-11T14:52:22.618 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31620.log.gz 2024-09-11T14:52:22.618 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54374.log 2024-09-11T14:52:22.618 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33184.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33184.log.gz 2024-09-11T14:52:22.618 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35202.log 2024-09-11T14:52:22.618 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61911.log.gz 2024-09-11T14:52:22.618 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60644.log 2024-09-11T14:52:22.618 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54374.log.gz 2024-09-11T14:52:22.618 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33224.log 2024-09-11T14:52:22.618 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35202.log.gz 2024-09-11T14:52:22.618 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48720.log 2024-09-11T14:52:22.618 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60644.log.gz 2024-09-11T14:52:22.618 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65709.log 2024-09-11T14:52:22.619 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33224.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33224.log.gz 2024-09-11T14:52:22.619 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47991.log 2024-09-11T14:52:22.619 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48720.log.gz 2024-09-11T14:52:22.619 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36405.log 2024-09-11T14:52:22.619 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.65709.log.gz 2024-09-11T14:52:22.619 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56952.log 2024-09-11T14:52:22.619 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47991.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47991.log.gz 2024-09-11T14:52:22.619 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51234.log 2024-09-11T14:52:22.619 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36405.log.gz 2024-09-11T14:52:22.619 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47964.log 2024-09-11T14:52:22.619 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56952.log.gz 2024-09-11T14:52:22.619 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48090.log 2024-09-11T14:52:22.619 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51234.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51234.log.gz 2024-09-11T14:52:22.619 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46633.log 2024-09-11T14:52:22.620 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47964.log.gz 2024-09-11T14:52:22.620 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45704.log 2024-09-11T14:52:22.620 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48090.log.gz 2024-09-11T14:52:22.620 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38931.log 2024-09-11T14:52:22.620 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46633.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46633.log.gz 2024-09-11T14:52:22.620 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45704.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45704.log.gz 2024-09-11T14:52:22.620 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40427.log 2024-09-11T14:52:22.620 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28222.log 2024-09-11T14:52:22.620 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38931.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.38931.log.gz 2024-09-11T14:52:22.620 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51185.log 2024-09-11T14:52:22.620 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz 2024-09-11T14:52:22.620 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58498.log 2024-09-11T14:52:22.620 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28222.log.gz 2024-09-11T14:52:22.620 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.51185.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62320.log 2024-09-11T14:52:22.621 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51185.log.gz 2024-09-11T14:52:22.621 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53314.log 2024-09-11T14:52:22.621 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58498.log.gz 2024-09-11T14:52:22.621 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50798.log/var/log/ceph/ceph-client.admin.62320.log: 2024-09-11T14:52:22.621 INFO:teuthology.orchestra.run.smithi103.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.62320.log.gz 2024-09-11T14:52:22.621 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53314.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52764.log 2024-09-11T14:52:22.621 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53314.log.gz 2024-09-11T14:52:22.621 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T14:52:22.621 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50798.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50798.log.gz 2024-09-11T14:52:22.621 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59958.log 2024-09-11T14:52:22.621 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52764.log.gz 2024-09-11T14:52:22.621 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58740.log 2024-09-11T14:52:22.621 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.59958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53185.log 2024-09-11T14:52:22.621 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59958.log.gz 2024-09-11T14:52:22.622 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62142.log 2024-09-11T14:52:22.622 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58740.log.gz 2024-09-11T14:52:22.622 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31789.log 2024-09-11T14:52:22.622 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53185.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53185.log.gz 2024-09-11T14:52:22.622 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50927.log 2024-09-11T14:52:22.622 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62142.log.gz 2024-09-11T14:52:22.622 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50878.log 2024-09-11T14:52:22.622 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31789.log.gz 2024-09-11T14:52:22.622 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44970.log 2024-09-11T14:52:22.622 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50927.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50927.log.gz 2024-09-11T14:52:22.622 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50878.log: 88.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T14:52:22.622 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42855.log 2024-09-11T14:52:22.622 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50878.log.gz 2024-09-11T14:52:22.623 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44434.log 2024-09-11T14:52:22.623 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44970.log.gz 2024-09-11T14:52:22.623 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.42855.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62560.log 2024-09-11T14:52:22.623 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42855.log.gz 2024-09-11T14:52:22.623 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50271.log 2024-09-11T14:52:22.623 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44434.log.gz 2024-09-11T14:52:22.623 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58671.log 2024-09-11T14:52:22.623 INFO:teuthology.orchestra.run.smithi103.stderr: 48.4% -- replaced with /var/log/ceph/ceph-client.admin.62560.log.gz 2024-09-11T14:52:22.623 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49466.log 2024-09-11T14:52:22.623 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50271.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.50271.log.gz 2024-09-11T14:52:22.623 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40585.log 2024-09-11T14:52:22.623 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58671.log.gz 2024-09-11T14:52:22.623 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31182.log 2024-09-11T14:52:22.623 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49466.log.gz 2024-09-11T14:52:22.624 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29914.log 2024-09-11T14:52:22.624 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40585.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40585.log.gz 2024-09-11T14:52:22.624 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38886.log 2024-09-11T14:52:22.624 INFO:teuthology.orchestra.run.smithi103.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.31182.log.gz 2024-09-11T14:52:22.624 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52813.log 2024-09-11T14:52:22.624 INFO:teuthology.orchestra.run.smithi103.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.29914.log.gz 2024-09-11T14:52:22.624 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34069.log 2024-09-11T14:52:22.624 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38886.log.gz 2024-09-11T14:52:22.624 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36085.log 2024-09-11T14:52:22.624 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52813.log.gz 2024-09-11T14:52:22.624 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67137.log 2024-09-11T14:52:22.624 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34069.log.gz 2024-09-11T14:52:22.625 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45090.log 2024-09-11T14:52:22.625 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36085.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36085.log.gz 2024-09-11T14:52:22.625 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48391.log 2024-09-11T14:52:22.625 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67137.log.gz 2024-09-11T14:52:22.625 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44843.log 2024-09-11T14:52:22.625 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45090.log.gz 2024-09-11T14:52:22.625 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58315.log 2024-09-11T14:52:22.625 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48391.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48391.log.gz 2024-09-11T14:52:22.625 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66717.log 2024-09-11T14:52:22.625 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44843.log.gz 2024-09-11T14:52:22.625 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65289.log 2024-09-11T14:52:22.625 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58315.log.gz 2024-09-11T14:52:22.625 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29857.log 2024-09-11T14:52:22.625 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66717.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66717.log.gz 2024-09-11T14:52:22.626 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54504.log 2024-09-11T14:52:22.626 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65289.log.gz 2024-09-11T14:52:22.626 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.29857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51136.log 2024-09-11T14:52:22.626 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66591.log 2024-09-11T14:52:22.626 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54504.log.gz 2024-09-11T14:52:22.626 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33949.log 2024-09-11T14:52:22.626 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51136.log.gz 2024-09-11T14:52:22.626 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60099.log 2024-09-11T14:52:22.626 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66591.log.gz 2024-09-11T14:52:22.626 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32027.log 2024-09-11T14:52:22.626 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33949.log.gz 2024-09-11T14:52:22.626 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28832.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60099.log.gz 2024-09-11T14:52:22.626 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.627 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32027.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32027.log.gz 2024-09-11T14:52:22.627 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65499.log 2024-09-11T14:52:22.627 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64891.log 2024-09-11T14:52:22.627 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.28832.log.gz 2024-09-11T14:52:22.627 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33442.log 2024-09-11T14:52:22.627 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65499.log.gz 2024-09-11T14:52:22.627 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61581.log 2024-09-11T14:52:22.627 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64891.log.gz 2024-09-11T14:52:22.627 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33442.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33442.log.gz 2024-09-11T14:52:22.627 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.51543.log 2024-09-11T14:52:22.627 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61581.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61581.log.gz 2024-09-11T14:52:22.627 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43898.log 2024-09-11T14:52:22.627 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51543.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51543.log.gz 2024-09-11T14:52:22.628 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.39100.log 2024-09-11T14:52:22.628 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43898.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43898.log.gz 2024-09-11T14:52:22.628 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30005.log 2024-09-11T14:52:22.628 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39100.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39100.log.gz 2024-09-11T14:52:22.628 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.49635.log 2024-09-11T14:52:22.628 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30005.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30005.log.gz 2024-09-11T14:52:22.628 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31262.log 2024-09-11T14:52:22.628 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49635.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49635.log.gz 2024-09-11T14:52:22.628 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42072.log 2024-09-11T14:52:22.628 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31262.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31262.log.gz 2024-09-11T14:52:22.628 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41685.log 2024-09-11T14:52:22.628 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42072.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42072.log.gz 2024-09-11T14:52:22.628 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.29590.log 2024-09-11T14:52:22.628 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41685.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41685.log.gz 2024-09-11T14:52:22.629 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53893.log 2024-09-11T14:52:22.629 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29590.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29590.log.gz 2024-09-11T14:52:22.629 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39440.log 2024-09-11T14:52:22.629 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53893.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53893.log.gz 2024-09-11T14:52:22.629 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46257.log 2024-09-11T14:52:22.629 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39440.log: gzip -5 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39440.log.gz 2024-09-11T14:52:22.629 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41553.log 2024-09-11T14:52:22.629 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46257.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46257.log.gz 2024-09-11T14:52:22.629 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40657.log 2024-09-11T14:52:22.629 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56205.log 2024-09-11T14:52:22.629 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41553.log.gz 2024-09-11T14:52:22.629 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41859.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40657.log.gz 2024-09-11T14:52:22.629 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.629 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56205.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56205.log.gz 2024-09-11T14:52:22.630 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64072.log 2024-09-11T14:52:22.630 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41859.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41859.log.gz 2024-09-11T14:52:22.630 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38978.log 2024-09-11T14:52:22.630 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64072.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64072.log.gz 2024-09-11T14:52:22.630 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63129.log 2024-09-11T14:52:22.630 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37561.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38978.log.gz 2024-09-11T14:52:22.630 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.630 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63129.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63129.log.gz 2024-09-11T14:52:22.630 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57519.log 2024-09-11T14:52:22.630 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37561.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37561.log.gz 2024-09-11T14:52:22.630 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.29318.log 2024-09-11T14:52:22.630 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57519.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57519.log.gz 2024-09-11T14:52:22.631 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51633.log 2024-09-11T14:52:22.631 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29318.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29318.log.gz 2024-09-11T14:52:22.631 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.46346.log 2024-09-11T14:52:22.631 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51633.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51633.log.gz 2024-09-11T14:52:22.631 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30047.log 2024-09-11T14:52:22.631 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46346.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46346.log.gz 2024-09-11T14:52:22.631 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.58126.log 2024-09-11T14:52:22.631 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30047.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30047.log.gz 2024-09-11T14:52:22.631 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39895.log 2024-09-11T14:52:22.631 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58126.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58126.log.gz 2024-09-11T14:52:22.631 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.54555.log 2024-09-11T14:52:22.631 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39895.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39895.log.gz 2024-09-11T14:52:22.631 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65751.log 2024-09-11T14:52:22.631 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54555.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54555.log.gz 2024-09-11T14:52:22.632 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30826.log 2024-09-11T14:52:22.632 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38621.log 2024-09-11T14:52:22.632 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.65751.log.gz 2024-09-11T14:52:22.632 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30826.log: gzip -5 --verbose -- 49.6% /var/log/ceph/ceph-client.admin.44663.log 2024-09-11T14:52:22.632 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30826.log.gz 2024-09-11T14:52:22.632 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28520.log 2024-09-11T14:52:22.632 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38621.log.gz 2024-09-11T14:52:22.632 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44663.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44663.log.gz 2024-09-11T14:52:22.632 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.40926.log 2024-09-11T14:52:22.632 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28520.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28520.log.gz 2024-09-11T14:52:22.632 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65171.log 2024-09-11T14:52:22.632 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30545.log 2024-09-11T14:52:22.632 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40926.log.gz 2024-09-11T14:52:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65171.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65171.log.gz 2024-09-11T14:52:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45847.log 2024-09-11T14:52:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30545.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30545.log.gz 2024-09-11T14:52:22.633 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.40027.log 2024-09-11T14:52:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45847.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45847.log.gz 2024-09-11T14:52:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56267.log 2024-09-11T14:52:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40027.log: gzip -5 --verbose 49.6% -- /var/log/ceph/ceph-client.admin.59776.log 2024-09-11T14:52:22.633 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40027.log.gz 2024-09-11T14:52:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49288.log 2024-09-11T14:52:22.633 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.56267.log.gz 2024-09-11T14:52:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61862.log 2024-09-11T14:52:22.633 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59776.log.gz 2024-09-11T14:52:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33760.log 2024-09-11T14:52:22.634 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49288.log.gz 2024-09-11T14:52:22.634 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.61862.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31342.log 2024-09-11T14:52:22.634 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61862.log.gz 2024-09-11T14:52:22.634 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56723.log 2024-09-11T14:52:22.634 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33760.log.gz 2024-09-11T14:52:22.634 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39358.log 2024-09-11T14:52:22.634 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31342.log.gz 2024-09-11T14:52:22.634 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56723.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-client.admin.28646.log 2024-09-11T14:52:22.634 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56723.log.gz 2024-09-11T14:52:22.634 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39358.log: gzip 50.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.39358.log.gz 2024-09-11T14:52:22.634 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57777.log 2024-09-11T14:52:22.634 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63209.log 2024-09-11T14:52:22.634 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28646.log.gz 2024-09-11T14:52:22.634 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57826.log 2024-09-11T14:52:22.635 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57777.log.gz 2024-09-11T14:52:22.635 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66230.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63209.log.gz 2024-09-11T14:52:22.635 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.635 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56394.log 2024-09-11T14:52:22.635 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57826.log.gz 2024-09-11T14:52:22.635 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34864.log 2024-09-11T14:52:22.635 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66230.log.gz 2024-09-11T14:52:22.635 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55996.log 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56394.log.gz 2024-09-11T14:52:22.635 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.635 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34864.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59147.log 2024-09-11T14:52:22.635 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34864.log.gz 2024-09-11T14:52:22.635 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43500.log 2024-09-11T14:52:22.635 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55996.log.gz 2024-09-11T14:52:22.636 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46986.log 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59147.log.gz 2024-09-11T14:52:22.636 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.636 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33571.log 2024-09-11T14:52:22.636 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43500.log.gz 2024-09-11T14:52:22.636 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46986.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46986.log.gz 2024-09-11T14:52:22.636 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.61722.log 2024-09-11T14:52:22.636 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33571.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33571.log.gz 2024-09-11T14:52:22.636 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39318.log 2024-09-11T14:52:22.636 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42637.log 2024-09-11T14:52:22.636 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61722.log.gz 2024-09-11T14:52:22.636 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67179.log 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39318.log.gz 2024-09-11T14:52:22.636 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.637 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42637.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42637.log.gz 2024-09-11T14:52:22.637 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37938.log 2024-09-11T14:52:22.637 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67179.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67179.log.gz 2024-09-11T14:52:22.637 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.41908.log 2024-09-11T14:52:22.637 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37938.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37938.log.gz 2024-09-11T14:52:22.637 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57866.log 2024-09-11T14:52:22.637 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36623.log 2024-09-11T14:52:22.637 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41908.log.gz 2024-09-11T14:52:22.637 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44801.log 2024-09-11T14:52:22.637 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57866.log.gz 2024-09-11T14:52:22.637 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32958.log 2024-09-11T14:52:22.637 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36623.log: /var/log/ceph/ceph-client.admin.44801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56912.log 2024-09-11T14:52:22.638 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44801.log.gz 2024-09-11T14:52:22.638 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36623.log.gz 2024-09-11T14:52:22.638 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31580.log 2024-09-11T14:52:22.638 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32958.log.gz 2024-09-11T14:52:22.638 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48943.log 2024-09-11T14:52:22.638 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56912.log.gz 2024-09-11T14:52:22.638 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31580.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-client.admin.29688.log 2024-09-11T14:52:22.638 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31580.log.gz 2024-09-11T14:52:22.638 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44474.log 2024-09-11T14:52:22.638 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48943.log.gz 2024-09-11T14:52:22.638 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34327.log 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29688.log.gz 2024-09-11T14:52:22.638 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.638 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44474.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57350.log 2024-09-11T14:52:22.638 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44474.log.gz 2024-09-11T14:52:22.639 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64052.log 2024-09-11T14:52:22.639 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34327.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34327.log.gz 2024-09-11T14:52:22.639 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57350.log: gzip -5 --verbose -- 49.6% /var/log/ceph/ceph-client.admin.50004.log 2024-09-11T14:52:22.639 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57350.log.gz 2024-09-11T14:52:22.639 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64052.log: gzip 50.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.64052.log.gz -- 2024-09-11T14:52:22.639 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.61411.log 2024-09-11T14:52:22.639 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64842.log 2024-09-11T14:52:22.639 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.50004.log.gz 2024-09-11T14:52:22.639 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48580.log 2024-09-11T14:52:22.639 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61411.log.gz 2024-09-11T14:52:22.639 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55807.log 2024-09-11T14:52:22.639 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64842.log.gz 2024-09-11T14:52:22.639 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55716.log 2024-09-11T14:52:22.639 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48580.log: /var/log/ceph/ceph-client.admin.55807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60422.log 2024-09-11T14:52:22.639 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55807.log.gz 2024-09-11T14:52:22.640 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48580.log.gz 2024-09-11T14:52:22.640 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47924.log 2024-09-11T14:52:22.640 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55716.log.gz 2024-09-11T14:52:22.640 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59461.log 2024-09-11T14:52:22.640 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60422.log.gz 2024-09-11T14:52:22.640 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48047.log 2024-09-11T14:52:22.640 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47924.log.gz 2024-09-11T14:52:22.640 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55947.log 2024-09-11T14:52:22.640 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59461.log.gz 2024-09-11T14:52:22.640 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36176.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48047.log.gz 2024-09-11T14:52:22.640 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.640 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55947.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55947.log.gz 2024-09-11T14:52:22.640 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56185.log 2024-09-11T14:52:22.641 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36176.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36176.log.gz 2024-09-11T14:52:22.641 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56772.log 2024-09-11T14:52:22.641 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56185.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56185.log.gz 2024-09-11T14:52:22.641 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38151.log 2024-09-11T14:52:22.641 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56772.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43540.log 2024-09-11T14:52:22.641 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56772.log.gz 2024-09-11T14:52:22.641 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35422.log 2024-09-11T14:52:22.641 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38151.log.gz 2024-09-11T14:52:22.641 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38571.log 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43540.log.gz 2024-09-11T14:52:22.641 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.641 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35422.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35422.log.gz 2024-09-11T14:52:22.641 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.66171.log 2024-09-11T14:52:22.641 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38571.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38571.log.gz 2024-09-11T14:52:22.642 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39768.log 2024-09-11T14:52:22.642 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32475.log 2024-09-11T14:52:22.642 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66171.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66171.log.gz 2024-09-11T14:52:22.642 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55119.log 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39768.log.gz 2024-09-11T14:52:22.642 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.642 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32475.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37294.log 2024-09-11T14:52:22.642 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32475.log.gz 2024-09-11T14:52:22.642 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46937.log 2024-09-11T14:52:22.642 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55119.log.gz 2024-09-11T14:52:22.642 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53136.log 2024-09-11T14:52:22.642 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37294.log.gz 2024-09-11T14:52:22.642 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67219.log 2024-09-11T14:52:22.642 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46937.log.gz 2024-09-11T14:52:22.642 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5/var/log/ceph/ceph-client.admin.53136.log: --verbose -- /var/log/ceph/ceph-client.admin.36805.log 2024-09-11T14:52:22.642 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53136.log.gz 2024-09-11T14:52:22.643 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50092.log 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67219.log.gz 2024-09-11T14:52:22.643 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.643 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36805.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36805.log.gz 2024-09-11T14:52:22.643 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40748.log 2024-09-11T14:52:22.643 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50092.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50092.log.gz 2024-09-11T14:52:22.643 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61273.log 2024-09-11T14:52:22.643 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40748.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40748.log.gz 2024-09-11T14:52:22.643 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.45228.log 2024-09-11T14:52:22.643 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61273.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.61273.log.gz 2024-09-11T14:52:22.643 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41195.log 2024-09-11T14:52:22.643 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28553.log 2024-09-11T14:52:22.643 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45228.log: /var/log/ceph/ceph-client.admin.41195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46846.log 2024-09-11T14:52:22.644 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45228.log.gz 2024-09-11T14:52:22.644 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41195.log.gz 2024-09-11T14:52:22.644 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42935.log 2024-09-11T14:52:22.644 INFO:teuthology.orchestra.run.smithi103.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.28553.log.gz 2024-09-11T14:52:22.644 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52141.log 2024-09-11T14:52:22.644 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46846.log.gz 2024-09-11T14:52:22.644 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57430.log 2024-09-11T14:52:22.644 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42935.log: /var/log/ceph/ceph-client.admin.52141.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42935.log.gz 2024-09-11T14:52:22.644 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60944.log 2024-09-11T14:52:22.644 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52141.log.gz 2024-09-11T14:52:22.644 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37512.log 2024-09-11T14:52:22.645 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57430.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57430.log.gz 2024-09-11T14:52:22.645 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37681.log 2024-09-11T14:52:22.645 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.60944.log.gz 2024-09-11T14:52:22.645 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64669.log 2024-09-11T14:52:22.645 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37512.log.gz 2024-09-11T14:52:22.645 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48769.log 2024-09-11T14:52:22.645 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37681.log.gz 2024-09-11T14:52:22.645 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5/var/log/ceph/ceph-client.admin.64669.log: --verbose -- /var/log/ceph/ceph-client.admin.41593.log 2024-09-11T14:52:22.645 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64669.log.gz 2024-09-11T14:52:22.645 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48769.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48769.log.gz 2024-09-11T14:52:22.645 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61371.log 2024-09-11T14:52:22.645 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41593.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41593.log.gz 2024-09-11T14:52:22.645 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.63249.log 2024-09-11T14:52:22.646 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61371.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61371.log.gz 2024-09-11T14:52:22.646 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55407.log 2024-09-11T14:52:22.646 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66801.log 2024-09-11T14:52:22.646 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63249.log: /var/log/ceph/ceph-client.admin.55407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57966.log 2024-09-11T14:52:22.646 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63249.log.gz 2024-09-11T14:52:22.646 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55407.log.gz 2024-09-11T14:52:22.646 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54071.log 2024-09-11T14:52:22.646 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66801.log.gz 2024-09-11T14:52:22.646 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62002.log 2024-09-11T14:52:22.646 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57966.log.gz 2024-09-11T14:52:22.646 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44245.log 2024-09-11T14:52:22.646 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54071.log.gz 2024-09-11T14:52:22.647 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.62002.log: -- /var/log/ceph/ceph-client.admin.50431.log 2024-09-11T14:52:22.647 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62002.log.gz 2024-09-11T14:52:22.647 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44245.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44245.log.gz 2024-09-11T14:52:22.647 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67053.log 2024-09-11T14:52:22.647 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50431.log: gzip -5 --verbose -- 49.6% /var/log/ceph/ceph-client.admin.37212.log 2024-09-11T14:52:22.647 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50431.log.gz 2024-09-11T14:52:22.647 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67053.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67053.log.gz 2024-09-11T14:52:22.647 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40387.log 2024-09-11T14:52:22.647 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37212.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60686.log 2024-09-11T14:52:22.647 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37212.log.gz 2024-09-11T14:52:22.647 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52021.log 2024-09-11T14:52:22.647 INFO:teuthology.orchestra.run.smithi103.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.40387.log.gz 2024-09-11T14:52:22.647 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55527.log 2024-09-11T14:52:22.647 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60686.log.gz 2024-09-11T14:52:22.647 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59727.log 2024-09-11T14:52:22.648 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52021.log.gz 2024-09-11T14:52:22.648 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31222.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55527.log.gz 2024-09-11T14:52:22.648 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.648 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59727.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35823.log 2024-09-11T14:52:22.648 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59727.log.gz 2024-09-11T14:52:22.648 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52855.log 2024-09-11T14:52:22.648 INFO:teuthology.orchestra.run.smithi103.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.31222.log.gz 2024-09-11T14:52:22.648 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64345.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35823.log.gz 2024-09-11T14:52:22.648 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.648 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52855.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50222.log 2024-09-11T14:52:22.648 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52855.log.gz 2024-09-11T14:52:22.648 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63736.log 2024-09-11T14:52:22.648 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64345.log.gz 2024-09-11T14:52:22.649 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46306.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50222.log.gz 2024-09-11T14:52:22.649 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.649 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63736.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48669.log 2024-09-11T14:52:22.649 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63736.log.gz 2024-09-11T14:52:22.649 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65835.log 2024-09-11T14:52:22.649 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46306.log.gz 2024-09-11T14:52:22.649 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54464.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48669.log.gz 2024-09-11T14:52:22.649 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.649 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65835.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65835.log.gz 2024-09-11T14:52:22.649 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63785.log 2024-09-11T14:52:22.649 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32775.log 2024-09-11T14:52:22.649 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54464.log.gz 2024-09-11T14:52:22.650 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66759.log 2024-09-11T14:52:22.650 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63785.log.gz 2024-09-11T14:52:22.650 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49546.log 2024-09-11T14:52:22.650 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32775.log.gz 2024-09-11T14:52:22.650 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39627.log 2024-09-11T14:52:22.650 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66759.log.gz 2024-09-11T14:52:22.650 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49119.log 2024-09-11T14:52:22.650 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49546.log.gz 2024-09-11T14:52:22.650 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29785.log 2024-09-11T14:52:22.650 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39627.log: /var/log/ceph/ceph-client.admin.49119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30935.log 2024-09-11T14:52:22.650 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49119.log.gz 2024-09-11T14:52:22.650 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39627.log.gz 2024-09-11T14:52:22.650 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57708.log 2024-09-11T14:52:22.650 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29785.log.gz 2024-09-11T14:52:22.651 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30935.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.30935.log.gz 2024-09-11T14:52:22.651 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64753.log 2024-09-11T14:52:22.651 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57708.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57708.log.gz 2024-09-11T14:52:22.651 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35282.log 2024-09-11T14:52:22.651 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64753.log: gzip -5 --verbose -- 50.4% -- replaced with /var/log/ceph/ceph-client.admin.64753.log.gz 2024-09-11T14:52:22.651 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.36989.log 2024-09-11T14:52:22.651 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35282.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35282.log.gz 2024-09-11T14:52:22.651 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63511.log 2024-09-11T14:52:22.651 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36989.log: gzip 50.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.30496.log 2024-09-11T14:52:22.651 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36989.log.gz 2024-09-11T14:52:22.651 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37828.log 2024-09-11T14:52:22.651 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63511.log.gz 2024-09-11T14:52:22.651 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56443.log 2024-09-11T14:52:22.651 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30496.log.gz 2024-09-11T14:52:22.652 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38845.log 2024-09-11T14:52:22.652 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37828.log.gz 2024-09-11T14:52:22.652 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50025.log 2024-09-11T14:52:22.652 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56443.log.gz 2024-09-11T14:52:22.652 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62890.log 2024-09-11T14:52:22.652 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38845.log.gz 2024-09-11T14:52:22.652 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34556.log 2024-09-11T14:52:22.652 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50025.log.gz 2024-09-11T14:52:22.652 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62890.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62890.log.gz 2024-09-11T14:52:22.652 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35729.log 2024-09-11T14:52:22.652 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34556.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34556.log.gz 2024-09-11T14:52:22.652 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51016.log 2024-09-11T14:52:22.653 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59818.log 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35729.log.gz 2024-09-11T14:52:22.653 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.653 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51016.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51016.log.gz 2024-09-11T14:52:22.653 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63968.log 2024-09-11T14:52:22.653 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.59818.log: /var/log/ceph/ceph-client.admin.57310.log 2024-09-11T14:52:22.653 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59818.log.gz 2024-09-11T14:52:22.653 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63968.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63968.log.gz 2024-09-11T14:52:22.653 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50571.log 2024-09-11T14:52:22.653 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57310.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57310.log.gz 2024-09-11T14:52:22.653 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41146.log 2024-09-11T14:52:22.653 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64535.log 2024-09-11T14:52:22.653 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50571.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50571.log.gz 2024-09-11T14:52:22.653 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56632.log 2024-09-11T14:52:22.654 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41146.log.gz 2024-09-11T14:52:22.654 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53443.log 2024-09-11T14:52:22.654 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64535.log.gz 2024-09-11T14:52:22.654 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39020.log 2024-09-11T14:52:22.654 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56632.log.gz 2024-09-11T14:52:22.654 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60993.log 2024-09-11T14:52:22.654 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53443.log.gz 2024-09-11T14:52:22.654 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40516.log 2024-09-11T14:52:22.654 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39020.log.gz 2024-09-11T14:52:22.654 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40586.log 2024-09-11T14:52:22.654 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60993.log.gz 2024-09-11T14:52:22.654 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55765.log 2024-09-11T14:52:22.654 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40516.log.gz 2024-09-11T14:52:22.655 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31391.log 2024-09-11T14:52:22.655 INFO:teuthology.orchestra.run.smithi103.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.40586.log.gz 2024-09-11T14:52:22.655 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34944.log 2024-09-11T14:52:22.655 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55765.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.55765.log.gz 2024-09-11T14:52:22.655 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.31391.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33482.log 2024-09-11T14:52:22.655 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31391.log.gz 2024-09-11T14:52:22.655 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62673.log 2024-09-11T14:52:22.655 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34944.log.gz 2024-09-11T14:52:22.655 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31133.log 2024-09-11T14:52:22.655 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33482.log.gz 2024-09-11T14:52:22.655 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62673.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-11T14:52:22.655 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62673.log.gz 2024-09-11T14:52:22.655 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61079.log 2024-09-11T14:52:22.655 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31133.log.gz 2024-09-11T14:52:22.656 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37807.log 2024-09-11T14:52:22.656 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.61079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52715.log 2024-09-11T14:52:22.656 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61079.log.gz 2024-09-11T14:52:22.656 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30636.log 2024-09-11T14:52:22.656 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37807.log.gz 2024-09-11T14:52:22.656 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65240.log 2024-09-11T14:52:22.656 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52715.log.gz 2024-09-11T14:52:22.656 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42815.log 2024-09-11T14:52:22.656 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30636.log.gz 2024-09-11T14:52:22.656 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54779.log 2024-09-11T14:52:22.656 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65240.log.gz 2024-09-11T14:52:22.656 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50838.log 2024-09-11T14:52:22.656 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42815.log.gz 2024-09-11T14:52:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29444.log 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54779.log.gz 2024-09-11T14:52:22.657 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50838.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50838.log.gz 2024-09-11T14:52:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61771.log 2024-09-11T14:52:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58849.log 2024-09-11T14:52:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29444.log: /var/log/ceph/ceph-client.admin.61771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64225.log 2024-09-11T14:52:22.657 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61771.log.gz 2024-09-11T14:52:22.657 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29444.log.gz 2024-09-11T14:52:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58849.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58849.log.gz 2024-09-11T14:52:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58803.log 2024-09-11T14:52:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64225.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64225.log.gz 2024-09-11T14:52:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60784.log 2024-09-11T14:52:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47491.log 2024-09-11T14:52:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58803.log: /var/log/ceph/ceph-client.admin.60784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66969.log 2024-09-11T14:52:22.658 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58803.log.gz 2024-09-11T14:52:22.658 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.60784.log.gz 2024-09-11T14:52:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47491.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47491.log.gz 2024-09-11T14:52:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34641.log 2024-09-11T14:52:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40167.log 2024-09-11T14:52:22.658 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66969.log.gz 2024-09-11T14:52:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34641.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33264.log 2024-09-11T14:52:22.658 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34641.log.gz 2024-09-11T14:52:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42955.log 2024-09-11T14:52:22.658 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40167.log.gz 2024-09-11T14:52:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.33264.log: -- /var/log/ceph/ceph-client.admin.64394.log 2024-09-11T14:52:22.658 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33264.log.gz 2024-09-11T14:52:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42955.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41642.log 2024-09-11T14:52:22.659 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42955.log.gz 2024-09-11T14:52:22.659 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36267.log 2024-09-11T14:52:22.659 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64394.log.gz 2024-09-11T14:52:22.659 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.41642.log: /var/log/ceph/ceph-client.admin.38030.log 2024-09-11T14:52:22.659 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41642.log.gz 2024-09-11T14:52:22.659 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36267.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28379.log 2024-09-11T14:52:22.659 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36267.log.gz 2024-09-11T14:52:22.659 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64485.log 2024-09-11T14:52:22.659 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38030.log.gz 2024-09-11T14:52:22.659 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.28379.log: -- /var/log/ceph/ceph-client.admin.59867.log 2024-09-11T14:52:22.659 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28379.log.gz 2024-09-11T14:52:22.659 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64485.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64485.log.gz 2024-09-11T14:52:22.659 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63831.log 2024-09-11T14:52:22.659 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51762.log 2024-09-11T14:52:22.659 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59867.log: /var/log/ceph/ceph-client.admin.63831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33362.log 2024-09-11T14:52:22.660 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59867.log.gz 2024-09-11T14:52:22.660 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63831.log.gz 2024-09-11T14:52:22.660 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57212.log 2024-09-11T14:52:22.660 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51762.log: /var/log/ceph/ceph-client.admin.33362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35778.log 2024-09-11T14:52:22.660 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51762.log.gz 2024-09-11T14:52:22.660 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33362.log.gz 2024-09-11T14:52:22.660 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57212.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57212.log.gz 2024-09-11T14:52:22.660 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35987.log 2024-09-11T14:52:22.660 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49824.log 2024-09-11T14:52:22.660 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35778.log: /var/log/ceph/ceph-client.admin.35987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44844.log 2024-09-11T14:52:22.660 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35778.log.gz 2024-09-11T14:52:22.660 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35987.log.gz 2024-09-11T14:52:22.660 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49824.log: 50.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.49824.log.gz 2024-09-11T14:52:22.661 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35580.log 2024-09-11T14:52:22.661 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33144.log 2024-09-11T14:52:22.661 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.44844.log: /var/log/ceph/ceph-client.admin.35580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39140.log 2024-09-11T14:52:22.661 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35580.log.gz 2024-09-11T14:52:22.661 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33144.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41505.log 2024-09-11T14:52:22.661 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33144.log.gz 2024-09-11T14:52:22.661 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44156.log 2024-09-11T14:52:22.661 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39140.log.gz 2024-09-11T14:52:22.661 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41505.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41505.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60148.log 2024-09-11T14:52:22.661 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.661 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50351.log 2024-09-11T14:52:22.661 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44156.log.gz 2024-09-11T14:52:22.661 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60148.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60148.log.gz 2024-09-11T14:52:22.662 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49139.log 2024-09-11T14:52:22.662 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60288.log 2024-09-11T14:52:22.662 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50351.log.gz 2024-09-11T14:52:22.662 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49139.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49139.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47126.log 2024-09-11T14:52:22.662 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.662 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62449.log 2024-09-11T14:52:22.662 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60288.log.gz 2024-09-11T14:52:22.662 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54422.log 2024-09-11T14:52:22.662 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0%/var/log/ceph/ceph-client.admin.62449.log: -- replaced with /var/log/ceph/ceph-client.admin.47126.log.gz 2024-09-11T14:52:22.662 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.62449.log.gz 2024-09-11T14:52:22.662 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35689.log 2024-09-11T14:52:22.662 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41816.log 2024-09-11T14:52:22.662 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54422.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.54422.log.gz 2024-09-11T14:52:22.662 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35689.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35689.log.gz 2024-09-11T14:52:22.663 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56674.log 2024-09-11T14:52:22.663 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56045.log 2024-09-11T14:52:22.663 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56674.log: /var/log/ceph/ceph-client.admin.41816.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41816.log.gz 2024-09-11T14:52:22.663 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56674.log.gz 2024-09-11T14:52:22.663 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63556.log 2024-09-11T14:52:22.663 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34247.log 2024-09-11T14:52:22.663 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56045.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.56045.log.gz 2024-09-11T14:52:22.663 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63556.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63556.log.gz 2024-09-11T14:52:22.663 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53813.log 2024-09-11T14:52:22.663 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55667.log 2024-09-11T14:52:22.663 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34247.log: /var/log/ceph/ceph-client.admin.53813.log: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34247.log.gz 2024-09-11T14:52:22.663 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53813.log.gz 2024-09-11T14:52:22.664 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31747.log 2024-09-11T14:52:22.664 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64305.log 2024-09-11T14:52:22.664 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55667.log: /var/log/ceph/ceph-client.admin.31747.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55667.log.gz 2024-09-11T14:52:22.664 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31747.log.gz 2024-09-11T14:52:22.664 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56311.log 2024-09-11T14:52:22.664 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30222.log 2024-09-11T14:52:22.664 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64305.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64305.log.gz 2024-09-11T14:52:22.664 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56311.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56311.log.gz 2024-09-11T14:52:22.664 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34465.log 2024-09-11T14:52:22.664 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46488.log 2024-09-11T14:52:22.664 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30222.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30222.log.gz 2024-09-11T14:52:22.664 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34465.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56085.log 2024-09-11T14:52:22.664 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34465.log.gz 2024-09-11T14:52:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54730.log 2024-09-11T14:52:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46488.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46488.log.gz 2024-09-11T14:52:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54031.log 2024-09-11T14:52:22.665 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56085.log.gz 2024-09-11T14:52:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58614.log 2024-09-11T14:52:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54730.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54730.log.gz 2024-09-11T14:52:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54031.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54031.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59236.log 2024-09-11T14:52:22.665 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:52:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45188.log 2024-09-11T14:52:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.58614.log: /var/log/ceph/ceph-client.admin.59236.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59236.log.gz 2024-09-11T14:52:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37374.log 2024-09-11T14:52:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45188.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45188.log.gz 2024-09-11T14:52:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42250.log 2024-09-11T14:52:22.666 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37374.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37374.log.gz 2024-09-11T14:52:22.666 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63877.log 2024-09-11T14:52:22.666 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42250.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42250.log.gz 2024-09-11T14:52:22.666 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37119.log 2024-09-11T14:52:22.666 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63877.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63877.log.gz 2024-09-11T14:52:22.666 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57470.log 2024-09-11T14:52:22.666 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37119.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37119.log.gz 2024-09-11T14:52:22.666 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35162.log 2024-09-11T14:52:22.666 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57470.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57470.log.gz 2024-09-11T14:52:22.666 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38529.log 2024-09-11T14:52:22.666 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35162.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35162.log.gz 2024-09-11T14:52:22.666 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61042.log 2024-09-11T14:52:22.666 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38529.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38529.log.gz 2024-09-11T14:52:22.666 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47357.log 2024-09-11T14:52:22.667 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61042.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61042.log.gz 2024-09-11T14:52:22.667 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46105.log 2024-09-11T14:52:22.667 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47357.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47357.log.gz 2024-09-11T14:52:22.667 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27357.log 2024-09-11T14:52:22.667 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46105.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46105.log.gz 2024-09-11T14:52:22.667 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40118.log 2024-09-11T14:52:22.667 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.tmp-client.admin.27357.log: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27357.log.gz 2024-09-11T14:52:22.667 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47746.log 2024-09-11T14:52:22.667 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40118.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40118.log.gz 2024-09-11T14:52:22.667 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32426.log 2024-09-11T14:52:22.667 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47746.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47746.log.gz 2024-09-11T14:52:22.667 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47786.log 2024-09-11T14:52:22.667 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32426.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32426.log.gz 2024-09-11T14:52:22.668 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60057.log 2024-09-11T14:52:22.668 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47786.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47786.log.gz 2024-09-11T14:52:22.668 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43680.log 2024-09-11T14:52:22.668 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60057.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60057.log.gz 2024-09-11T14:52:22.668 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48993.log 2024-09-11T14:52:22.668 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43680.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43680.log.gz 2024-09-11T14:52:22.668 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57390.log 2024-09-11T14:52:22.668 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48993.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48993.log.gz 2024-09-11T14:52:22.668 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60864.log 2024-09-11T14:52:22.668 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57390.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57390.log.gz 2024-09-11T14:52:22.668 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43858.log 2024-09-11T14:52:22.668 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60864.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60864.log.gz 2024-09-11T14:52:22.669 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46205.log 2024-09-11T14:52:22.669 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43858.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43858.log.gz 2024-09-11T14:52:22.669 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51276.log 2024-09-11T14:52:22.669 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46205.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46205.log.gz 2024-09-11T14:52:22.669 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28730.log 2024-09-11T14:52:22.669 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51276.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51276.log.gz 2024-09-11T14:52:22.669 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45655.log 2024-09-11T14:52:22.669 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28730.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28730.log.gz 2024-09-11T14:52:22.669 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34597.log 2024-09-11T14:52:22.669 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45655.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45655.log.gz 2024-09-11T14:52:22.669 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34109.log 2024-09-11T14:52:22.669 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34597.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34597.log.gz 2024-09-11T14:52:22.669 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63080.log 2024-09-11T14:52:22.669 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34109.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34109.log.gz 2024-09-11T14:52:22.670 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43282.log 2024-09-11T14:52:22.670 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63080.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63080.log.gz 2024-09-11T14:52:22.670 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46165.log 2024-09-11T14:52:22.670 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43282.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43282.log.gz 2024-09-11T14:52:22.670 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42895.log 2024-09-11T14:52:22.670 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46165.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46165.log.gz 2024-09-11T14:52:22.670 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49248.log 2024-09-11T14:52:22.670 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42895.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42895.log.gz 2024-09-11T14:52:22.670 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35331.log 2024-09-11T14:52:22.670 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49248.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49248.log.gz 2024-09-11T14:52:22.670 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28998.log 2024-09-11T14:52:22.670 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35331.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35331.log.gz 2024-09-11T14:52:22.670 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36945.log 2024-09-11T14:52:22.670 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28998.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28998.log.gz 2024-09-11T14:52:22.670 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45575.log 2024-09-11T14:52:22.671 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36945.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36945.log.gz 2024-09-11T14:52:22.671 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48860.log 2024-09-11T14:52:22.671 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45575.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45575.log.gz 2024-09-11T14:52:22.671 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50173.log 2024-09-11T14:52:22.671 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48860.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48860.log.gz 2024-09-11T14:52:22.671 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35520.log 2024-09-11T14:52:22.671 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50173.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50173.log.gz 2024-09-11T14:52:22.671 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38111.log 2024-09-11T14:52:22.671 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35520.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35520.log.gz 2024-09-11T14:52:22.671 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41286.log 2024-09-11T14:52:22.671 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38111.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38111.log.gz 2024-09-11T14:52:22.671 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56583.log 2024-09-11T14:52:22.671 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41286.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41286.log.gz 2024-09-11T14:52:22.672 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37989.log 2024-09-11T14:52:22.672 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56583.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56583.log.gz 2024-09-11T14:52:22.672 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53933.log 2024-09-11T14:52:22.672 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37989.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37989.log.gz 2024-09-11T14:52:22.672 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33641.log 2024-09-11T14:52:22.672 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53933.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53933.log.gz 2024-09-11T14:52:22.672 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58191.log 2024-09-11T14:52:22.672 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33641.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33641.log.gz 2024-09-11T14:52:22.672 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60337.log 2024-09-11T14:52:22.672 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58191.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58191.log.gz 2024-09-11T14:52:22.672 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58235.log 2024-09-11T14:52:22.672 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60337.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.60337.log.gz 2024-09-11T14:52:22.672 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42032.log 2024-09-11T14:52:22.672 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58235.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58235.log.gz 2024-09-11T14:52:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35907.log 2024-09-11T14:52:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42032.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42032.log.gz 2024-09-11T14:52:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43414.log 2024-09-11T14:52:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35907.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35907.log.gz 2024-09-11T14:52:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52996.log 2024-09-11T14:52:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43414.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43414.log.gz 2024-09-11T14:52:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59636.log 2024-09-11T14:52:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52996.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52996.log.gz 2024-09-11T14:52:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33851.log 2024-09-11T14:52:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59636.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59636.log.gz 2024-09-11T14:52:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48311.log 2024-09-11T14:52:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33851.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33851.log.gz 2024-09-11T14:52:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51056.log 2024-09-11T14:52:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48311.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48311.log.gz 2024-09-11T14:52:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42339.log 2024-09-11T14:52:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51056.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51056.log.gz 2024-09-11T14:52:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65419.log 2024-09-11T14:52:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42339.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42339.log.gz 2024-09-11T14:52:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41335.log 2024-09-11T14:52:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65419.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65419.log.gz 2024-09-11T14:52:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30735.log 2024-09-11T14:52:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41335.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41335.log.gz 2024-09-11T14:52:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45753.log 2024-09-11T14:52:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30735.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30735.log.gz 2024-09-11T14:52:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62051.log 2024-09-11T14:52:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45753.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45753.log.gz 2024-09-11T14:52:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47532.log 2024-09-11T14:52:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62051.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.62051.log.gz 2024-09-11T14:52:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T14:52:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47532.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47532.log.gz 2024-09-11T14:52:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52673.log 2024-09-11T14:52:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.log: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T14:52:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60506.log 2024-09-11T14:52:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52673.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52673.log.gz 2024-09-11T14:52:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33102.log 2024-09-11T14:52:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60506.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60506.log.gz 2024-09-11T14:52:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37037.log 2024-09-11T14:52:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33102.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33102.log.gz 2024-09-11T14:52:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31302.log 2024-09-11T14:52:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37037.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37037.log.gz 2024-09-11T14:52:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52495.log 2024-09-11T14:52:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31302.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31302.log.gz 2024-09-11T14:52:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33313.log 2024-09-11T14:52:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52495.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52495.log.gz 2024-09-11T14:52:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63387.log 2024-09-11T14:52:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33313.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33313.log.gz 2024-09-11T14:52:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54329.log 2024-09-11T14:52:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63387.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63387.log.gz 2024-09-11T14:52:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57688.log 2024-09-11T14:52:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54329.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54329.log.gz 2024-09-11T14:52:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42155.log 2024-09-11T14:52:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57688.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57688.log.gz 2024-09-11T14:52:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29528.log 2024-09-11T14:52:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42155.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42155.log.gz 2024-09-11T14:52:22.677 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50133.log 2024-09-11T14:52:22.677 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29528.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29528.log.gz 2024-09-11T14:52:22.677 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39060.log 2024-09-11T14:52:22.677 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50133.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50133.log.gz 2024-09-11T14:52:22.677 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51435.log 2024-09-11T14:52:22.677 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39060.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39060.log.gz 2024-09-11T14:52:22.677 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50480.log 2024-09-11T14:52:22.677 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51435.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51435.log.gz 2024-09-11T14:52:22.677 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60466.log 2024-09-11T14:52:22.677 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50480.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50480.log.gz 2024-09-11T14:52:22.677 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65667.log 2024-09-11T14:52:22.677 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60466.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60466.log.gz 2024-09-11T14:52:22.677 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33989.log 2024-09-11T14:52:22.678 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65667.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.65667.log.gz 2024-09-11T14:52:22.678 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36485.log 2024-09-11T14:52:22.678 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33989.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33989.log.gz 2024-09-11T14:52:22.678 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65540.log 2024-09-11T14:52:22.678 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36485.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36485.log.gz 2024-09-11T14:52:22.678 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55228.log 2024-09-11T14:52:22.678 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65540.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65540.log.gz 2024-09-11T14:52:22.678 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43073.log 2024-09-11T14:52:22.678 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55228.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55228.log.gz 2024-09-11T14:52:22.678 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40347.log 2024-09-11T14:52:22.678 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43073.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43073.log.gz 2024-09-11T14:52:22.678 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65793.log 2024-09-11T14:52:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40347.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40347.log.gz 2024-09-11T14:52:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53045.log 2024-09-11T14:52:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65793.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65793.log.gz 2024-09-11T14:52:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30594.log 2024-09-11T14:52:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53045.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53045.log.gz 2024-09-11T14:52:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32069.log 2024-09-11T14:52:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30594.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30594.log.gz 2024-09-11T14:52:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52409.log 2024-09-11T14:52:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32069.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32069.log.gz 2024-09-11T14:52:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48231.log 2024-09-11T14:52:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52409.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52409.log.gz 2024-09-11T14:52:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43133.log 2024-09-11T14:52:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48231.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48231.log.gz 2024-09-11T14:52:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66231.log 2024-09-11T14:52:22.680 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43133.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43133.log.gz 2024-09-11T14:52:22.680 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41992.log 2024-09-11T14:52:22.680 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66231.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66231.log.gz 2024-09-11T14:52:22.680 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49506.log 2024-09-11T14:52:22.680 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41992.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41992.log.gz 2024-09-11T14:52:22.680 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58582.log 2024-09-11T14:52:22.680 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49506.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49506.log.gz 2024-09-11T14:52:22.680 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29000.log 2024-09-11T14:52:22.680 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58582.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58582.log.gz 2024-09-11T14:52:22.680 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57608.log 2024-09-11T14:52:22.680 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29000.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29000.log.gz 2024-09-11T14:52:22.680 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58455.log 2024-09-11T14:52:22.681 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57608.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57608.log.gz 2024-09-11T14:52:22.681 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43778.log 2024-09-11T14:52:22.681 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58455.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58455.log.gz 2024-09-11T14:52:22.681 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50529.log 2024-09-11T14:52:22.681 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43778.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43778.log.gz 2024-09-11T14:52:22.681 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49426.log 2024-09-11T14:52:22.681 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50529.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50529.log.gz 2024-09-11T14:52:22.681 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34904.log 2024-09-11T14:52:22.681 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49426.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49426.log.gz 2024-09-11T14:52:22.681 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42379.log 2024-09-11T14:52:22.681 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34904.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34904.log.gz 2024-09-11T14:52:22.681 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51682.log 2024-09-11T14:52:22.681 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42379.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.42379.log.gz 2024-09-11T14:52:22.682 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65071.log 2024-09-11T14:52:22.682 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51682.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51682.log.gz 2024-09-11T14:52:22.682 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53534.log 2024-09-11T14:52:22.682 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65071.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65071.log.gz 2024-09-11T14:52:22.682 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55487.log 2024-09-11T14:52:22.682 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53534.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53534.log.gz 2024-09-11T14:52:22.682 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32726.log 2024-09-11T14:52:22.682 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55487.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55487.log.gz 2024-09-11T14:52:22.682 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53274.log 2024-09-11T14:52:22.682 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32726.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32726.log.gz 2024-09-11T14:52:22.682 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41055.log 2024-09-11T14:52:22.682 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53274.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53274.log.gz 2024-09-11T14:52:22.682 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49726.log 2024-09-11T14:52:22.682 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41055.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41055.log.gz 2024-09-11T14:52:22.683 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41733.log 2024-09-11T14:52:22.683 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49726.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49726.log.gz 2024-09-11T14:52:22.683 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48440.log 2024-09-11T14:52:22.683 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41733.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41733.log.gz 2024-09-11T14:52:22.683 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49377.log 2024-09-11T14:52:22.683 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48440.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48440.log.gz 2024-09-11T14:52:22.683 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63689.log 2024-09-11T14:52:22.683 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49377.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49377.log.gz 2024-09-11T14:52:22.683 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52366.log 2024-09-11T14:52:22.683 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63689.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63689.log.gz 2024-09-11T14:52:22.683 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45397.log 2024-09-11T14:52:22.683 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52366.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52366.log.gz 2024-09-11T14:52:22.683 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31838.log 2024-09-11T14:52:22.683 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45397.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45397.log.gz 2024-09-11T14:52:22.684 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39676.log 2024-09-11T14:52:22.684 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31838.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31838.log.gz 2024-09-11T14:52:22.684 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39229.log 2024-09-11T14:52:22.684 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39676.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39676.log.gz 2024-09-11T14:52:22.684 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62280.log 2024-09-11T14:52:22.684 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39229.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39229.log.gz 2024-09-11T14:52:22.684 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28831.log 2024-09-11T14:52:22.684 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62280.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62280.log.gz 2024-09-11T14:52:22.684 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51325.log 2024-09-11T14:52:22.684 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28831.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28831.log.gz 2024-09-11T14:52:22.684 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51842.log 2024-09-11T14:52:22.684 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51325.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51325.log.gz 2024-09-11T14:52:22.684 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42766.log 2024-09-11T14:52:22.685 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51842.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51842.log.gz 2024-09-11T14:52:22.685 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31978.log 2024-09-11T14:52:22.685 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42766.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42766.log.gz 2024-09-11T14:52:22.685 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38389.log 2024-09-11T14:52:22.685 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31978.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31978.log.gz 2024-09-11T14:52:22.685 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59187.log 2024-09-11T14:52:22.685 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38389.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38389.log.gz 2024-09-11T14:52:22.685 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44707.log 2024-09-11T14:52:22.685 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59187.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59187.log.gz 2024-09-11T14:52:22.685 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52905.log 2024-09-11T14:52:22.685 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44707.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44707.log.gz 2024-09-11T14:52:22.685 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29963.log 2024-09-11T14:52:22.685 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52905.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52905.log.gz 2024-09-11T14:52:22.686 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41775.log 2024-09-11T14:52:22.686 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29963.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29963.log.gz 2024-09-11T14:52:22.686 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57648.log 2024-09-11T14:52:22.686 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41775.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41775.log.gz 2024-09-11T14:52:22.686 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40451.log 2024-09-11T14:52:22.686 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57648.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57648.log.gz 2024-09-11T14:52:22.686 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48902.log 2024-09-11T14:52:22.686 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40451.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40451.log.gz 2024-09-11T14:52:22.686 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47581.log 2024-09-11T14:52:22.686 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48902.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48902.log.gz 2024-09-11T14:52:22.686 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52308.log 2024-09-11T14:52:22.686 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47581.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47581.log.gz 2024-09-11T14:52:22.686 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47666.log 2024-09-11T14:52:22.687 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.52308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60595.log 2024-09-11T14:52:22.687 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47666.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47666.log.gz 2024-09-11T14:52:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39985.log 2024-09-11T14:52:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60595.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60595.log.gz 2024-09-11T14:52:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36854.log 2024-09-11T14:52:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39985.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39985.log.gz 2024-09-11T14:52:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44750.log 2024-09-11T14:52:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36854.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36854.log.gz 2024-09-11T14:52:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55367.log 2024-09-11T14:52:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44750.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44750.log.gz 2024-09-11T14:52:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43818.log 2024-09-11T14:52:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55367.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55367.log.gz 2024-09-11T14:52:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64010.log 2024-09-11T14:52:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43818.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43818.log.gz 2024-09-11T14:52:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35024.log 2024-09-11T14:52:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64010.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64010.log.gz 2024-09-11T14:52:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54289.log 2024-09-11T14:52:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35024.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35024.log.gz 2024-09-11T14:52:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62939.log 2024-09-11T14:52:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54289.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54289.log.gz 2024-09-11T14:52:22.692 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30242.log 2024-09-11T14:52:22.692 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62939.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62939.log.gz 2024-09-11T14:52:22.699 INFO:teuthology.orchestra.run.smithi103.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.37880.log.gz 2024-09-11T14:52:22.704 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56992.log 2024-09-11T14:52:22.704 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30242.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30242.log.gz 2024-09-11T14:52:22.704 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32815.log 2024-09-11T14:52:22.704 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56992.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.56992.log.gz 2024-09-11T14:52:22.704 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31929.log 2024-09-11T14:52:22.704 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32815.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32815.log.gz 2024-09-11T14:52:22.704 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40886.log 2024-09-11T14:52:22.704 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31929.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.31929.log.gz 2024-09-11T14:52:22.705 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28604.log 2024-09-11T14:52:22.709 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40886.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40886.log.gz 2024-09-11T14:52:22.709 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45535.log 2024-09-11T14:52:22.709 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28604.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28604.log.gz 2024-09-11T14:52:22.710 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48133.log 2024-09-11T14:52:22.710 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45535.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45535.log.gz 2024-09-11T14:52:22.710 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35947.log 2024-09-11T14:52:22.710 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48133.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48133.log.gz 2024-09-11T14:52:22.710 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66060.log 2024-09-11T14:52:22.710 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35947.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35947.log.gz 2024-09-11T14:52:22.710 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29276.log 2024-09-11T14:52:22.715 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66060.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66060.log.gz 2024-09-11T14:52:22.715 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53232.log 2024-09-11T14:52:22.716 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29276.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29276.log.gz 2024-09-11T14:52:22.716 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34348.log 2024-09-11T14:52:22.716 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53232.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53232.log.gz 2024-09-11T14:52:22.716 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44076.log 2024-09-11T14:52:22.716 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34348.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.34348.log.gz 2024-09-11T14:52:22.716 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46448.log 2024-09-11T14:52:22.716 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44076.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44076.log.gz 2024-09-11T14:52:22.716 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34158.log 2024-09-11T14:52:22.716 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46448.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46448.log.gz 2024-09-11T14:52:22.722 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64933.log 2024-09-11T14:52:22.722 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34158.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34158.log.gz 2024-09-11T14:52:22.722 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64625.log 2024-09-11T14:52:22.722 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64933.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64933.log.gz 2024-09-11T14:52:22.722 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52624.log 2024-09-11T14:52:22.722 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64625.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64625.log.gz 2024-09-11T14:52:22.722 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62989.log 2024-09-11T14:52:22.723 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52624.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52624.log.gz 2024-09-11T14:52:22.723 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47449.log 2024-09-11T14:52:22.723 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62989.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62989.log.gz 2024-09-11T14:52:22.723 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65877.log 2024-09-11T14:52:22.723 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47449.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47449.log.gz 2024-09-11T14:52:22.740 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61451.log 2024-09-11T14:52:22.740 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65877.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.65877.log.gz 2024-09-11T14:52:22.740 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44525.log 2024-09-11T14:52:22.740 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61451.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61451.log.gz 2024-09-11T14:52:22.740 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58057.log 2024-09-11T14:52:22.740 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44525.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44525.log.gz 2024-09-11T14:52:22.740 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43729.log 2024-09-11T14:52:22.740 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58057.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58057.log.gz 2024-09-11T14:52:22.740 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32597.log 2024-09-11T14:52:22.740 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43729.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43729.log.gz 2024-09-11T14:52:22.741 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59067.log 2024-09-11T14:52:22.741 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32597.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32597.log.gz 2024-09-11T14:52:22.741 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58364.log 2024-09-11T14:52:22.741 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59067.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59067.log.gz 2024-09-11T14:52:22.741 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50669.log 2024-09-11T14:52:22.741 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58364.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58364.log.gz 2024-09-11T14:52:22.741 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52455.log 2024-09-11T14:52:22.741 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50669.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50669.log.gz 2024-09-11T14:52:22.741 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54919.log 2024-09-11T14:52:22.741 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52455.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52455.log.gz 2024-09-11T14:52:22.741 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37170.log 2024-09-11T14:52:22.741 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54919.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54919.log.gz 2024-09-11T14:52:22.741 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48489.log 2024-09-11T14:52:22.741 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37170.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37170.log.gz 2024-09-11T14:52:22.742 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61491.log 2024-09-11T14:52:22.742 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48489.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48489.log.gz 2024-09-11T14:52:22.742 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32557.log 2024-09-11T14:52:22.742 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61491.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61491.log.gz 2024-09-11T14:52:22.742 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35867.log 2024-09-11T14:52:22.742 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32557.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32557.log.gz 2024-09-11T14:52:22.742 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60197.log 2024-09-11T14:52:22.742 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35867.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35867.log.gz 2024-09-11T14:52:22.751 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58978.log 2024-09-11T14:52:22.752 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60197.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60197.log.gz 2024-09-11T14:52:22.752 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40846.log 2024-09-11T14:52:22.752 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58978.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.58978.log.gz 2024-09-11T14:52:22.752 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52236.log 2024-09-11T14:52:22.752 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40846.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40846.log.gz 2024-09-11T14:52:22.752 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54819.log 2024-09-11T14:52:22.752 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52236.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52236.log.gz 2024-09-11T14:52:22.752 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39399.log 2024-09-11T14:52:22.752 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54819.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.54819.log.gz 2024-09-11T14:52:22.752 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38670.log 2024-09-11T14:52:22.752 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39399.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39399.log.gz 2024-09-11T14:52:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33006.log 2024-09-11T14:52:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38670.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38670.log.gz 2024-09-11T14:52:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66359.log 2024-09-11T14:52:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33006.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.33006.log.gz 2024-09-11T14:52:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53354.log 2024-09-11T14:52:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66359.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66359.log.gz 2024-09-11T14:52:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44036.log 2024-09-11T14:52:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53354.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53354.log.gz 2024-09-11T14:52:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59285.log 2024-09-11T14:52:22.760 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44036.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.44036.log.gz 2024-09-11T14:52:22.760 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36665.log 2024-09-11T14:52:22.760 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59285.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59285.log.gz 2024-09-11T14:52:22.760 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56814.log 2024-09-11T14:52:22.760 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36665.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36665.log.gz 2024-09-11T14:52:22.760 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31084.log 2024-09-11T14:52:22.760 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56814.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56814.log.gz 2024-09-11T14:52:22.760 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65111.log 2024-09-11T14:52:22.760 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31084.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31084.log.gz 2024-09-11T14:52:22.760 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56534.log 2024-09-11T14:52:22.761 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65111.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.65111.log.gz 2024-09-11T14:52:22.761 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45936.log 2024-09-11T14:52:22.761 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56534.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56534.log.gz 2024-09-11T14:52:22.761 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55447.log 2024-09-11T14:52:22.761 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45936.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45936.log.gz 2024-09-11T14:52:22.767 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64143.log 2024-09-11T14:52:22.767 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55447.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55447.log.gz 2024-09-11T14:52:22.767 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44930.log 2024-09-11T14:52:22.767 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64143.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64143.log.gz 2024-09-11T14:52:22.767 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37254.log 2024-09-11T14:52:22.767 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44930.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44930.log.gz 2024-09-11T14:52:22.767 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36225.log 2024-09-11T14:52:22.768 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37254.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37254.log.gz 2024-09-11T14:52:22.768 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62400.log 2024-09-11T14:52:22.768 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36225.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36225.log.gz 2024-09-11T14:52:22.768 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41424.log 2024-09-11T14:52:22.768 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62400.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62400.log.gz 2024-09-11T14:52:22.768 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36445.log 2024-09-11T14:52:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41424.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41424.log.gz 2024-09-11T14:52:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42717.log 2024-09-11T14:52:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36445.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36445.log.gz 2024-09-11T14:52:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63447.log 2024-09-11T14:52:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42717.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42717.log.gz 2024-09-11T14:52:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59107.log 2024-09-11T14:52:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63447.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63447.log.gz 2024-09-11T14:52:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66885.log 2024-09-11T14:52:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59107.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59107.log.gz 2024-09-11T14:52:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44623.log 2024-09-11T14:52:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66885.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66885.log.gz 2024-09-11T14:52:22.778 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46797.log 2024-09-11T14:52:22.778 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44623.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44623.log.gz 2024-09-11T14:52:22.778 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46588.log 2024-09-11T14:52:22.778 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46797.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46797.log.gz 2024-09-11T14:52:22.778 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28464.log 2024-09-11T14:52:22.778 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46588.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46588.log.gz 2024-09-11T14:52:22.779 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62806.log 2024-09-11T14:52:22.779 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28464.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28464.log.gz 2024-09-11T14:52:22.779 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62094.log 2024-09-11T14:52:22.782 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62806.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62806.log.gz 2024-09-11T14:52:22.782 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30777.log 2024-09-11T14:52:22.782 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62094.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62094.log.gz 2024-09-11T14:52:22.782 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29402.log 2024-09-11T14:52:22.782 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30777.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.30777.log.gz 2024-09-11T14:52:22.782 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66927.log 2024-09-11T14:52:22.782 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29402.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29402.log.gz 2024-09-11T14:52:22.787 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48351.log 2024-09-11T14:52:22.787 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66927.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66927.log.gz 2024-09-11T14:52:22.788 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42113.log 2024-09-11T14:52:22.788 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48351.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48351.log.gz 2024-09-11T14:52:22.788 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63338.log 2024-09-11T14:52:22.788 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42113.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.42113.log.gz 2024-09-11T14:52:22.788 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46717.log 2024-09-11T14:52:22.788 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63338.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.63338.log.gz 2024-09-11T14:52:22.788 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48531.log 2024-09-11T14:52:22.788 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46717.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.46717.log.gz 2024-09-11T14:52:22.793 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55079.log 2024-09-11T14:52:22.793 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48531.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48531.log.gz 2024-09-11T14:52:22.793 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50710.log 2024-09-11T14:52:22.793 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55079.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55079.log.gz 2024-09-11T14:52:22.793 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52575.log 2024-09-11T14:52:22.793 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50710.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50710.log.gz 2024-09-11T14:52:22.793 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46397.log 2024-09-11T14:52:22.793 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52575.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52575.log.gz 2024-09-11T14:52:22.794 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60380.log 2024-09-11T14:52:22.794 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46397.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46397.log.gz 2024-09-11T14:52:22.798 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43373.log 2024-09-11T14:52:22.798 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60380.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.60380.log.gz 2024-09-11T14:52:22.799 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65961.log 2024-09-11T14:52:22.799 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43373.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43373.log.gz 2024-09-11T14:52:22.799 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53982.log 2024-09-11T14:52:22.799 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65961.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.65961.log.gz 2024-09-11T14:52:22.799 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46016.log 2024-09-11T14:52:22.799 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53982.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53982.log.gz 2024-09-11T14:52:22.799 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54597.log 2024-09-11T14:52:22.799 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46016.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46016.log.gz 2024-09-11T14:52:22.804 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63169.log 2024-09-11T14:52:22.804 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54597.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54597.log.gz 2024-09-11T14:52:22.804 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30312.log 2024-09-11T14:52:22.804 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63169.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63169.log.gz 2024-09-11T14:52:22.804 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56863.log 2024-09-11T14:52:22.805 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30312.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30312.log.gz 2024-09-11T14:52:22.805 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35073.log 2024-09-11T14:52:22.805 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56863.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.56863.log.gz 2024-09-11T14:52:22.805 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50976.log 2024-09-11T14:52:22.805 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35073.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35073.log.gz 2024-09-11T14:52:22.810 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56354.log 2024-09-11T14:52:22.810 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50976.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50976.log.gz 2024-09-11T14:52:22.810 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66339.log 2024-09-11T14:52:22.810 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56354.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56354.log.gz 2024-09-11T14:52:22.810 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57121.log 2024-09-11T14:52:22.810 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66339.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.66339.log.gz 2024-09-11T14:52:22.810 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58106.log 2024-09-11T14:52:22.810 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57121.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57121.log.gz 2024-09-11T14:52:22.810 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66399.log 2024-09-11T14:52:22.810 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58106.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58106.log.gz 2024-09-11T14:52:22.815 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44334.log 2024-09-11T14:52:22.815 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66399.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66399.log.gz 2024-09-11T14:52:22.815 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40307.log 2024-09-11T14:52:22.815 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44334.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44334.log.gz 2024-09-11T14:52:22.815 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29827.log 2024-09-11T14:52:22.815 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40307.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40307.log.gz 2024-09-11T14:52:22.816 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52278.log 2024-09-11T14:52:22.816 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29827.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29827.log.gz 2024-09-11T14:52:22.816 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66063.log 2024-09-11T14:52:22.816 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52278.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52278.log.gz 2024-09-11T14:52:22.822 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47399.log 2024-09-11T14:52:22.822 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66063.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66063.log.gz 2024-09-11T14:52:22.822 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64713.log 2024-09-11T14:52:22.822 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47399.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47399.log.gz 2024-09-11T14:52:22.822 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54681.log 2024-09-11T14:52:22.822 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64713.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.64713.log.gz 2024-09-11T14:52:22.822 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47316.log 2024-09-11T14:52:22.822 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54681.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54681.log.gz 2024-09-11T14:52:22.822 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43331.log 2024-09-11T14:52:22.822 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47316.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47316.log.gz 2024-09-11T14:52:22.822 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51374.log 2024-09-11T14:52:22.823 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43331.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43331.log.gz 2024-09-11T14:52:22.828 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32637.log 2024-09-11T14:52:22.829 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51374.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51374.log.gz 2024-09-11T14:52:22.829 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30355.log 2024-09-11T14:52:22.829 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32637.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32637.log.gz 2024-09-11T14:52:22.829 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45976.log 2024-09-11T14:52:22.829 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30355.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30355.log.gz 2024-09-11T14:52:22.829 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62848.log 2024-09-11T14:52:22.829 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45976.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45976.log.gz 2024-09-11T14:52:22.829 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45796.log 2024-09-11T14:52:22.829 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62848.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62848.log.gz 2024-09-11T14:52:22.829 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36127.log 2024-09-11T14:52:22.829 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45796.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45796.log.gz 2024-09-11T14:52:22.835 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51414.log 2024-09-11T14:52:22.835 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36127.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36127.log.gz 2024-09-11T14:52:22.835 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34984.log 2024-09-11T14:52:22.835 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51414.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51414.log.gz 2024-09-11T14:52:22.835 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29169.log 2024-09-11T14:52:22.835 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34984.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34984.log.gz 2024-09-11T14:52:22.836 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55625.log 2024-09-11T14:52:22.836 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29169.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29169.log.gz 2024-09-11T14:52:22.836 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45139.log 2024-09-11T14:52:22.836 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55625.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55625.log.gz 2024-09-11T14:52:22.836 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45446.log 2024-09-11T14:52:22.836 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45139.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45139.log.gz 2024-09-11T14:52:22.842 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43194.log 2024-09-11T14:52:22.842 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45446.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45446.log.gz 2024-09-11T14:52:22.842 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52535.log 2024-09-11T14:52:22.842 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43194.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43194.log.gz 2024-09-11T14:52:22.842 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34287.log 2024-09-11T14:52:22.842 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52535.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52535.log.gz 2024-09-11T14:52:22.842 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28407.log 2024-09-11T14:52:22.842 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34287.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34287.log.gz 2024-09-11T14:52:22.842 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49964.log 2024-09-11T14:52:22.842 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28407.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28407.log.gz 2024-09-11T14:52:22.842 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54111.log 2024-09-11T14:52:22.842 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49964.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.49964.log.gz 2024-09-11T14:52:22.847 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59027.log 2024-09-11T14:52:22.847 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54111.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54111.log.gz 2024-09-11T14:52:22.847 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32383.log 2024-09-11T14:52:22.847 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59027.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59027.log.gz 2024-09-11T14:52:22.847 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42201.log 2024-09-11T14:52:22.848 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32383.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32383.log.gz 2024-09-11T14:52:22.848 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36903.log 2024-09-11T14:52:22.848 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42201.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42201.log.gz 2024-09-11T14:52:22.848 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33055.log 2024-09-11T14:52:22.848 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36903.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36903.log.gz 2024-09-11T14:52:22.852 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37414.log 2024-09-11T14:52:22.852 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33055.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33055.log.gz 2024-09-11T14:52:22.852 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58929.log 2024-09-11T14:52:22.852 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37414.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37414.log.gz 2024-09-11T14:52:22.852 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38480.log 2024-09-11T14:52:22.853 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58929.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58929.log.gz 2024-09-11T14:52:22.853 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36763.log 2024-09-11T14:52:22.853 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38480.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38480.log.gz 2024-09-11T14:52:22.853 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37334.log 2024-09-11T14:52:22.856 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36763.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36763.log.gz 2024-09-11T14:52:22.856 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67011.log 2024-09-11T14:52:22.856 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37334.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37334.log.gz 2024-09-11T14:52:22.856 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65379.log 2024-09-11T14:52:22.856 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67011.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67011.log.gz 2024-09-11T14:52:22.857 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63031.log 2024-09-11T14:52:22.857 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65379.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65379.log.gz 2024-09-11T14:52:22.860 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28940.log 2024-09-11T14:52:22.860 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63031.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63031.log.gz 2024-09-11T14:52:22.860 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44385.log 2024-09-11T14:52:22.860 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28940.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.28940.log.gz 2024-09-11T14:52:22.860 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45896.log 2024-09-11T14:52:22.860 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44385.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44385.log.gz 2024-09-11T14:52:22.861 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49077.log 2024-09-11T14:52:22.864 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45896.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45896.log.gz 2024-09-11T14:52:22.864 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54191.log 2024-09-11T14:52:22.864 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49077.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.49077.log.gz 2024-09-11T14:52:22.864 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33402.log 2024-09-11T14:52:22.864 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54191.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.54191.log.gz 2024-09-11T14:52:22.864 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28829.log 2024-09-11T14:52:22.865 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33402.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33402.log.gz 2024-09-11T14:52:22.865 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28829.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28829.log.gz 2024-09-11T14:52:22.907 INFO:teuthology.orchestra.run.smithi103.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.44844.log.gz 2024-09-11T14:52:22.953 INFO:teuthology.orchestra.run.smithi103.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.58614.log.gz 2024-09-11T14:52:22.987 INFO:teuthology.orchestra.run.smithi103.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.29857.log.gz 2024-09-11T14:52:23.002 INFO:teuthology.orchestra.run.smithi103.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.52308.log.gz 2024-09-11T14:52:23.062 INFO:teuthology.orchestra.run.smithi103.stderr: 89.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-11T14:52:54.996 INFO:teuthology.orchestra.run.smithi176.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-11T14:52:58.893 INFO:teuthology.orchestra.run.smithi176.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-11T14:52:58.894 INFO:teuthology.orchestra.run.smithi176.stderr: 2024-09-11T14:52:58.895 INFO:teuthology.orchestra.run.smithi176.stderr:real 0m36.655s 2024-09-11T14:52:58.895 INFO:teuthology.orchestra.run.smithi176.stderr:user 1m7.154s 2024-09-11T14:52:58.895 INFO:teuthology.orchestra.run.smithi176.stderr:sys 0m2.180s 2024-09-11T14:52:59.621 INFO:teuthology.orchestra.run.smithi103.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-11T14:53:00.047 INFO:teuthology.orchestra.run.smithi103.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-11T14:53:00.050 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T14:53:00.050 INFO:teuthology.orchestra.run.smithi103.stderr:real 0m37.856s 2024-09-11T14:53:00.050 INFO:teuthology.orchestra.run.smithi103.stderr:user 1m16.154s 2024-09-11T14:53:00.050 INFO:teuthology.orchestra.run.smithi103.stderr:sys 0m2.905s 2024-09-11T14:53:00.050 INFO:tasks.ceph:Archiving logs... 2024-09-11T14:53:00.050 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901362/remote/smithi103/log 2024-09-11T14:53:00.052 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T14:53:14.196 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901362/remote/smithi176/log 2024-09-11T14:53:14.197 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T14:53:26.518 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T14:53:26.526 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T14:53:26.527 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T14:53:26.530 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T14:53:26.599 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T14:53:26.607 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T14:53:26.607 DEBUG:teuthology.orchestra.run.smithi103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T14:53:26.610 DEBUG:teuthology.orchestra.run.smithi176:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T14:53:26.624 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-11T14:53:26.627 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2024-09-11T14:53:26.629 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T14:53:26.629 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-11T14:53:26.629 INFO:teuthology.orchestra.run.smithi103.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 +1013us[+1021us] +/- 60ms 2024-09-11T14:53:26.629 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 -644us[ -636us] +/- 59ms 2024-09-11T14:53:26.629 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -520us[ -512us] +/- 90ms 2024-09-11T14:53:26.629 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:53:26.634 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T14:53:26.634 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2024-09-11T14:53:26.634 INFO:teuthology.orchestra.run.smithi176.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 +993us[+1003us] +/- 60ms 2024-09-11T14:53:26.634 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 11 -653us[ -644us] +/- 59ms 2024-09-11T14:53:26.634 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 -540us[ -540us] +/- 90ms 2024-09-11T14:53:26.634 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:53:26.634 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T14:53:26.644 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T14:53:26.644 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T14:53:26.663 DEBUG:teuthology.orchestra.run.smithi103:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T14:53:26.756 DEBUG:teuthology.orchestra.run.smithi176:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T14:53:26.822 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T14:53:26.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:53:26.853 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T14:53:26.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:53:26.882 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T14:53:26.891 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T14:53:26.913 INFO:teuthology.task.internal:Duration was 1469.672846 seconds 2024-09-11T14:53:26.914 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T14:53:26.947 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T14:53:26.947 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T14:53:26.950 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T14:53:26.988 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T14:53:26.991 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T14:53:27.232 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T14:53:27.233 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi103.front.sepia.ceph.com 2024-09-11T14:53:27.233 DEBUG:teuthology.orchestra.run.smithi103:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T14:53:27.293 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi176.front.sepia.ceph.com 2024-09-11T14:53:27.293 DEBUG:teuthology.orchestra.run.smithi176:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T14:53:27.323 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T14:53:27.323 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T14:53:27.335 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T14:53:27.389 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T14:53:27.389 DEBUG:teuthology.orchestra.run.smithi103:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T14:53:27.401 DEBUG:teuthology.orchestra.run.smithi176:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T14:53:27.533 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T14:53:27.543 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T14:53:27.543 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T14:53:27.568 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T14:53:27.593 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T14:53:27.602 DEBUG:teuthology.orchestra.run.smithi103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T14:53:27.611 DEBUG:teuthology.orchestra.run.smithi176:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T14:53:27.632 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = core 2024-09-11T14:53:27.656 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = core 2024-09-11T14:53:27.675 DEBUG:teuthology.orchestra.run.smithi103:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T14:53:27.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:53:27.711 DEBUG:teuthology.orchestra.run.smithi176:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T14:53:27.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:53:27.729 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T14:53:27.740 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T14:53:27.740 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901362/remote/smithi103 2024-09-11T14:53:27.741 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T14:53:27.786 DEBUG:teuthology.misc:Transferring archived files from smithi176:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901362/remote/smithi176 2024-09-11T14:53:27.786 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T14:53:27.819 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T14:53:27.819 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T14:53:27.823 DEBUG:teuthology.orchestra.run.smithi176:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T14:53:27.868 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T14:53:27.882 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T14:53:27.882 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T14:53:27.945 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T14:53:27.946 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T14:53:27.948 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T14:53:27.961 INFO:teuthology.orchestra.run.smithi103.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 14:53 /home/ubuntu/cephtest 2024-09-11T14:53:27.963 INFO:teuthology.orchestra.run.smithi176.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 14:53 /home/ubuntu/cephtest 2024-09-11T14:53:27.964 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T14:53:27.981 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T14:53:28.050 INFO:teuthology.run:Summary data: description: crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore thrashers/simple thrashosds-health workloads/radosbench} duration: 1469.6728460788727 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-11T14:53:28.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T14:53:28.128 INFO:teuthology.run:pass